If you guys knew the crap I have to deal with every day to keep this running. The world is full of *******s just looking to exploit your data in whatever way possible.
I recently tracked the 'possible' issue to freaking ChiComm robots who refuse to obey the robots.txt rules. If they had not been so greedy and only slurped a few pages on occasion, it would not have been a problem. But, Noooooooo.
I was parsing the access log in real time looking for their signature, blocking IPS one-by-one. Seconds later they would respawn to a new IP. After a few hours of this, I finally limited them down to their 2 primary subnets (all the numbers were in the same range, before they were all over the place). I ended up blocking 2 major subnets from commie land.
Things seem better since then. If you see more problems, please message me directly, better yet, email me. You should be able to figure out my email address as it is very straightforward.
Now, I'm dealing with the ****tards at Twitter. I am going to start a new thread on that one.