Code to reduce the load of bots on system.

[kato13]

Added a change to my web server to redirect a very bot specific code to a forbidden page. AI bots are slowing the site down and I hope this will help.

This is a very brute force way of stopping them, and it may effect normal users so let me know if you see an issue. Particularly if you use some sort of app forum reader there might be issues. Hopefully this does not effect our meat users and slows down Skynet's eventual take over of the world.

PM or Email (mailto:rpgstuff@juhlin.com) if you do see any issues.

[kato13]

Since it has been a few days without issues, I modified the response to bot code a bit further. Now you will no longer see forbidden the link simply will not do anything.

This step fully stops the bots from pulling any of our bandwidth whereas the prior step lowered their bandwidth and cpu usage by about 75%. Again hopefully this will help with speed particularly for the times the bots are pulling 10 pages a second.

Ok if you ever see a link and it goes nowhere let me know.


Thanks
Kato

[Tegyrius]

Thank you for keeping up with the infrastructure support, Kato.

- C.

[The Zappster]

I second that thanks. Its much appreciated.