#1
|
||||
|
||||
Code to reduce the load of bots on system.
Added a change to my web server to redirect a very bot specific code to a forbidden page. AI bots are slowing the site down and I hope this will help.
This is a very brute force way of stopping them, and it may effect normal users so let me know if you see an issue. Particularly if you use some sort of app forum reader there might be issues. Hopefully this does not effect our meat users and slows down Skynet's eventual take over of the world. PM or Email if you do see any issues. |
#2
|
||||
|
||||
Since it has been a few days without issues, I modified the response to bot code a bit further. Now you will no longer see forbidden the link simply will not do anything.
This step fully stops the bots from pulling any of our bandwidth whereas the prior step lowered their bandwidth and cpu usage by about 75%. Again hopefully this will help with speed particularly for the times the bots are pulling 10 pages a second. Ok if you ever see a link and it goes nowhere let me know. Thanks Kato |
#3
|
||||
|
||||
Thank you for keeping up with the infrastructure support, Kato.
- C.
__________________
Clayton A. Oliver • Occasional RPG Freelancer Since 1996 Author of The Pacific Northwest, coauthor of Tara Romaneasca, creator of several other free Twilight: 2000 and Twilight: 2013 resources, and curator of an intermittent gaming blog. It rarely takes more than a page to recognize that you're in the presence of someone who can write, but it only takes a sentence to know you're dealing with someone who can't. - Josh Olson |
#4
|
||||
|
||||
I second that thanks. Its much appreciated.
|
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
|
|