Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Same here.

I run a very small browser game (~120 weekly users currently), and until I put its Wiki (utterly uninteresting to anyone who doesn't already play the game) behind a login-wall, the bots were causing massive amounts of spurious traffic. Due to some of the Wiki's data coming live from the game through external data feeds, the deluge of bots actually managed to crash the game several times, necessitating a restart of the MariaDB process.





Wikis seems to attract AI bots like crazy, especially the bad kind that will attempt any type of cache invalidation available to them.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: