Google Search Appliance DOS

When does a Google Search Appliance become evil? When it mercilessly pounds your site 24x7.

Temple University has a Google Search appliance that indexes content, and as the admin for the Temple ACM I watch my poor server get smacked around.

[root@acmsrv1 httpd]# grep 'websupport@temple.edu' access_log* | wc 621428 9321420 122998794

Oh the humanity!

I’m hoping that tweaking our robots.txt will fix the issue.