Sean Collins

sean [at] seanmcollins [dot] com

GPG Key ID: 0xf60f564978913931

sean [at] coreitpro [dot] com

GPG Key ID: 0xA1D7E590

profile for Sean at Stack Overflow, Q&A for professional and enthusiast programmers

Baiduspider 404 Urls

I’m also seeing a bunch of crap from Baiduspider

180.76.5.172 - - [05/Feb/2013:11:44:59 -0500] "GET /seattle-used-cars-lynnwood/detail/2012-Mazda-3-s-Grand-Touring/6/JM1BL1M61C1531842 HTTP/1.1" 404 240 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
180.76.6.16 - - [23/Mar/2013:13:26:37 -0400] "GET /enamel-martini-glass-charm-10k-yellow-gold/p-04461868000P HTTP/1.1" 404 221 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
180.76.5.65 - - [23/Mar/2013:13:38:37 -0400] "GET /east-point-sports-7ft-3-in-1-swivel/p-00639650000P HTTP/1.1" 404 216 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
180.76.5.62 - - [23/Mar/2013:13:50:37 -0400] "GET /electrolux-24inch-built-in-dishwasher/p-02211406000P HTTP/1.1" 404 216 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
180.76.5.103 - - [23/Mar/2013:14:02:37 -0400] "GET /duracell-car-charger-for-blackberry-treo-cellular-phones/p-00333840000P HTTP/1.1" 404 228 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
180.76.5.91 - - [23/Mar/2013:14:14:37 -0400] "GET /dockers-women-8217-s-sunglasses-square-silver/p-088VA53880912P HTTP/1.1" 404 227 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"

A looooooot of it.

scollins@Uller ~/Downloads/logs » wc 404_spam_urls.txt
   30554   30554 1797957 404_spam_urls.txt