Keith's Weblog: Comments on "Inktomi is the worst spider ever", posted on September 16, 2003 http://keithdevens.com/weblog/archive/2003/Sep/16/Inktomi.worst-spider en-us http://keithdevens.com/weblog http://keithdevens.com/images/kbd.gif http://keithdevens.com/weblog/archive/2003/Sep/16/Inktomi.worst-spider#comment2939 http://keithdevens.com/weblog/4247#comment2939 Fri, 19 Sep 2003 12:10:45 +0000 <p class="st-markup">Yeah Inktomi is the same for me. It seems to have a problem following links, especially ones beginning with a slash '/' because I'm getting strange 404 errors for pages that have never existed too.</p>