Isn’t it interesting what you find in robots files

by Peter Young on September 5, 2008 · 0 comments

John Hill over at E-Gain New Media sent me a link to these files he found in the robots.txt file for

and of particular interest

This got me trying a number of other iterations, with bringing back some rather ‘different’ results

Taken from

Taken from

Any other intesting snapshots out there?

Google+ Comments

Leave a Comment

Previous post:

Next post: