Tag: robots.txt

  • killer-robots.txt

    Nice one: http://www.google.com/killer-robots.txt User-Agent: T-1000 User-Agent: T-800 Disallow: /+LarryPage Disallow: /+SergeyBrin via Hackernews.