robots.txt
is a file used by convention to tell web spiders (systems like those at Google or Microsoft that “crawl the web,” indexing files for their search engines) to ignore certain files. It seems that someone at Last.fm has a geeky sense of humor…
User-Agent: *
Disallow: /music?
Disallow: /widgets/radio?
Disallow: /show_ads.php
Disallow: /affiliate/
Disallow: /affiliate_redirect.php
Disallow: /affiliate_sendto.php
Disallow: /affiliatelink.php
Disallow: /campaignlink.php
Disallow: /delivery.php
Disallow: /music/+noredirect/
Disallow: /harming/humans
Disallow: /ignoring/human/orders
Disallow: /harm/to/self
Allow: /
See it? If not, brush up on your Asimov and look again. 😉
(Via BoingBoing)