Phil wilson responded to my rant about blogs & porn
Porn sites add themselves to your referrer list in order to boost their
position in search engines! It emerged as the latest trick about two months
ago, I think Dave Winer mentioned it on his blog at some point.
I don’t think there’s any way around it, but you could always add your
referrers page to robots.txt to stop search engines listing it.
and here’s Dave’s mention
Referer spam is starting to get pretty annoying. A couple of weeks ago we finally figured out why porn sites add themselves to referer pages on high page-rank sites: to improve their placement in search engines. Last night at dinner Andrew Grumet came up with the solution. In robots.txt specifically tell Googlebot and its relatives to not index the Referers page. Then the spammers won’t get the page-rank they seek. Maybe they’ll bother someone else.
More info about robots.tx here. So the robots.txt would look like:
User-agent: * Disallow: /Referrers/
Now should a default Robots.txt be created by roller for every user? Dave/Lance/Matt/Anthony any ideas?
