# http://search.msn.com/docs/siteowner.aspx?t=SEARCH_WEBMASTER_FAQ_MSNBotIndexing.htm#D # msnbot is a bit aggressive; it's 50% of my hits in March 2007; about 150Mb # seems to come by about once a minute. Double it. Means it will take about # a week to index the entire site. I'm okay with that. #User-agent: msnbot #Crawl-delay: 120 # Not a big fan of turnitin. And frankly, who'd plagarize a gaming database? User-agent: TurnitinBot Disallow: / # nameprotect copyright scanners. User-agent: NPBot Disallow: /