# robots.txt for http://penrules.net User-agent: Googlebot-Image* Disallow: / User-agent: Googlebot* Disallow: / User-agent: Mediapartners-Google* Disallow: / User-agent: YahooFeedSeeker* Disallow: / User-agent: BlogPulseLive* Disallow: / User-agent: Moreoverbot* Disallow: / User-Agent: * Disallow: / # Mobile Site (duplicate content) Sitemap: http://penrules.net/sitemap.xml.gz Crawl-delay: 30 Sitemap: http://penrules.mobi/sitemap.xml