# robots.txt for http://www.hotelhunter.co.uk/ Sitemap: http://www.hotelhunter.co.uk/sitemap-index.xml User-agent: * Disallow: / User-agent: Mediapartners-Google Disallow: User-agent: ia_archiver User-agent: ArchitextSpider User-agent: Baiduspider User-agent: Googlebot User-agent: Googlebot-Image User-agent: msnbot User-agent: msnbot-media User-agent: Scooter User-agent: Slurp User-agent: Snappy User-agent: Teoma User-agent: Yahoo-Blogs User-agent: Yahoo-MMCrawler User-agent: Yandex Disallow: /book/ Disallow: /fags/ Disallow: /search/ Disallow: /users/