# (c) triplemind.com # Version: $Id: robots.xml 84151 2010-02-02 11:46:23Z cgaffga $ # # dyn-gen robots text, robots = 'true' # # Please, we do NOT allow nonauthorized robots. # Any unauthorized bot running will result in IP's being banned. Agent spoofing # is considered a bot. Fair warning to the clueless - honey pots are - and have # been - running. If you have been banned for bot running - please contact an # admin for a reinclusion request. # # We use wildcard extensions for dynamic areas of the site which we don't need # spidered. Note: these are extensions to the basic standard as defined here: # http://www.google.com/support/webmasters/bin/answer.py?answer=40367 # only certain robots (only Googlebot?) may acknowledge them. User-agent: * Disallow: /auth/ Disallow: /safe/ Disallow: /tmp/ Disallow: /temp/ Disallow: /work/ Disallow: /security/ Disallow: /component/ Disallow: /reqa/ Disallow: /map/ Disallow: *.pdf User-agent: Mediapartners-Google Allow: / User-agent: Googlebot Disallow: /auth/ Disallow: /safe/ Disallow: /tmp/ Disallow: /temp/ Disallow: /work/ Disallow: /security/ Disallow: /component/ Disallow: /reqa/ Disallow: /map/ Disallow: */booking/* Disallow: *bookmark* Disallow: *gallery* Disallow: accommodation/**/print.pdf Disallow: */advanced.html Sitemap: /site/sitemap.xml Sitemap: /accommodation/sitemap.xml Sitemap: /query/sitemap.xml Sitemap: /directory/sitemap.xml