# Robots.txt file # http://www.robotstxt.org/wc/norobots.html # All robots will spider the domain User-agent: * Disallow: /css/ Disallow: /data/ Disallow: /images/ Disallow: /keurmerken/