################################# sample robots.txt file for this website ## addresses all robots by using wild card *#User-agent: *# list folders robots are not allowed to index# Disallow: /tutorials/meta/## list specific files robots are not allowed to index## Disallow: /tutorials/meta_tags.html# Disallow: /tutorials/custom_error_page.html## End of robots.txt file# Sitemap:http://www.pixellence.co.uk/sitemap.xml