# Exclude Files From All Robots: User-agent: * Disallow: /media/ Disallow: /blog.php Disallow: /search/ Disallow: /lib/ Crawl-delay: 5 # End robots.txt file