Robots.txt best practice guide + examples The robots.txt file is an often overlooked and sometimes forgotten part of a website and SEO. Here's what it is, examples, how to's, and tips for success.