1.) How do I use a Robots file or do you have an example of one? A. You mean robots.txt. It’s a file in the main directory of a website which tells the search engine spiders where they are allowed to go. A basic, spider can go anywhere file is: User-agent: * Disallow: You can disallow folders or files by putting this into the file: User-agent: * Disallow: /foldername/...