1.) How do I use a Robots file or do you have an example of one?

A. You mean robots.txt. It’s a file in the main directory of a website which tells the search engine spiders where they are allowed to go.

A basic, spider can go anywhere file is:

User-agent: *

Disallow:

You can disallow folders or files by putting this into the file:

User-agent: *

Disallow: /foldername/ (more…)