Frequently Asked Questions - FAQ

We've put together a series of the most common questions and comments that come through our inbox and done our best to answer them as thoroughly as we can right here. If you still have a question, please feel free to drop us a line.

What Is A Robots.txt file?

A robots.txt file provides restrictions to search engine robots (known as "bots") that crawl the web. These bots are automated, and before they access pages of a site, they check to see if a robots.txt file exists that prevents them from accessing certain pages.

Do I Need The File?

You only need a robots.txt if your site includes content that you don't want search engines to index.  You may wish to exclude certain areas such as promotional pages that are duplicate content.

If you want search engines to index everything in your site, you don't need a robots.txt file (not even an empty one).

What Does It Cost To Put A Robots.txt File On My Site

We include in our prices the building of a robots.txt file for the new web site we design for you.

If you have an existing site, we charge $25 to construct a robots.txt file. Any modifications to the file at a later date (you decide you want to exclude other folders, files etc) usually costs about $7.50 as it falls under our Web Site Maintenance program