A robots file not being found

[Peak Times]

My home page contains the following code:

<meta name="Robots" content="Index,follow">
<meta name="Revisit-after" content="7 days">

However looking at the google webmaster analysis it tells me that they cannot find it with the following ref:

404 (Not found) [?]

Is the problem that this code is in the home page header or am I missing something.

As ever any help would be appreciated as not receiving decent page rankings in google is driving me around the bend.

Many thanks,

www.peak-times.com

 

[StephanieCordray]

google looks for a file called robots.txt which has all the stuff you want the robots to index in it and the stuff you don't want them to index... like images, etc.

Try this: http://www.seochat.com/seo-tools/robots-generator/ then save your text file and upload it to the public_html folder.

 

[DLPerry]

My home page contains the following code:

<meta name="Robots" content="Index,follow">
<meta name="Revisit-after" content="7 days">

However looking at the google webmaster analysis it tells me that they cannot find it with the following ref:

404 (Not found) [?]

Is the problem that this code is in the home page header or am I missing something.

As ever any help would be appreciated as not receiving decent page rankings in google is driving me around the bend.

Many thanks,

www.peak-times.com

Do you mean it cannot locate your homepage (http://your.domain) or your robots.txt file (http://your.domain/robots.txt) ?

The Meta robots attribute in your header is used (sometimes) to tell robots what they should do when crawling a page, and can vary from page to page.

The robots.txt protocol is an Exclusion protocal - telling bots what they should NOT crawl - on a domain/sitewide basis.