hide from Google

[GRY086]

So the site I'm working on has an admin page. Seems to me that this should be made unavailable to search engines. I already put it in an .htAccess controlled directory, but still, I want it hidden from spiders and such. any idea how?

 

[3dmagicaldesign]

You may find this website interesting: http://www.robotstxt.org/robotstxt.html

That will help you to disallow the search engine spiders or whatever you want to disallow.

Enjoy!!

 

[sheanhoxie]

Hey GRY086, be aware that there are spiders out there that will completely ignore your robots.txt (some even exploit it by seeing what you want ignored) so pay special attention to the link 3dmagical posted when they speak about "bad robots"

 

[digtech]

I was surprised to see my website show up on google when I searched my name which was also in the html. Actually go by my middle name now for that reason.

 

[pingeyeg]

You gotta use a robots.txt file and tell the robots they're not allowed in.

 

[cmjvulavala]

You can also use .htaccess as an extra layer or protection for your admin folder (generate one login username and password and admins will be able to access the login page but search engines wont be able to

 

[conor]

i have a site that doesnt have any meta tags and its been up for 7 months and google still hasn't found it.

the spiders might find it eventually though.......