The forum of the forums
Would you like to react to this message? Create an account in a few clicks or log in to continue.

Google Robots.txt

3 posters

Go down

Solved Google Robots.txt

Post by RServers March 23rd 2011, 3:56 am

Is there any way to allow Google to crawl my web pages, it keeps giving me the "robots.txt" error.
is there any way to allow google to crawl my website?

Notice: sorry if in wrong section/ reposted this!


Last edited by RServers on March 23rd 2011, 10:15 pm; edited 1 time in total
avatar
RServers
New Member

Posts : 9
Reputation : 0
Language : Gaffney, South Carolina

Back to top Go down

Solved Re: Google Robots.txt

Post by MrMario March 23rd 2011, 4:28 am

You can't do much with the robot.txt

What does the error that Google tells you? It could be that it hasn't found the code. I know it takes at least a couple hours to find it.
MrMario
MrMario
Helper
Helper

Male Posts : 22186
Reputation : 1839
Language : test

Back to top Go down

Solved Re: Google Robots.txt

Post by kirk March 23rd 2011, 4:51 am

you have to have your permissions set for guest if you want it to gather information as well, bots cas only gather what they have access to
kirk
kirk
Forumaster

Male Posts : 11037
Reputation : 653
Language : English,Vulcan,Klingon, Romulan,& Gorn

Back to top Go down

Solved Re: Google Robots.txt

Post by RServers March 23rd 2011, 10:15 pm

thanks marked as solved please lock?
avatar
RServers
New Member

Posts : 9
Reputation : 0
Language : Gaffney, South Carolina

Back to top Go down

Solved Re: Google Robots.txt

Post by kirk March 23rd 2011, 10:48 pm

RServers wrote:thanks marked as solved please lock?

Your welcome Smile

Since the topic was marked as solved i will now lock
kirk
kirk
Forumaster

Male Posts : 11037
Reputation : 653
Language : English,Vulcan,Klingon, Romulan,& Gorn

Back to top Go down

Back to top

- Similar topics

 
Permissions in this forum:
You cannot reply to topics in this forum