The forum of the forums
Welcome to the Official Support Forum of Forumotion!

To take full advantage of everything offered by our forum, please log in if you are already a member, or join our community if you've not yet.



Create a free forum like this one.

Google Robots.txt

View previous topic View next topic Go down

Solved Google Robots.txt

Post by RServers on March 23rd 2011, 3:56 am

Is there any way to allow Google to crawl my web pages, it keeps giving me the "robots.txt" error.
is there any way to allow google to crawl my website?

Notice: sorry if in wrong section/ reposted this!


Last edited by RServers on March 23rd 2011, 10:15 pm; edited 1 time in total

RServers
New Member

Posts : 9
Reputation : 0
Language : Gaffney, South Carolina

Back to top Go down

Solved Re: Google Robots.txt

Post by MrMario on March 23rd 2011, 4:28 am

You can't do much with the robot.txt

What does the error that Google tells you? It could be that it hasn't found the code. I know it takes at least a couple hours to find it.

MrMario
Helper
Helper

Male Posts : 22186
Reputation : 1830
Language : test

http://test.com

Back to top Go down

Solved Re: Google Robots.txt

Post by kirk on March 23rd 2011, 4:51 am

you have to have your permissions set for guest if you want it to gather information as well, bots cas only gather what they have access to

kirk
Forumaster

Male Posts : 11037
Reputation : 651
Language : English,Vulcan,Klingon, Romulan,& Gorn

Back to top Go down

Solved Re: Google Robots.txt

Post by RServers on March 23rd 2011, 10:15 pm

thanks marked as solved please lock?

RServers
New Member

Posts : 9
Reputation : 0
Language : Gaffney, South Carolina

Back to top Go down

Solved Re: Google Robots.txt

Post by kirk on March 23rd 2011, 10:48 pm

@RServers wrote:thanks marked as solved please lock?

Your welcome Smile

Since the topic was marked as solved i will now lock

kirk
Forumaster

Male Posts : 11037
Reputation : 651
Language : English,Vulcan,Klingon, Romulan,& Gorn

Back to top Go down

View previous topic View next topic Back to top


 
Permissions in this forum:
You cannot reply to topics in this forum