The forum of the forums
Welcome to the Official Support Forum of Forumotion!

To take full advantage of everything offered by our forum, please log in if you are already a member, or join our community if you've not yet.



Create a free forum like this one.

Robots.txt File Preventing Indexing

View previous topic View next topic Go down

Robots.txt File Preventing Indexing

Post by Bully@Wiiplaza on August 31st 2014, 12:26 pm

Hello,

when I search my forum on Google it will say that the description is not available due to my robots.txt file. Also, if I search the contents of a specific post, it doesn't show up on Google but it does on Bing. Shocked
It is allowed for guests to see.

I didn't even install such a file nor do I know how to do it. Please help me to get rid of it. What are the possible causes?Confused

I'm using a meta tag called"google-site-verification" and "google-translate-customization".

Bully@Wiiplaza
Forumember

Male Posts : 127
Reputation : 4
Language : English

http://www.bullywiihacks.com/

Back to top Go down

Re: Robots.txt File Preventing Indexing

Post by tugatech on August 31st 2014, 3:38 pm

The Google bot only doesn't have access to some specific pages, like:
Code:
Disallow: /abuse
Disallow: /admgt/
Disallow: /contact
Disallow: /donate
Disallow: /go/
Disallow: /login
Disallow: /modcp
Disallow: /post
Disallow: /privmsg
Disallow: /spa/
Disallow: /sta/

The rest of the website should be indexed...

What you are telling should be becouse your sub-forums are protected by login. So only registed users could login. The google bot can access that pages and doesn't show the description of the topic/page..

tugatech
Forumember

Male Posts : 175
Reputation : 8
Language : Portuguese
Location : Portugal

Back to top Go down

Re: Robots.txt File Preventing Indexing

Post by Bully@Wiiplaza on August 31st 2014, 4:34 pm

The sub-forums which don't show up on Google are accessible for guests. Bing does pick them up and I can view the content as guest. So you're saying that there's nothing wrong with the robots.txt file? But why does it say that site description etc. are not available? It worked a while ago, I just don't know what changed and why some sub-forums/ topics are no longer picked up by Google. Confused


Last edited by Bully@Wiiplaza on August 31st 2014, 4:42 pm; edited 1 time in total

Bully@Wiiplaza
Forumember

Male Posts : 127
Reputation : 4
Language : English

http://www.bullywiihacks.com/

Back to top Go down

Re: Robots.txt File Preventing Indexing

Post by tugatech on August 31st 2014, 4:41 pm

Can you give a example?

tugatech
Forumember

Male Posts : 175
Reputation : 8
Language : Portuguese
Location : Portugal

Back to top Go down

View previous topic View next topic Back to top


 
Permissions in this forum:
You cannot reply to topics in this forum