The forum of the forums

Would you like to react to this message? Create an account in a few clicks or log in to continue.
The forum of the forums
2 posters

    Robots.txt File Preventing Indexing

    avatar
    Bully@Wiiplaza
    Forumember


    Male Posts : 127
    Reputation : 4
    Language : English

    Robots.txt File Preventing Indexing Empty Robots.txt File Preventing Indexing

    Post by Bully@Wiiplaza August 31st 2014, 12:26 pm

    Hello,

    when I search my forum on Google it will say that the description is not available due to my robots.txt file. Also, if I search the contents of a specific post, it doesn't show up on Google but it does on Bing. Shocked
    It is allowed for guests to see.

    I didn't even install such a file nor do I know how to do it. Please help me to get rid of it. What are the possible causes? Confused

    I'm using a meta tag called "google-site-verification" and "google-translate-customization".
    tugatech
    tugatech
    Forumember


    Male Posts : 186
    Reputation : 8
    Language : Portuguese
    Location : Portugal

    Robots.txt File Preventing Indexing Empty Re: Robots.txt File Preventing Indexing

    Post by tugatech August 31st 2014, 3:38 pm

    The Google bot only doesn't have access to some specific pages, like:
    Code:
    Disallow: /abuse
    Disallow: /admgt/
    Disallow: /contact
    Disallow: /donate
    Disallow: /go/
    Disallow: /login
    Disallow: /modcp
    Disallow: /post
    Disallow: /privmsg
    Disallow: /spa/
    Disallow: /sta/

    The rest of the website should be indexed...

    What you are telling should be becouse your sub-forums are protected by login. So only registed users could login. The google bot can access that pages and doesn't show the description of the topic/page..
    avatar
    Bully@Wiiplaza
    Forumember


    Male Posts : 127
    Reputation : 4
    Language : English

    Robots.txt File Preventing Indexing Empty Re: Robots.txt File Preventing Indexing

    Post by Bully@Wiiplaza August 31st 2014, 4:34 pm

    The sub-forums which don't show up on Google are accessible for guests. Bing does pick them up and I can view the content as guest. So you're saying that there's nothing wrong with the robots.txt file? But why does it say that site description etc. are not available? It worked a while ago, I just don't know what changed and why some sub-forums/ topics are no longer picked up by Google. Confused


    Last edited by Bully@Wiiplaza on August 31st 2014, 4:42 pm; edited 1 time in total
    tugatech
    tugatech
    Forumember


    Male Posts : 186
    Reputation : 8
    Language : Portuguese
    Location : Portugal

    Robots.txt File Preventing Indexing Empty Re: Robots.txt File Preventing Indexing

    Post by tugatech August 31st 2014, 4:41 pm

    Can you give a example?

      Current date/time is November 14th 2024, 12:58 pm