The forum of the forums
Welcome to the Official Support Forum of Forumotion!

To take full advantage of everything offered by our forum, please log in if you are already a member, or join our community if you've not yet.



Create a free forum like this one.

In the BBS of robots.txt file should have "the user-agent: Baiduspider" don't let baidu grab total content! The official addres

View previous topic View next topic Go down

In the BBS of robots.txt file should have "the user-agent: Baiduspider" don't let baidu grab total content! The official addres

Post by hiwwe on September 23rd 2014, 5:39 pm

Today received a letter from baidu is as follows:


http://www.wwe911.com/ : website baidu for the total ban on sep 20, 2014


Dear webmaster:


After the examination, the website http://www.wwe911.com/ has carried on the robots to baidu total ban, Baiduspider couldn't grab the web pages of the site. Would you please to check the details in the Robots tools.


Testing time: 2014-09-20 03:00:00


I have a look at http://www.wwe911.com/robots.txt file should have "the user-agent: Baiduspider" don't let baidu grab total content!


You ought to get rid of this, let baidu included my BBS content properly!

hiwwe
Forumember

Posts : 31
Reputation : 1
Language : cn

Back to top Go down

Re: In the BBS of robots.txt file should have "the user-agent: Baiduspider" don't let baidu grab total content! The official addres

Post by hiwwe on September 23rd 2014, 5:41 pm

I do not want to change this yourself "Robots.txt" file, I just want to have your official change this file, don't shielding baidu search engine spiders. Official, please remove the "the user-agent: Baiduspider" field.

hiwwe
Forumember

Posts : 31
Reputation : 1
Language : cn

Back to top Go down

Re: In the BBS of robots.txt file should have "the user-agent: Baiduspider" don't let baidu grab total content! The official addres

Post by SLGray on September 23rd 2014, 7:32 pm

For suggestions for all forum, you need to start a suggestion here - http://help.forumotion.com/f30-suggestions-for-your-forums .

Topic Locked

P.S.  You might want to do a search of Baidu.  You will notice many complains about it not following robot.txt instructions and other issues.


When your topic has been solved, ensure you mark the topic solved.
Never post your email in public.


SLGray
Administrator
Administrator

Male Posts : 36698
Reputation : 2445
Language : English
Location : United States

http://ztwds.forumotion.com/

Back to top Go down

View previous topic View next topic Back to top


 
Permissions in this forum:
You cannot reply to topics in this forum