Search Bots Bing & Google

The Search Bots Bing & Google were on my forum all day yesterday and all night last night and are still on there today, I'm talking about 7 or 9 at a time continuously all the time. Bots usually in the past just spend several minutes and then they are gone, and there is usually just one of them but yesterday and today these bots are still there and 8 or 9 of the same kind bing and google! Whats going on here?

Ask google or bing. To be honest, its good that they are on your forum for a longer time.

Forums with large post counts get quite a few bots, this is because google, yahoo and bing is constantly adding pages and images to their search engines.

Could it be that I used to have my forum open for members only but now it is open to guests to read? I changed it for Guests to read also a bout 1 month ago. I'm thinking that maybe now they are catching up to scanning all the pages because before they wouldn't because the forum was closed to guests. I have thousands of topics and pages, and my forum has been verified by both google and bing.

runawayhorses wrote:Could it be that I used to have my forum open for members only but now it is open to guests to read? I changed it for Guests to read also a bout 1 month ago. I'm thinking that maybe now they are catching up to scanning all the pages because before they wouldn't because the forum was closed to guests. I have thousands of topics and pages, and my forum has been verified by both google and bing.

That could be the most likely possible answer.

Yes I think that is probably it, they are catching up scanning all the pages that they couldn't before. But even so I think 24 hours is an awful long time.

I'm happy about the bots are scanning the forum, that is the reason I have my site verified by google and bing, I just think 25 hours is a long time and was wondering if anyone else was getting this too.

Hi runawayhorses,

I can tell you that Google and Bing have done a lot of updates to there sites and as some one else has said this is to put more of your site on the net. As most of you should know by now yahoo and Bing are now one so when Bing comes up on your site that is also yahoo some of us still get yahoo come up on our sites that is down to the update's not changing there logo on all the sites yet.

Most of all if your site has been hid to guests for a long time Google has to find the post that have not been read by them so yes it will take longer to do so.

I know for sure that Google and Bing read the post 3 or 4 times a day and if there is a lot to read it will take forever.

I think you should not Worry about it it's a good thing there coming on your site and the more there come the better as this will keep your site up to date on the world wide web (internet)

Hope this is to some help to you.

Ape

Hi!

As more google or another search engines stay on your site as better. But, it depends of how many pages your forum have. As more forum pages you have as more time crawlers will stay on your forum.

And yes, APE's really right. They read the same pages more times, because if you edited some content from that page google will update & index it.

P.S. pages = all links from your forum, this meant categoryes, forums, topics, who is online page, pages from navbar and other more.

So, you should do your best for keeping google (or another engines) crawlers on your forum. It will help you with improving froum SEO. Also note that, crawlers behave almost like a simple guest. So, if you'll disable acces for guests, crawlers also, will not index your pages that can't see guests.

Hope I was clear.

Yes I know if your forum is closed to guests the bots will not scan pages guests can't read, but my forum IS open to guests so the bots are no doubt scanning all the pages. I have thousands and thousands of topics and posts so the bots have there work cut out for them. I guess they will be there all the time now, but thats a good thing. I also have that sharing thing enabled so "Similar" topics and posts from other forumotion forums shows up below my forum topic pages. Don't know what the bots make of that.

That's great, I should congratulate you for this. Keep it up with new & interesting topics so this will increase google activity on your board.

Be sure, there is no to worry about. This is great.

Thank you Coddy..

And thanks to everyone, APE, Sanket, acaelusthorne, for your input..