At the Lunch sponsored by Google today Matt Cutts confirmed the recent rumors about media bot results getting into Big Daddy. Matt said it is a bandwidth saving feature to have GoogleBot and MediaBot both contributing to big daddy. Matt also stated that you will gain zero advantage in search listings however if you are serving different content to MediaBot then to Googlebot then you could be in trouble.
Matt Cutts Confirms Media Bot Crawling For Big Daddy
April 18, 2006
About The Author
Jeremy Schoemaker
Jeremy "ShoeMoney" Schoemaker is the founder & CEO of ShoeMoney Media Group, and to date has sold 6 companies and done over 10 million in affiliate revenue. In 2013 Jeremy released his #1 International Best selling Autobiography titled "Nothing's Changed But My Change" - The ShoeMoney Story. You can read more about Jeremy on his wikipedia page here.
SanDiegoSEO
Just another good tactic to combat cloaking
Jason Murphy
A slight bandwidth saving feature for webmasters too, not just Google. Especially true for large gallery or media sites.
Eric Giguere
Like I said yesterday, this is good. And remember, Google always wants to see what data you’re serving your human visitors, so this really shouldn’t be a surprise.
SEOidiot
hmmm and what about them crawling with no useragent all the time now???????
dan kavanaugh
it only combats blue collar cloaking
Brandon
I thought Matt went to Yahoo!…
Hunox
How about legal cases e.g. “members only” areas and such? What if mediabot indexes those and puts those pages into serps. This is just plain wrong!
yeah and also
it’ll be a while before google confirms this, but the number of adsense impressions significantly impacts your placement. i won’t say where, but we’ve done some tests, and shooting an URL to the top of the list for a specific search term via this method is pretty cake. Meanwhile, legitimate sites that have good content aren’t getting indexed by the bot at all.
AdSense MediaBot Indexing
Over a year ago I put AdSense on a site that was getting limited traffic and only had a couple hundred indexed pages. Being this site was a directory, I should have had thousands of indexed pages. Anyway, I added the code into a global footer and forgot about it.
Then about a week later, when I was going over some SEO data I noticed my indexed pages had jumped to 25,000. All these new indexed pages had that global footer. Of course this led me to believe the AdSense ads had something to do with it.
Jim
Matt Cutts Has confirmed that the adsense mediabot is working for collecting websities content for search index. So, there is no surprise because Goolge always look for content which will be serve by website owner to human visitors.
Jim
pilkster
I think the adsense TOS prohibts running ads on password protected content. You might want to check if this is a concern for you.
pilks.
DA
So, no more testing with AdSense code on the page!
It only made sense (no pun) that they’d share the crawled content. It would also be awfully nice if the regular index gets fed into mediabot’s index. This way the ads on a page that was crawled before will show relevant ads even to the very first human visiting the page
McCrown
Because of comment from “nonBot SEO Blog » AdSense MediaBot Indexing – nonBot.com” with link to this domain:
The domain http://www.nonbot.com is expired. All Tools on this site aren’t still alive.
McCrown
Because of comment from “nonBot? with link to this domain:
The domain http://www.nonbot.com is expired. All Tools on this site aren’t still alive.
Stock Disposal
As again Matt has briefed us on a Strong Anti Spam thing from G. Well Done Matt
John
another technique to penalize website.