Search Form

Matt Cutts Confirms Media Bot Crawling For Big Daddy

At the Lunch sponsored by Google today Matt Cutts confirmed the recent rumors about media bot results getting into Big Daddy. Matt said it is a bandwidth saving feature to have GoogleBot and MediaBot both contributing to big daddy. Matt also stated that you will gain zero advantage in search listings however if you are serving different content to MediaBot then to Googlebot then you could be in trouble.



Please read this disclaimer before acting on this post.
  • 44 comments. What say you?
    • RSS

Who's talking about it?

  1. Sammy Sullivan
  2. Shortcuts … Mediapartner Googlebot pro Bigdaddy, neue Google Patente & Google Earth Radarfallen … | SEO BLOG
  3. Google的Robots.txt指南 - 博客优化 - 菠萝油
  4. Tips en Truks voor Zoekmachine Optimalisatie - Ulco.nl
  5. MetaContents » Meta News Clips For The Week Of June 16th, 2006 » Interactive Search Engine Marketing and Optimization
  6. ZillionBits-Its about number$ and technology » Are AdSense publishers being favored with more frequent indexing?
  7. SEO Expert
  8. ?索引擎优化排??SEO?天一贴
  9. SEO Expert » Blog Archive » Getting Sites Indexed Quicker with Adsense?
  10. Street Lessons » Yes, MediaBot is also acting as GoogleBot! Matt Cutts confirms.
  11. Unofficial SEO Blog » Matt Cutts Confirms Adsense mediapartners Bot Indexing Pages For GoogleBot - SEO Information much before its official!
  12. AdSense Spider Cross-Pollinates for Google : Natural Search Blog
  13. Google Adsense Bot News » TheSMSGuide Blog » Blog Archive » Google Adsense Bot News
  14. @-web Suchmaschinen Weblog
  15. nonBot SEO Blog » AdSense MediaBot Indexing - nonBot.com
  16. Search Engine Journal » Google AdSense MediaBot is Crawling Sites says Matt Cutts
  17. Référencement, Design et Cie
  18. Make Easy Money with Google and AdSense
  19. Important Information For Cloakers SEO Black Hat: Black Hat SEO Blog
  20. » This and that
  21. Davilac.net » Mediapartners sí indexa para Google
  22. Google Adsense Bot Moonlighting » JANGRO - Affiliate Marketing & SEO
  23. JenSense - Making Sense of Contextual Advertising
  24. Shortcuts … Mediapartner Googlebot pro Bigdaddy, neue Google Patente & Google Earth Radarfallen …
  25. Blog de Max Glaser » Blog Archive » Matt Cutts confirma que el AdSense bot escanea para Bigdaddy
  26. ottz Blog » AdSense-Bot auf Abwegen
  27. Brian’s Business Blog » Google confirms Adsense adds to index
  28. Webmaster Blog
  29. Google’s mediabot bruges til almindelig crawling! - Mikkel deMib Svendsen

Comments

  1. Stock Disposal

    As again Matt has briefed us on a Strong Anti Spam thing from G. Well Done Matt

  2. McCrown

    Because of comment from “nonBot? with link to this domain:
    The domain http://www.nonbot.com is expired. All Tools on this site aren’t still alive.

  3. McCrown

    Because of comment from “nonBot SEO Blog » AdSense MediaBot Indexing – nonBot.com” with link to this domain:
    The domain http://www.nonbot.com is expired. All Tools on this site aren’t still alive.

  4. DA

    So, no more testing with AdSense code on the page!
    It only made sense (no pun) that they’d share the crawled content. It would also be awfully nice if the regular index gets fed into mediabot’s index. This way the ads on a page that was crawled before will show relevant ads even to the very first human visiting the page

  5. pilkster

    I think the adsense TOS prohibts running ads on password protected content. You might want to check if this is a concern for you.

    pilks.

  6. Jim

    Matt Cutts Has confirmed that the adsense mediabot is working for collecting websities content for search index. So, there is no surprise because Goolge always look for content which will be serve by website owner to human visitors.

    Jim

  7. AdSense MediaBot Indexing

    Over a year ago I put AdSense on a site that was getting limited traffic and only had a couple hundred indexed pages. Being this site was a directory, I should have had thousands of indexed pages. Anyway, I added the code into a global footer and forgot about it.

    Then about a week later, when I was going over some SEO data I noticed my indexed pages had jumped to 25,000. All these new indexed pages had that global footer. Of course this led me to believe the AdSense ads had something to do with it.

  8. yeah and also

    it’ll be a while before google confirms this, but the number of adsense impressions significantly impacts your placement. i won’t say where, but we’ve done some tests, and shooting an URL to the top of the list for a specific search term via this method is pretty cake. Meanwhile, legitimate sites that have good content aren’t getting indexed by the bot at all.

  9. Hunox

    How about legal cases e.g. “members only” areas and such? What if mediabot indexes those and puts those pages into serps. This is just plain wrong!

  10. Brandon

    I thought Matt went to Yahoo!…

  11. dan kavanaugh

    it only combats blue collar cloaking

  12. SEOidiot

    hmmm and what about them crawling with no useragent all the time now???????

  13. Eric Giguere

    Like I said yesterday, this is good. And remember, Google always wants to see what data you’re serving your human visitors, so this really shouldn’t be a surprise.

  14. Jason Murphy

    A slight bandwidth saving feature for webmasters too, not just Google. Especially true for large gallery or media sites.

  15. SanDiegoSEO

    Just another good tactic to combat cloaking

Trackbacks url:

By commenting on this post you agree to the comment policy

Leave a Comment...