At the Lunch sponsored by Google today Matt Cutts confirmed the recent rumors about media bot results getting into Big Daddy. Matt said it is a bandwidth saving feature to have GoogleBot and MediaBot both contributing to big daddy. Matt also stated that you will gain zero advantage in search listings however if you are serving different content to MediaBot then to Googlebot then you could be in trouble.

By Jeremy Schoemaker

Jeremy "ShoeMoney" Schoemaker is the founder & CEO of ShoeMoney Media Group, and to date has sold 6 companies and done over 10 million in affiliate revenue. In 2013 Jeremy released his #1 International Best selling Autobiography titled "Nothing's Changed But My Change" - The ShoeMoney Story. You can read more about Jeremy on his wikipedia page here.

46 thoughts on “Matt Cutts Confirms Media Bot Crawling For Big Daddy”
  1. […] I dag kunne Matt Cuts sÃ¥ bekræfte at Google’s mediabot faktisk er begyndt at indsamle data til det almindelige indeks. Denne afsløring, eller konfirmation skulle man mÃ¥ske heller sige, fremkom ved et sponseret frokost arrangement i dag i Boston i forbindelse med konferencen PubCon. Technorati Tags: Google, Soegemaskineoptimering […]

  2. Adsense Bot spidert für Big Daddy…

    Bei JenSense wurde kürzlich festgestellt, dass der Mediapartners Googlebot, der eigentlich nur Seiten für die Adsense Einblendungen analysiert, neuerdings auch Webseiten in den Google Suchindex……

  3. A slight bandwidth saving feature for webmasters too, not just Google. Especially true for large gallery or media sites.

  4. Like I said yesterday, this is good. And remember, Google always wants to see what data you’re serving your human visitors, so this really shouldn’t be a surprise.

  5. […] Shoemoney reports that Matt Cutts has confirmed that the AdSense Mediabot is now collecting content for the Big Daddy search index. […]

  6. […] Was JenSense schon vor einiger Zeit geschrieben hat wurde nun auch von Matt Cutts bestätigt. Der Mediapartners-Bot, der eigentlich für die Analyse einer Seite zum Einblenden der passenden Werbung zuständig ist, wird auch eingesetzt um Seiten für den Big Daddy Index zu indizieren. Lange Zeit wurde das von Google selbst bestritten. Doch es besteht ein eindeutiger Zusammenhang zwischen dem Datum der Cacheversion und dem Besuch des Bots. Matt Cutts sagte ausserdem, dass die Indizierung durch den AdSense-Bot für die Seiten weder Vorteile noch Nachteile bringt. Nachteile könnten lediglich entstehen wenn man dem Mediapartners-Bot andere Seiten präsentiere als dem normalen Googlebot. Es werden anscheinend auch nur Seiten aktualisiert, die sich bereits im Index befinden. Der Mediapartners-Bot wird also nicht helfen frisch erstellte Unterseiten in den Index zu bringen. […]

  7. Blog de Max Glaser » Blog Archive » Matt Cutts confirma que el AdSense bot escanea para Bigdaddy says:

    […] ShoeMoney informa que en un almuerzo organizado por Google, Matt ha confirmado los rumores de que el bot de AsSense también se esta usando para el buscador. […]

  8. How about legal cases e.g. “members only” areas and such? What if mediabot indexes those and puts those pages into serps. This is just plain wrong!

  9. Shortcuts … Mediapartner Googlebot pro Bigdaddy, neue Google Patente & Google Earth Radarfallen … says:

    […] Der Mediapartners Googlebot (bisher nur für Adsense zuständig) sammelt lt. Matt Cutts auch Daten für Bigdaddy, allerdings angeblich ohne Ranking Vor- oder Nachteile für Adsense Werbetreibende. Cloaking könnte allerdings nun “gefährlicher” werden … 😉 via ShoeMoney: Matt Cutts Confirms Media Bot Crawling For BigDaddy […]

  10. Matt Cutts confirms AdSense media bot in natural search index…

    Matt Cutts confirmed today that the AdSense mediapartners bot (aka mediabot) is indexing pages for use in the Big Daddy Google index. Both Greg Boser and myself have found evidence of mediabot’s crawls for AdSense ad targeting purposes have ended……

  11. […] Word out of the presently-running WebmasterWorld conference is that Matt Cutts of Google confirms that this is the case. Shoemoney reports that “Matt said it is a bandwidth saving feature to have GoogleBot and MediaBot both contributing to big daddy.” […]

  12. […] Más información: Shoemoney y Jensense. […]

  13. […] Update: Wie Shoemoney berichtet hat Matt Cutts die Gerüchte um den AdSense Bot auf der Pubcon in Boston bestätigt : At the Lunch sponsored by Google today Matt Cutts confirmed the recent rumors about media bot results getting into Big Daddy. Matt said it is a bandwidth saving feature to have GoogleBot and MediaBot both contributing to big daddy. Matt also stated that you will gain zero advantage in search listings however if you are serving different content to MediaBot then to Googlebot then you could be in trouble. […]

  14. […] Shoemoney is reporting that : Matt Cutts confirmed the recent rumors about media bot results getting into Big Daddy. Matt said it is a bandwidth saving feature to have GoogleBot and MediaBot both contributing to big daddy. Matt also stated that you will gain zero advantage in search listings however if you are serving different content to MediaBot then to Googlebot then you could be in trouble. […]

  15. Are AdSense publishers being favored with more frequent indexing?…

    Today I was going to address some of the comments that Stu Drew left about managing to get a high ranking for his private-label rights articles blog entry, but I’m going to defer that to a later time. If you’re interested in that topic, let me point …

  16. Mediapartners utilisé pour l’indexation ?…

    A en croire Matt Cutts qui s’est exprimé à ce sujet au Pubcon de Boston, Mediapartners, le robot d’indexation utilisé normalement pour cibler les liens sponsorisés du programme Google Adsense serait aussi utilisé par Google pour enrichir son ind…

  17. […] Yes, Google is using the AdSense MediaBot to index pages for the Google Big Daddy Index confirms Matt Cutts at PubCon. ShoeMoney has the lowdown on MediaBot and Google’s Big Daddy index: At the Lunch sponsored by Google today Matt Cutts confirmed the recent rumors about media bot results getting into Big Daddy. […]

  18. it’ll be a while before google confirms this, but the number of adsense impressions significantly impacts your placement. i won’t say where, but we’ve done some tests, and shooting an URL to the top of the list for a specific search term via this method is pretty cake. Meanwhile, legitimate sites that have good content aren’t getting indexed by the bot at all.

  19. […] It all started when I was with an SEO company never to be named (I don’t want to give them the exposure). All I can say is ShoeMoney has a picture with their booth girls. Like many of us in this industry, I was running some sites on the side to supplement my income. Then one day I decided to sign up with Google AdSense and deploy the ads. […]

  20. Over a year ago I put AdSense on a site that was getting limited traffic and only had a couple hundred indexed pages. Being this site was a directory, I should have had thousands of indexed pages. Anyway, I added the code into a global footer and forgot about it.

    Then about a week later, when I was going over some SEO data I noticed my indexed pages had jumped to 25,000. All these new indexed pages had that global footer. Of course this led me to believe the AdSense ads had something to do with it.

  21. Trägt Adsense Media Bot zum Google Index bei?…

    Eigentlich ist alles ganz klar. Die Daten der Google Bots landen im Index der die unbezahlten Suchergebnisse ausliefert, dem “Organischen Index”. Die Adsense Media Bots hingegen sammeln Daten um die Seiten auf denen Adsense geschaltet wird, mit kont…

  22. […] Matt Cutts, who is speaking at this week’s PubCon, confirmed that the AdSense mediapartners bot is doing double duty by not only targeting ads for AdSense but also indexing for the regular Google search database, in a bandwidth saving move. Matt also noted that there is no advantage to being indexed by one bot or the other, however, those cloaking content and serving different pages to each bot could run into problems in the search index. Google Adsense ; Google ; Adsense Popularity: unranked […]

  23. […] A few bloggers such as Jenstar have just posted that pages spidered by Google’s AdSense bot are appearing in Google’s regular search results pages. Shoemoney just blogged that Matt Cutts has officially verified that this is happening, saying that this was done so that they wouldn’t have to spider the same content twice, and that Google did this as part of their recent Big Daddy infrastructure improvements. […]

  24. Matt Cutts Has confirmed that the adsense mediabot is working for collecting websities content for search index. So, there is no surprise because Goolge always look for content which will be serve by website owner to human visitors.

    Jim

  25. Unofficial SEO Blog » Matt Cutts Confirms Adsense mediapartners Bot Indexing Pages For GoogleBot - SEO Information much before its official! says:

    […] According to Matt Cutts, the Adsense mediapartners bot is helping Googlebot with indexing. How? Well, this was confirmed by him in this week's Pubcon. In his statement he said that Adsense mediapartners bot is not only focusing on ads for Adsense but also indexing for the regular Google search database, in a bandwidth saving move.Hmm..quite an important thought to think upon.  […]

  26. I think the adsense TOS prohibts running ads on password protected content. You might want to check if this is a concern for you.

    pilks.

  27. […] Matt Cutts has confirmed that Google is in economy mode and is trying to save some bandwidth by combining GoogleBot and MediaBot (AdSense Bot) — in response to the speculations fired up by Jen. Matt said it is a bandwidth saving feature to have GoogleBot and MediaBot both contributing to big daddy. Matt also stated that you will gain zero advantage in search listings however if you are serving different content to MediaBot then to Googlebot then you could be in trouble. […]

  28. So, no more testing with AdSense code on the page!
    It only made sense (no pun) that they’d share the crawled content. It would also be awfully nice if the regular index gets fed into mediabot’s index. This way the ads on a page that was crawled before will show relevant ads even to the very first human visiting the page

  29. […] Now, Matt Cutts confirms that Google’s AdSense mediapartners bot is not only targeting ads for AdSense but is also indexing for the regular Google search database, in an apparent bandwidth saving move. […]

  30. Google Adsense蜘蛛抓å?–的网页在æ?œç´¢ä¸­å‡ºçŽ°…

    �两天Matt Cutts刚刚�实,Google Adsense蜘蛛(Mediapartner bot)所抓�的网页会在Google�索中出现。Matt Cutts说这�是一个节�带宽开支的手段而已。
    由于Google蜘蛛(Googlebot/2.1)所抓å?–的网站之多和频率…

  31. Getting Sites Indexed Quicker with Adsense?…

    While being in a search engine index does not guarantee rankings, it is the first step. SEOs regularly use the Google cache command “cache:http://www.yoursite.com” to determine when a page is in the index and the last spider crawl time.
    No…

  32. ZillionBits-Its about number$ and technology » Are AdSense publishers being favored with more frequent indexing? says:

    […] I want to talk some more about Google’s indexing of AdSense pages. In case you hadn’t heard, Googler Matt Cutts confirmed that the AdSense crawler is feeding pages into Google’s new “BigDaddy” search indexes. This confirms what others had noticed about what the AdSense crawler (usually referred to as the “mediabot”) is doing. Or does it? […]

  33. MetaContents » Meta News Clips For The Week Of June 16th, 2006 » Interactive Search Engine Marketing and Optimization says:

    […] Google confirms use of AdSense bot for regular search results cache Matt Cutts confirmed at the Webmasterworld Pubcon and via his blog that Google uses the AdSense mediapartners bot for the natural results cache. Matt said it is a bandwidth saving feature to have GoogleBot and MediaBot both contributing to big daddy. From Google’s “How do your crawler and site diagnostic reports work?” support page: “The Adsense crawler is different form the Google crawler, but they do share a cache, We do this to avoid both crawlers requesting the same pages, thereby helping publishers converve their bandwidth.” (via JenSense) […]

  34. Because of comment from “nonBot SEO Blog » AdSense MediaBot Indexing – nonBot.com” with link to this domain:
    The domain http://www.nonbot.com is expired. All Tools on this site aren’t still alive.

  35. […] Wat ik bedoel met mediapartners Ruben? Dit…, ik was alleen wat […]

  36. […] Cutts证实mediabot的索引爬行结果也被 BigDaddy的索引使用后这种怀疑便更显得顺理承章,虽然Matt […]

  37. Shortcuts … Mediapartner Googlebot pro Bigdaddy, neue Google Patente & Google Earth Radarfallen … | SEO BLOG says:

    […] Der Mediapartners Googlebot (bisher nur für Adsense zuständig) sammelt lt. Matt Cutts auch Daten für Bigdaddy, allerdings angeblich ohne Ranking Vor- oder Nachteile für Adsense Werbetreibende. Cloaking könnte allerdings nun “gefährlicher” werden … via ShoeMoney: Matt Cutts Confirms Media Bot Crawling For BigDaddy […]

  38. […] ThomasBindl). At Boston Pubcon 2006 Matt Cutts spoke about it at the Google luncheon ( see Shoemoney.com) and then came back and went into much greater detail about understanding the new crawling cache […]

Comments are closed.