Matt Cutts Confirms Media Bot Crawling For Big Daddy

41 responses..

At the Lunch sponsored by Google today Matt Cutts confirmed the recent rumors about media bot results getting into Big Daddy. Matt said it is a bandwidth saving feature to have GoogleBot and MediaBot both contributing to big daddy. Matt also stated that you will gain zero advantage in search listings however if you are serving different content to MediaBot then to Googlebot then you could be in trouble.




Related Posts:

  • Googles BigDaddy and the Bots - Tests and Clarification
  • The Other Matt Is Banned From Google
  • Matt Cutts memo to Shoemoney - ‘I cant be bribed’
  • posted on April 18th, 2006:
    Written By: ShoeMoney

    Links To This Post :

    1. Google’s mediabot bruges til almindelig crawling! - Mikkel deMib Svendsen

    2. Webmaster Blog

    3. Brian’s Business Blog » Google confirms Adsense adds to index

    4. ottz Blog » AdSense-Bot auf Abwegen

    5. Blog de Max Glaser » Blog Archive » Matt Cutts confirma que el AdSense bot escanea para Bigdaddy

    6. Shortcuts … Mediapartner Googlebot pro Bigdaddy, neue Google Patente & Google Earth Radarfallen …

    7. JenSense - Making Sense of Contextual Advertising

    8. Google Adsense Bot Moonlighting » JANGRO - Affiliate Marketing & SEO

    9. Davilac.net » Mediapartners sí indexa para Google

    10. » This and that

    11. Important Information For Cloakers SEO Black Hat: Black Hat SEO Blog

    12. Make Easy Money with Google and AdSense

    13. Référencement, Design et Cie

    14. Search Engine Journal » Google AdSense MediaBot is Crawling Sites says Matt Cutts

    15. nonBot SEO Blog » AdSense MediaBot Indexing - nonBot.com

    16. @-web Suchmaschinen Weblog

    17. Google Adsense Bot News » TheSMSGuide Blog » Blog Archive » Google Adsense Bot News

    18. AdSense Spider Cross-Pollinates for Google : Natural Search Blog

    19. Unofficial SEO Blog » Matt Cutts Confirms Adsense mediapartners Bot Indexing Pages For GoogleBot - SEO Information much before its official!

    20. Street Lessons » Yes, MediaBot is also acting as GoogleBot! Matt Cutts confirms.

    21. SEO Expert » Blog Archive » Getting Sites Indexed Quicker with Adsense?

    22. ?索引擎优化排??SEO?天一贴

    23. SEO Expert

    24. ZillionBits-Its about number$ and technology » Are AdSense publishers being favored with more frequent indexing?

    25. MetaContents » Meta News Clips For The Week Of June 16th, 2006 » Interactive Search Engine Marketing and Optimization

    26. Tips en Truks voor Zoekmachine Optimalisatie - Ulco.nl

    27. Google的Robots.txt指南 - 博客优化 - 菠萝油




    41 Comments

    @April 18, 2006 11:46 am

    Just another good tactic to combat cloaking

     

    [...] I dag kunne Matt Cuts så bekræfte at Google’s mediabot faktisk er begyndt at indsamle data til det almindelige indeks. Denne afsløring, eller konfirmation skulle man måske heller sige, fremkom ved et sponseret frokost arrangement i dag i Boston i forbindelse med konferencen PubCon. Technorati Tags: Google, Soegemaskineoptimering [...]

     
    @April 18, 2006 12:50 pm

    Adsense Bot spidert für Big Daddy…

    Bei JenSense wurde kürzlich festgestellt, dass der Mediapartners Googlebot, der eigentlich nur Seiten für die Adsense Einblendungen analysiert, neuerdings auch Webseiten in den Google Suchindex……

     
    @April 18, 2006 12:52 pm

    A slight bandwidth saving feature for webmasters too, not just Google. Especially true for large gallery or media sites.

     
    @April 18, 2006 1:34 pm

    Like I said yesterday, this is good. And remember, Google always wants to see what data you’re serving your human visitors, so this really shouldn’t be a surprise.

     

    [...] Shoemoney reports that Matt Cutts has confirmed that the AdSense Mediabot is now collecting content for the Big Daddy search index. [...]

     
    @April 18, 2006 1:46 pm
    SEOidiot Says:

    hmmm and what about them crawling with no useragent all the time now???????

     
    @April 18, 2006 1:54 pm

    [...] Was JenSense schon vor einiger Zeit geschrieben hat wurde nun auch von Matt Cutts besttigt. Der Mediapartners-Bot, der eigentlich fr die Analyse einer Seite zum Einblenden der passenden Werbung zustndig ist, wird auch eingesetzt um Seiten fr den Big Daddy Index zu indizieren. Lange Zeit wurde das von Google selbst bestritten. Doch es besteht ein eindeutiger Zusammenhang zwischen dem Datum der Cacheversion und dem Besuch des Bots. Matt Cutts sagte ausserdem, dass die Indizierung durch den AdSense-Bot fr die Seiten weder Vorteile noch Nachteile bringt. Nachteile knnten lediglich entstehen wenn man dem Mediapartners-Bot andere Seiten prsentiere als dem normalen Googlebot. Es werden anscheinend auch nur Seiten aktualisiert, die sich bereits im Index befinden. Der Mediapartners-Bot wird also nicht helfen frisch erstellte Unterseiten in den Index zu bringen. [...]

     

    [...] ShoeMoney informa que en un almuerzo organizado por Google, Matt ha confirmado los rumores de que el bot de AsSense también se esta usando para el buscador. [...]

     
    @April 18, 2006 3:06 pm

    it only combats blue collar cloaking

     
    @April 18, 2006 3:06 pm
    Brandon Says:

    I thought Matt went to Yahoo!…

     
    @April 18, 2006 3:23 pm
    Hunox Says:

    How about legal cases e.g. “members only” areas and such? What if mediabot indexes those and puts those pages into serps. This is just plain wrong!

     

    [...] Der Mediapartners Googlebot (bisher nur für Adsense zuständig) sammelt lt. Matt Cutts auch Daten für Bigdaddy, allerdings angeblich ohne Ranking Vor- oder Nachteile für Adsense Werbetreibende. Cloaking könnte allerdings nun “gefährlicher” werden … ;-) via ShoeMoney: Matt Cutts Confirms Media Bot Crawling For BigDaddy [...]

     
    @April 18, 2006 11:41 pm

    Matt Cutts confirms AdSense media bot in natural search index…

    Matt Cutts confirmed today that the AdSense mediapartners bot (aka mediabot) is indexing pages for use in the Big Daddy Google index. Both Greg Boser and myself have found evidence of mediabot’s crawls for AdSense ad targeting purposes have ended……

     

    [...] Word out of the presently-running WebmasterWorld conference is that Matt Cutts of Google confirms that this is the case. Shoemoney reports that “Matt said it is a bandwidth saving feature to have GoogleBot and MediaBot both contributing to big daddy.” [...]

     

    [...] Más información: Shoemoney y Jensense. [...]

     
    @April 19, 2006 4:44 am

    [...] Update: Wie Shoemoney berichtet hat Matt Cutts die Gerüchte um den AdSense Bot auf der Pubcon in Boston bestätigt : At the Lunch sponsored by Google today Matt Cutts confirmed the recent rumors about media bot results getting into Big Daddy. Matt said it is a bandwidth saving feature to have GoogleBot and MediaBot both contributing to big daddy. Matt also stated that you will gain zero advantage in search listings however if you are serving different content to MediaBot then to Googlebot then you could be in trouble. [...]

     

    [...] Shoemoney is reporting that : Matt Cutts confirmed the recent rumors about media bot results getting into Big Daddy. Matt said it is a bandwidth saving feature to have GoogleBot and MediaBot both contributing to big daddy. Matt also stated that you will gain zero advantage in search listings however if you are serving different content to MediaBot then to Googlebot then you could be in trouble. [...]

     
    @April 19, 2006 9:05 am

    Are AdSense publishers being favored with more frequent indexing?…

    Today I was going to address some of the comments that Stu Drew left about managing to get a high ranking for his private-label rights articles blog entry, but I’m going to defer that to a later time. If you’re interested in that topic, let me point …

     
    @April 19, 2006 9:19 am

    Mediapartners utilisé pour l’indexation ?…

    A en croire Matt Cutts qui s’est exprimé à ce sujet au Pubcon de Boston, Mediapartners, le robot d’indexation utilisé normalement pour cibler les liens sponsorisés du programme Google Adsense serait aussi utilisé par Google pour enrichir son ind…

     

    [...] Yes, Google is using the AdSense MediaBot to index pages for the Google Big Daddy Index confirms Matt Cutts at PubCon. ShoeMoney has the lowdown on MediaBot and Google’s Big Daddy index: At the Lunch sponsored by Google today Matt Cutts confirmed the recent rumors about media bot results getting into Big Daddy. [...]

     
    @April 19, 2006 2:26 pm

    it’ll be a while before google confirms this, but the number of adsense impressions significantly impacts your placement. i won’t say where, but we’ve done some tests, and shooting an URL to the top of the list for a specific search term via this method is pretty cake. Meanwhile, legitimate sites that have good content aren’t getting indexed by the bot at all.

     

    [...] It all started when I was with an SEO company never to be named (I don’t want to give them the exposure). All I can say is ShoeMoney has a picture with their booth girls. Like many of us in this industry, I was running some sites on the side to supplement my income. Then one day I decided to sign up with Google AdSense and deploy the ads. [...]

     
    @April 19, 2006 3:26 pm

    Over a year ago I put AdSense on a site that was getting limited traffic and only had a couple hundred indexed pages. Being this site was a directory, I should have had thousands of indexed pages. Anyway, I added the code into a global footer and forgot about it.

    Then about a week later, when I was going over some SEO data I noticed my indexed pages had jumped to 25,000. All these new indexed pages had that global footer. Of course this led me to believe the AdSense ads had something to do with it.

     
    @April 19, 2006 3:34 pm

    Trägt Adsense Media Bot zum Google Index bei?…

    Eigentlich ist alles ganz klar. Die Daten der Google Bots landen im Index der die unbezahlten Suchergebnisse ausliefert, dem “Organischen Index”. Die Adsense Media Bots hingegen sammeln Daten um die Seiten auf denen Adsense geschaltet wird, mit kont…

     

    [...] Matt Cutts, who is speaking at this week’s PubCon, confirmed that the AdSense mediapartners bot is doing double duty by not only targeting ads for AdSense but also indexing for the regular Google search database, in a bandwidth saving move. Matt also noted that there is no advantage to being indexed by one bot or the other, however, those cloaking content and serving different pages to each bot could run into problems in the search index. Google Adsense ; Google ; Adsense Popularity: unranked [...]

     

    [...] A few bloggers such as Jenstar have just posted that pages spidered by Google’s AdSense bot are appearing in Google’s regular search results pages. Shoemoney just blogged that Matt Cutts has officially verified that this is happening, saying that this was done so that they wouldn’t have to spider the same content twice, and that Google did this as part of their recent Big Daddy infrastructure improvements. [...]

     
    @April 19, 2006 10:59 pm
    Jim Says:

    Matt Cutts Has confirmed that the adsense mediabot is working for collecting websities content for search index. So, there is no surprise because Goolge always look for content which will be serve by website owner to human visitors.

    Jim

     

    [...] According to Matt Cutts, the Adsense mediapartners bot is helping Googlebot with indexing. How? Well, this was confirmed by him in this week's Pubcon. In his statement he said that Adsense mediapartners bot is not only focusing on ads for Adsense but also indexing for the regular Google search database, in a bandwidth saving move.Hmm..quite an important thought to think upon.  [...]

     
    @April 20, 2006 5:16 am
    pilkster Says:

    I think the adsense TOS prohibts running ads on password protected content. You might want to check if this is a concern for you.

    pilks.

     

    [...] Matt Cutts has confirmed that Google is in economy mode and is trying to save some bandwidth by combining GoogleBot and MediaBot (AdSense Bot) — in response to the speculations fired up by Jen. Matt said it is a bandwidth saving feature to have GoogleBot and MediaBot both contributing to big daddy. Matt also stated that you will gain zero advantage in search listings however if you are serving different content to MediaBot then to Googlebot then you could be in trouble. [...]

     
    @April 20, 2006 8:35 pm
    DA Says:

    So, no more testing with AdSense code on the page!
    It only made sense (no pun) that they’d share the crawled content. It would also be awfully nice if the regular index gets fed into mediabot’s index. This way the ads on a page that was crawled before will show relevant ads even to the very first human visiting the page

     

    [...] Now, Matt Cutts confirms that Google’s AdSense mediapartners bot is not only targeting ads for AdSense but is also indexing for the regular Google search database, in an apparent bandwidth saving move. [...]

     
    @April 26, 2006 11:22 am

    Google Adsense蜘蛛抓?的网页在?索中出现…

    ?两天Matt Cutts刚刚?实,Google Adsense蜘蛛(Mediapartner bot)所抓?的网页会在Google?索中出现。Matt Cutts说这?是一个节?带宽开支的手段而已。
    由于Google蜘蛛(Googlebot/2.1)所抓?的网站之多和频率…

     
    @April 28, 2006 4:52 pm
    SEO Expert Says:

    Getting Sites Indexed Quicker with Adsense?…

    While being in a search engine index does not guarantee rankings, it is the first step. SEOs regularly use the Google cache command “cache:http://www.yoursite.com” to determine when a page is in the index and the last spider crawl time.
    No…

     

    [...] I want to talk some more about Google’s indexing of AdSense pages. In case you hadn’t heard, Googler Matt Cutts confirmed that the AdSense crawler is feeding pages into Google’s new “BigDaddy” search indexes. This confirms what others had noticed about what the AdSense crawler (usually referred to as the “mediabot”) is doing. Or does it? [...]

     

    [...] Google confirms use of AdSense bot for regular search results cache Matt Cutts confirmed at the Webmasterworld Pubcon and via his blog that Google uses the AdSense mediapartners bot for the natural results cache. Matt said it is a bandwidth saving feature to have GoogleBot and MediaBot both contributing to big daddy. From Google’s “How do your crawler and site diagnostic reports work?” support page: “The Adsense crawler is different form the Google crawler, but they do share a cache, We do this to avoid both crawlers requesting the same pages, thereby helping publishers converve their bandwidth.” (via JenSense) [...]

     
    @August 20, 2006 8:49 am
    McCrown Says:

    Because of comment from “nonBot SEO Blog » AdSense MediaBot Indexing - nonBot.com” with link to this domain:
    The domain http://www.nonbot.com is expired. All Tools on this site aren’t still alive.

     
    @August 20, 2006 8:49 am
    McCrown Says:

    Because of comment from “nonBot? with link to this domain:
    The domain http://www.nonbot.com is expired. All Tools on this site aren’t still alive.

     

    [...] Wat ik bedoel met mediapartners Ruben? Dit…, ik was alleen wat [...]

     

    [...] Cutts证实mediabot的索引爬行结果也被 BigDaddy的索引使用后这种怀疑便更显得顺理承章,虽然Matt [...]

     

    Sorry, the comment form is closed at this time.

    Latest Radio Shows

    Latest Q&A

    Latest T-Shirt Fridays

    Thanks For The ADD!

    © 2008 Shoemoney Media Group. All rights reserved.

    Blog Design