Matt Cutts Confirms Media Bot Crawling For Big Daddy

Posted on: April 18th, 2006 by Jeremy Schoemaker

At the Lunch sponsored by Google today Matt Cutts confirmed the recent rumors about media bot results getting into Big Daddy. Matt said it is a bandwidth saving feature to have GoogleBot and MediaBot both contributing to big daddy. Matt also stated that you will gain zero advantage in search listings however if you are serving different content to MediaBot then to Googlebot then you could be in trouble.

Post written by Jeremy Schoemaker

Hi I am Jeremy Schoemaker and ShoeMoney.com is my blog. 99% of the post here are done by me but you will see others occasionally make guest posts. This blog is fun to write but for my day job I run several online companies.

More about Jeremy at http://www.shoemoney.com!

Have You Read:

45 Comments. What Say You?

  1. SanDiegoSEO
    April 18, 2006 at 11:46 am

    Just another good tactic to combat cloaking

  2. Jason Murphy
    April 18, 2006 at 12:52 pm

    A slight bandwidth saving feature for webmasters too, not just Google. Especially true for large gallery or media sites.

  3. Eric Giguere
    April 18, 2006 at 1:34 pm

    Like I said yesterday, this is good. And remember, Google always wants to see what data you’re serving your human visitors, so this really shouldn’t be a surprise.

  4. SEOidiot
    April 18, 2006 at 1:46 pm

    hmmm and what about them crawling with no useragent all the time now???????

  5. dan kavanaugh
    April 18, 2006 at 3:06 pm

    it only combats blue collar cloaking

  6. Brandon
    April 18, 2006 at 3:06 pm

    I thought Matt went to Yahoo!…

  7. Hunox
    April 18, 2006 at 3:23 pm

    How about legal cases e.g. “members only” areas and such? What if mediabot indexes those and puts those pages into serps. This is just plain wrong!

  8. yeah and also
    April 19, 2006 at 2:26 pm

    it’ll be a while before google confirms this, but the number of adsense impressions significantly impacts your placement. i won’t say where, but we’ve done some tests, and shooting an URL to the top of the list for a specific search term via this method is pretty cake. Meanwhile, legitimate sites that have good content aren’t getting indexed by the bot at all.

  9. AdSense MediaBot Indexing
    April 19, 2006 at 3:26 pm

    Over a year ago I put AdSense on a site that was getting limited traffic and only had a couple hundred indexed pages. Being this site was a directory, I should have had thousands of indexed pages. Anyway, I added the code into a global footer and forgot about it.

    Then about a week later, when I was going over some SEO data I noticed my indexed pages had jumped to 25,000. All these new indexed pages had that global footer. Of course this led me to believe the AdSense ads had something to do with it.

  10. Jim
    April 19, 2006 at 10:59 pm

    Matt Cutts Has confirmed that the adsense mediabot is working for collecting websities content for search index. So, there is no surprise because Goolge always look for content which will be serve by website owner to human visitors.

    Jim

  11. pilkster
    April 20, 2006 at 5:16 am

    I think the adsense TOS prohibts running ads on password protected content. You might want to check if this is a concern for you.

    pilks.

  12. DA
    April 20, 2006 at 8:35 pm

    So, no more testing with AdSense code on the page!
    It only made sense (no pun) that they’d share the crawled content. It would also be awfully nice if the regular index gets fed into mediabot’s index. This way the ads on a page that was crawled before will show relevant ads even to the very first human visiting the page

  13. McCrown
    August 20, 2006 at 8:49 am

    Because of comment from “nonBot SEO Blog » AdSense MediaBot Indexing – nonBot.com” with link to this domain:
    The domain http://www.nonbot.com is expired. All Tools on this site aren’t still alive.

  14. McCrown
    August 20, 2006 at 8:49 am

    Because of comment from “nonBot� with link to this domain:
    The domain http://www.nonbot.com is expired. All Tools on this site aren’t still alive.

  15. Stock Disposal
    November 4, 2008 at 12:58 am

    As again Matt has briefed us on a Strong Anti Spam thing from G. Well Done Matt

Leave a Reply