I did a post a while back here in which I talk about how much traffic search engines are sending me vs how much they are indexing me. It was a fun and interesting stat (to me) but as people commented it really doesn’t meant that much.
Going from the last 5 months data (Jan-April) I took it a bit further I calculated all the bandwidth each bot is using (using webalizer) vs how much organic traffic I am receiving that converts to a sale (using Google analytics). So I averaged this to a daily breakdown. (keep in mind that Google is using gzip and caches now so it should actually perform better over the next 6 months). This site has no contextual ads so only completed shopping carts are conversions.
Now we have a true cost analysis- This is purely organic stats and a true ROI for spiders vs conversion over a 153 day period broken down per day.
Ask COSTS me $7.90 per day.
MSN Gives me $29.85 per day.
Yahoo Gives me $124.23 per day.
Google Gives me $227.44 per day.
Now I like ask.com but cmon… improve your fricking bot already. You are chewing the most bandwidth from me yet you give craptastic returns.
Ricky Peterson (24) 
ZK @ Web Marketing Blog (23) 
R Kumar (12) 
Holly Mann (11) 
gurtey (9) 
Shanker Bakshi (9) 
Jacques Snyman | 3 Quotes (8) 
Yisraeli Foods (8) 
Find Affiliate Offers (5) 
Michael Zhao (77) 
almir (76) 
fas (75) 
R Kumar (74) 
Rick Kats (70) 
Jay @ work from home (62) 
Dino (60) 
Dick (628) 
Goran Website (495) 
Melvin (330) 
Ben Pei (329) 
Taris Janitens (274) 
meethere (269) 
Tushar Dhoot (265) 
Tushar (260) 
Moneybites (259) 
Interesting read. I’m learning some new AND interesting things going back and re-reading your topics you posted before I was a reader. I’ve never seen anyone break down bot/cost
Hopefully they READ your blog too.
You know what they say….
“Ask and ye shall receive.”
You said “This site” above, but I assume you mean something other than http://www.shoemoney.com … unless your blog is making close to $400/day … which would be amazing … but then again, you are ShoeMoney
That is some great information and goes to show that google is the big pink elephant in the room. I would be interested in seeing it broken down even further, say month to month stats going back last 12 months to see what kind of seasonal fluctuations there are and whether there is growth or loss per each engine per month.
An outstanding analysis. Thanks Shoe.
You do have an interesting brain…
Awesome, that is interesting.
-Daniel
No I mean they are actually accepting gzip encoded files if the server supports it. Its basically like googlebot asks for a zip (compressed) version of the html page. Usually this is about 1/20th the size for normal txt or html.
Cute Statistics.
When you say Google is Caching with Gzip, do you mean they cache the images and just download the html and parse that content?