We had a few off the wall questions during last weeks radio show about how I deal with digg and the other social networks. Well I have a dedicated server that I use pretty much just for my blog so its not that hard however some people made the point that most bloggers that do shared hosting or whatever just cant handle the traffic that a DIGG or something brings and that my friends is just not planning for success!
If your server is having problems dealing with diggs put this code in your .htaccess and it will redirect them to a cached mirror of your page.
!start code
RewriteEngine on
RewriteCond %{REMOTE_ADDR} !^192.168.1.2$
RewriteCond %{HTTP_USER_AGENT} !^CoralWebPrx
RewriteCond %{QUERY_STRING} !(^|&)coral-no-serve$
RewriteCond %{HTTP_REFERER} ^http://(www.)?digg.com [OR]
RewriteCond %{HTTP_REFERER} ^http://(www.)?slashdot.org [OR]
RewriteCond %{HTTP_REFERER} ^http://(www.)?slashdot.com [OR]
RewriteCond %{HTTP_REFERER} ^http://(www.)?fark.com [OR]
RewriteCond %{HTTP_REFERER} ^http://(www.)?somethingawful.com [OR]
RewriteCond %{HTTP_REFERER} ^http://(www.)?engadget.com [OR]
RewriteCond %{HTTP_REFERER} ^http://(www.)?boingboing.net [OR]
RewriteCond %{HTTP_REFERER} ^http://(www.)?del.icio.us
RewriteRule ^(.*)$ http://www.shoemoney.com.nyud.net:8080/$1 [R,L]
!end code
What you need to edit:
RewriteCond %{REMOTE_ADDR} !^192.168.1.2$ – This should be your ip so you dont see the cached version
RewriteRule ^(.*)$ http://www.shoemoney.com.nyud.net:8080/$1 [R,L] – change the shoemoney.com part to our website but make sure you keep the nyud.net:8080 part intact.
How this works? Your webserver sees the referal from the social site and points people to the mirrored cached copy of your website thus not hammering on yours.
(This tip is also included in a lot of digg comments)
For the demonstration of this article I will use it. If you come from the digg link you will be redirected (dont feel that you need to digg this article though)











Instead of digg, slashdot and delicious, you still could yous the list of 150 social bookmarking site above. You also could be deal with them
i just implemented this on my blog… but it is showing the main page… not the post, what should i change?
Isn’t it true that this requires that the user’s browser sends a referrer, which many people block, negating the solution in many cases?
It looks to me like that last line should be changed a little, ie
RewriteRule ^/(.*)$ http://www.shoemoney.com.nyud.net:8080/$1 [R,L]
Otherwise won’t you get a double slash in the destination address? (Keep in mind that I am new to mod_rewrite, so I could be wrong here…)
Would this still make statcounters increase?
This code looks to be useful, but if the user doesn’t pass referers (many firewalls block sending referers) they won’t get redirected.
Also, I tested the code today from the Digg article and went thru to your homepage where the current title is “One Year Of Blogging…. Pretty Wild”. Kinda confusing to the user (me) who clicked a link in Digg marked “Be Anti-Social – How To Deal With Diggs, Slashdots, Delicious And The Like”.
Something amiss in your .htaccess file?
fyi, these 3 posts have the same no. of diggs, must be something wrong here?
http://www.shoemoney.com/2006/09/30/the-key-to-being-anti-social-how-to-deal-with-diggs-slashdot-delicious-ect/
http://www.shoemoney.com/2006/09/24/so-long-technorati-top-100/
http://www.shoemoney.com/2006/09/24/searchfeed-please-take-me-off-all-lists-already/
What if you’re running WP-Cache on WordPress? That should take care of the caching, right? So would you still need this?
Great post. Thanks for the tip.
CoralCDN does not automatically rewrite links, so any pages that do not contain a referer from Digg/* will not get redirected. Many anaylists of the Digg/* Effect show that most vistors don’t go past the first page, so this may not be a problem.
Now I just need to write more articles…
Thanks for the great piece of code.
just by using that domain it works
Great idea. Thx for the hint.
Informative post!
I got dugg pretty hard just last week and what I did was save the page of my blog as .htm upload it to my server and did a 301 redirect to that html page. The load and bandwidth significantly dropped.
Dumb question: How does one get, find or set up a, as it says above, “mirrored cached copy of your website” ?
i think it checks back hourly for a new version
Dumb question: How does one get or set up a, as it says above, “the mirrored cached copy of your website” ?
I didn’t get redirected?
How often does nyud.net slurp content into the cache? Maybe it will pull the cache upon the first access so there is effectively no waiting period required.
Came to this from digg and my RSS feed. Did not redirect me either times =\
you can run it all the time
When would you recommend setting this up? Being that you can’t really predict when and what article will get the spike.
Haha great tips…keep them coming shoemoney!
also dont be a dumbass like me and double post