69

Using The Wordpress Discussion Filters – Fighting Comment Spam

Posted August 7th, 2008 by Jeremy Schoemaker

This is the 2nd post in a series on how to fight wordpress comment spam.  You can read the first post on minimum comment content here.

People ask me all the time how I maintain such a good comments/spam ratio on my blog.  The answer is pretty easy…  Lots of work and studying the patterns of spammers.  The single most powerful tool is the built in discussion filter system via moderation and blacklisting.

The discussion filters within Wordpress are some of the best tools you have to lower your liability in letting spam through. You can get to the settings by logging into your admin panel then going to settings -> then to discussions. From their you will have plenty of options which I will go through one by one.

Default Article Settings:

This really does not have much to do with fighting spam but I thought I would show it anyway since its in the same section.

E-mail me whenever:

This really will depend on how busy your blog is.  I had to give up on this a while ago.

Before A Comment Appears:

Here we go… finally something to do with the actual title of this post:

Over the years I have found the best settings for these is to make people use a name and email,  already have an approved comment (comments will sit in moderation queue until approved), and also I do not make a administrator approve every comment.  I am not out to censor anyone… just to limit spammers.  Thats not to say spammers wont come back once approved and spam but we will point out how to combat that later settings.

Comment Moderation:

Here is where some of the secret sauce comes in.  Here are my tips for using the comment moderation system.

1) I HIGHLY HIGHLY HIGHLY recommend putting a 1 in the first box.  This means any comment that has a link must be approved no matter what.

2) The moderation box allows you to specify words, emails, ips or just about anything someone would put into a comment.  I use this section to post a lot of dynamic stuff.

3) The first thing I put in this box is a list of TOR proxies.   They even have a plain list you can just copy and paste into this box.  We also put in other open proxy ips from around the web.   I am a huge supporter of the EFF and have financially contributed to them since 2004 but unfortunately the Tor network has become a great resource for spammers.   We have found that 95% of the comment spam that makes it through the Akismet plugin has a open proxy ip.

4) A good example of stuff to put in here is swear words.   I think its pretty obvious I have nothing against swear words but I would like to approve the comment with them before its posted.

5) Another good example is to put in your own companies urls.  I have found a lot of times people have posted security issues or bugs with my sites on my blog… and I like to be the first person to see those and deal with them ;)

6) There are several other things you can put in this.  Remember that whatever you put in is a broad match so try to keep it pretty specific.  Putting in common words will lead to a lot of manual approval of comments and the goal of this is to lesson admin time =).

Comment Blacklist:

The Comment Blacklist feature is very powerful and should not be taken lightly.  Every comment that matches your entry will be perminiantly deleted.  ALWAYS test a filter out first in Comment Moderation before adding it to the Blacklist so that you know what its going to catch.

Here are my tips for using the Comment Blacklist feature:

1) As you can see I currently send all comments with spam@ in the email straight to the trash.  I used this in moderation for over a year and after only false positive decided it was good to go.

2) groups.google is a great example of something that should go right to the crapper.   I am pretty sure that Akismet now gives a much higher score to comments with a  *groups.google* url in the comment fields but I can them just incase.

3) Anything that sends you BS trackbacks and pings go here.  Tired of seeing the same scraper site send you a trackback with your own content?  Put it here.  Tiered of seeing a forum or spam site with a spammy “auto ping” function that searches and pings any blog that matches the content?  Put them here.

Really you want to be very careful with this tool. As I said above its very powerful and you can not undo it.  Experiment with matching in moderation then add them to the blacklist when your sure.

Disclaimer

Before acting on this post, be sure to read my Disclaimer.

- Comment Likes - Comment Dislikes

69 comments. What say you?

  1. Good Comment?
    Cherokee

    Good stuff, I “Stumbled” you. My DIGG account got messed up but I like Stumbling better anyway.

  2. Good Comment?
    Don Loughran

    Excellent content. Thanks very much, it was very helpful!

  3. Good Comment?
    Dustin Cucciarre

    Nice settings!

  4. Good Comment?
    SEO Tricks

    Thanks for this great idea.. I get a lot of spam on my blog.. I hope this is going to help me out

  5. Good Comment?
    terminator69

    Has this helped you combat spam? seen any changes?

  6. Good Comment?
    Static Brain

    Another thing that really helps fight spam on wordpress is the bad behavior plugin. You should check it out. It does way better than any other spam fighting plugin out there and is also compatible with akismet. You can check out the plugin at Bad Behavior

  7. Good Comment?
    Lilu_Gabriel

    RipTiger downloader helped me to save desired Google, Facebook and CNN videos for my research work this week. I would be in lost without this program!
    It’s claimed that RipTiger can save any online video you find on the web to your desktop. If you turn on automatic downloading feature, all you need is to start watching the video. Take a look at riptiger.com

  8. Good Comment?
    Le Melon

    But, like the tor proxy list – it shows that spammers are using things not originally meant for spam. So the owners of the IPs/software may be happy to hand out the information.

  9. Good Comment?
    Kabatology

    I always prefer to personally moderate all comments, maybe cause i don’t get many, but moderating also means reading your comments, thus responding to those comments that need one. Thx for the tips anyway.

  10. Good Comment?
    Dick

    I think that very little spam loved people. However, he also does not like people. -)))

  11. Good Comment?
    Josh Vojtkievic

    A great article from a great man… :)

  12. Good Comment?
    Mario

    i really need this information, i hate spam

  13. Good Comment?
    Her Ticking Clock

    Great tips, I’ll try em out. I’ve been getting hundreds of spam, so I’ll do whatever it takes. Take care.

  14. Good Comment?
    Jeff Finch

    Thank you for the great article. Needed that information.

  15. Good Comment?
    Justin Cook

    I really don’t think using an IP blocklist is at all an effective means of combatting spam. Most bot systems run on dynamic IPs, that change over time, and then a valid visitor may assume one of the IPs on their next visit to your site, and their comment gets blocked.

  16. Good Comment?
    mikel

    good article for this information which is very important

  17. Good Comment?
    Agent Magenta

    captcha is also bad for the user experience, for comments you would be having to type it way too much. From a user point of view it’s much better not to have it. Also as terminator69 said it will only stop the automated spam, not the human spam.

  18. Good Comment?
    Dick

    You have declared war on spam? Do not use comments! Never! -)

  19. Good Comment?
    Dick

    Blacklist needed if the site is popular. I think that otherwise it could do without. -)

  20. Good Comment?
    Software Projects

    There is a very easy way to eliminate 100% of automated WordPress spam without using Captchas, by implementing a simple Javascript hack:

    Wordpress Comment spam

  21. Good Comment?
    Dick

    I think that there is no such site. Spammers will not allow the existence of such a site. -)

  22. Good Comment?
    Melvin

    since i have implemented those i got some increased nos. false postives.. hehe.. :-p

  23. Good Comment?
    Berry

    Thanks for your tip, in my case The Akismet caught about 50% of comments as spam, but about other 30% spams passed the filter, sometimes comments with 10 URL passed the filter too, so we have to checked it carefully. I think altogether spams comments about 90%.

  24. Good Comment?
    JumboCasher.com

    Wordpress makes it easy to take care of spam. Really helpful post.

  25. Good Comment?
    Omar

    hahaha great post

    I can see the light at the end of this spam tunnel hahaha :)

  26. Good Comment?
    WebTrafficROI

    Spam takes a lot of time ….hope this post helps reduce it

  27. Good Comment?
    Andrew

    I could imagine how much spam a blog like yours receives. Will there ever be a day that the spammers give up? Will there ever be a day that there is no more spam?

  28. Good Comment?
    Nick Throlson

    Gotta keep that spam out of our blogs ! thanks Shoe

  29. Good Comment?
    Melvin

    it maybe depends on the content and how popular that site is…

  30. Good Comment?
    Melvin

    i think shoe has been having these problems even before… when he started using ubd’s theme… ;-)

  31. Good Comment?
    Emarketing

    Thanks for the tips, I guess I could also probably eliminate a lot of spam with a nice captcha.

  32. Good Comment?
    TEKFIRM

    The real value is in the info , with that you could get a lot more thn a mac and a t-shirt

  33. Good Comment?
    TEKFIRM

    what plugin ? lol this is the core of Wordpress :)

  34. Good Comment?
    Erica DeWolf

    Haha true- but he probably also wouldn’t have as many loyal commenters!

  35. Good Comment?
    Erica DeWolf

    Very helpful! Thanks for the tips!

  36. Good Comment?
    Bulbboy

    You bring it all upon yourself Shoe.

    If you didn’t give away macbooks and other freestuff, you wouldn’t have this problem!

    =P

  37. Good Comment?
    Stephanie

    I like that list of TOR proxies. That was a source I didn’t have yet. I’ve long had various drug terms and such in my filter because those aren’t relevant to what I blog about, and I can always change that if the situation changes.

  38. Good Comment?
    River Girl

    Thank you – making changes now.

  39. Good Comment?
    OnlineGodfahter

    great post, tnx for this :)

  40. Good Comment?
    Bryn Youngblut

    Thanks for the tips, I just beefed up my settings. :)

  41. Good Comment?
    Rajaie AlKorani

    Have to be very careful so no genuine comments get deleted

  42. Good Comment?
    pickupjojo

    Very useful tip, thanks for sharing!
    I will fight spam better now. :)

  43. Good Comment?
    jared

    Great post like usual, ive applied all the settings from post 1 and 2 and i already notice the difference.

  44. Good Comment?
    Wcnktm

    Great plugin, this what i am looking. Thank you for sharing this information.

  45. Good Comment?
    Reid

    This is very useful information. I found that I would have spam on my blog so I took the necessary steps to delete it, and fortunately ever since then I haven’t had any spam at all! (cross fingers)

  46. Good Comment?
    URL Shortner

    Great content. I put anything with a swear word straight to the trash. If they can’t figure out how to express themselves without swearing what is the point?

    http://ivyurl.com

  47. Good Comment?
    Michael John Grove

    It is strange how different website get hit differently with spam, I have managed a few blogs, and some get loads more spam hits that others. with the same settings.

    Thanks for the tips.. maybe now I can control the more prolific spam on my sites.

  48. Good Comment?
    Tim Linden

    Yes – thanks, I wouldn’t have thought of that!

  49. Good Comment?
    terminator69

    No, it just ensures whoever is spamming is a real person not a computer.

  50. Good Comment?
    FunkySOuth

    this is interesting, i think ill bookmark this and come back to it when my blog is more popular ! ta shoe

  51. Good Comment?
    jim

    Thanks for the plaintext IP list of open proxies, that’s going to save me a lot of time.

  52. Good Comment?
    Geiger

    Wouldn’t a captcha get rid of almost ALL spam?

  53. Good Comment?
    Geiger

    I also suggest clicking the Akismet button that rechecks the queue for Spam.

  54. Good Comment?
    Richard Farrar

    While Askimet seems to be doing a reasonable job for me at the moment, every little bit helps in the constant battle against spam. The proxy list is a very useful addition to the armoury.

  55. Good Comment?
    WAHM Tara

    You know I have been slammed with spam recently. I have been looking for other ways to try and cut it down some and found this post. Thanks for the great tips. I have never even used the Comment Blacklist, so I will working on that today.

  56. Good Comment?
    Melvin

    but still akismet fails sometimes at false positives ans ometimes its just consecutive

  57. Good Comment?
    Lawrence

    i hate spam, or generic comments…it’s nothing but dead space.

    effiency – that’s what i’m about.

  58. Good Comment?
    TEKFIRM

    just the last year i got more than 45 000 spam comments :) but if you install akismet and bad behaviour most wont pass it .

    Thanks shoe for the more advanced protection ;)

  59. Good Comment?
    Melvin

    i think that is the tor proxy list already… ;-)

  60. Good Comment?
    Melvin

    Wow, this is very helpful to me… I had a list of tor proxies but never got it from that site… Also since my site isn’t really that popular i don’t put any on comment blacklist..

  61. Good Comment?
    Agent Magenta

    An excellent guide with some great tips. The TOR proxy list was a new one to me as well and I wouldn;thave thought of blocking the google.groups either. Those steps mentioned above should deal with a large percentage of the automated spam.

  62. Good Comment?
    terminator69

    I have removed the email and url option from my blog so users just have to use a name, and i havent seen an increase in spam. So maybe this doesn’t have as big effect as you think.

  63. Good Comment?
    Andrew

    didn’t knew about the tor proxy list. Going to use it pretty soon. Thanks

  64. Good Comment?
    letrodectus

    Great post! I did learn some new things about commenting.
    I use Comment Blacklist feature a lot. I have a list of common “stop” words used by spammers (like names of drugs and adults-related stuff)

  65. Good Comment?
    filontheroad

    Thanks for this tips. Hope they will help to reduce the spam i get on my blogs. Is there any site where the most common spammer IPs are published?

  66. Good Comment?
    wesley

    The tor proxy list tip is gold, thanks!

  67. Good Comment?
    meethere

    Great article..
    I get lot of spam to my blog
    Hope this will help :)

    Thanks.

Join the Discussion