Comments on: Wordpress robots.txt tips against duplicate content

By: Bogan Marketing

Bogan Marketing — Wed, 10 Mar 2010 21:31:16 +0000

I also think the author,date,comment and in some cases rss archives should be noindex if you want silo seo. Even adding the .html extension is a good idea, and stripping out the top level category. there is a post about it at Wordpress Robots.txt for Silo SEO<

By: bursa emlak

bursa emlak — Thu, 08 Oct 2009 13:58:16 +0000

Some really good info, if you are not an SEO you are pretty darn close

By: bursa

bursa — Thu, 08 Oct 2009 13:57:46 +0000

Ya,I dont use Disfollows..

By: Unpublished Guy

Unpublished Guy — Sun, 02 Aug 2009 22:10:43 +0000

I use the robot.txt file, because I use a CMS with URL rewriting. I can’t (I don’t think) use meta tags because I have the appearance of duplicate content–not actual duplicate content. For example, teh same page might appear under the URL ./Default.aspx?tabid=1 or ./tabid/1/Default.aspx, depending on how the page is accessed. If I add meta tags, then none of pages will get indexed.

By: What is a Robots.txt file and how to write one | Web Design Blog x2interactive. Ένα blog για το Internet και το Web Design

Fri, 24 Jul 2009 12:28:30 +0000

[...] http://www.shoemoney.com/2008/03/03/wordpress-robotstxt-tips-against-duplicate-content/ [...]

By: 8 tips to better secure your Wordpress installation | Web Design Blog x2interactive. Ένα blog για το Internet και το Web Design

Fri, 29 May 2009 13:50:55 +0000

[...] Robots.txt, μπορείτε να βρείτε σχετικές οδηγίες στο Shoemoney ή να χρησιμοποιήσετε κάποιο generator όπως αυτόν που [...]

By: Tatil

Tatil — Sun, 24 May 2009 20:14:19 +0000

thank u this article and all comments