Comments on: WordPress Robots.txt file for SEO

By: Jesse

Jesse — Wed, 03 Mar 2010 15:23:46 +0000

Thanks for stopping by, I'll check out your article as well.

By: Bogan Marketing

Bogan Marketing — Wed, 03 Mar 2010 11:46:20 +0000

Hey Jessie,

Nice post, I went into this today too, you can check out my take on using robots.txt for silos in Wordpress here

thanks

By: Jesse

Jesse — Mon, 15 Feb 2010 06:19:49 +0000

That is very odd, let me know what your domain is or use the contact form
here and let me know and I will take a peek at it and see why this could be
happening.

By: Joe Jones

Joe Jones — Mon, 15 Feb 2010 05:08:35 +0000

Admin Daily,
I have one website that's a wordpress site of only 2 web pages. I used all the disallows you have listed but Google's keyword list for the site had “disallow”, “user”, and “agent” as the most frequently used keywords for the site. How do I stop google from using words in the robots.txt file as a source of keywords.

Thanks

By: Jesse

Jesse — Tue, 10 Nov 2009 02:53:48 +0000

Thanks for stopping by, glad you found this post useful.