Comments on: WordPress Robots.txt file for SEO http://admindaily.com/wordpress-robotstxt-file-for-seo.html AdminDaily.com has everything you need to know to make your site a success. We focus on SEO, Online Marketing, Web Design, WordPress tweaks and customization. Tue, 25 Oct 2011 19:45:35 +0000 hourly 1 By: Jesse http://admindaily.com/wordpress-robotstxt-file-for-seo.html#comment-1660 Jesse Wed, 12 Oct 2011 21:27:20 +0000 http://admindaily.com/?p=116#comment-1660 Sorry lol... those were not supposed to be in there, a plugin that I use to automatically add in affiliate links based on keywords on the site had added those... It was supposed to be excluded from that. I have corrected this page and you shouldn't see those links in there any more :) Sorry lol… those were not supposed to be in there, a plugin that I use to automatically add in affiliate links based on keywords on the site had added those… It was supposed to be excluded from that. I have corrected this page and you shouldn’t see those links in there any more :)

]]> By: Karl http://admindaily.com/wordpress-robotstxt-file-for-seo.html#comment-1659 Karl Wed, 12 Oct 2011 21:20:00 +0000 http://admindaily.com/?p=116#comment-1659 Hi Jesse, thanks for the article, one question, what are the reasons you used the links in the robots.txt, , special for the feed, is that to avoid duplicate content? Hi Jesse, thanks for the article, one question, what are the reasons you used the links in the robots.txt, , special for the feed, is that to avoid duplicate content?

]]> By: Jesse http://admindaily.com/wordpress-robotstxt-file-for-seo.html#comment-1607 Jesse Sat, 23 Apr 2011 17:19:52 +0000 http://admindaily.com/?p=116#comment-1607 If you are using a manually created robots.txt file (instead of the virtual robots.txt file many plugins make) you will want to ad a sitemap reference for all domains in use to the file because each subdomain is considered a separate domain by search engines. If you are using a manually created robots.txt file (instead of the virtual robots.txt file many plugins make) you will want to ad a sitemap reference for all domains in use to the file because each subdomain is considered a separate domain by search engines.

]]> By: Mobile Themes World http://admindaily.com/wordpress-robotstxt-file-for-seo.html#comment-1604 Mobile Themes World Thu, 21 Apr 2011 02:03:37 +0000 http://admindaily.com/?p=116#comment-1604 Thanks for this valuable information.by the way do i have to add sitemap for subdomain in robots.txt and webmaster tools Thanks for this valuable information.by the way do i have to add sitemap for subdomain in robots.txt and webmaster tools

]]> By: Jesse http://admindaily.com/wordpress-robotstxt-file-for-seo.html#comment-1287 Jesse Wed, 10 Nov 2010 20:47:43 +0000 http://admindaily.com/?p=116#comment-1287 Thanks Phil, I appreciate the feedback.. To disallow something you just change it to Disallow: / and that will take care of everything from your site root folder down. the links you see aren't supposed to be there, it seems that a plugin I use is messing with the code.. thanks for the heads up, I'm going to sort that out right now :) Thanks Phil, I appreciate the feedback..

To disallow something you just change it to Disallow: / and that will take care of everything from your site root folder down.

the links you see aren’t supposed to be there, it seems that a plugin I use is messing with the code.. thanks for the heads up, I’m going to sort that out right now :)

]]>