WordPress Robots.txt file for SEO

Wordpress, straight out of the box is an excellent platform that is feature rich, easy to use and highly customizable. But guess what, it’s navigation structure is absolutely horrible in the eyes of search engines because many of the features that make user navigation so easy and intuitive end up having the exact opposite effect for search engine spiders/bots. The ability to easily navigate to posts/pages by multiple links of various names can produce a pile of the ever-dreaded duplicate content that search engines such as Google will penalize your site for. Unless you want your pages in the supplemental index, read on to learn one more SEO “must-do” to keep your site SERP’ing strong[…]