How to solve Robots.txt problem with WordPress fresh install?

1 Views

I installed a fresh copy of WordPress few weeks ago and I have been having some strange problems.

1- I get this message : “Comments for FirstName LastName
name-last.com/‎
A description for this result is not available because of this site’s robots.txt – learn more.”
When I google my name. I re-checked setting and I haven’t checked the “discourage option”

Read More

2- I installed WP Better Security and Yoast SEO plugin. Now I have another problem!

When I google my domain RANDOM Web Sniffing Websites come up that exposes my data server and many more thing!

Where did I go wrong ?

PS: My robots.txt is fixed to disallow only Plugin Folder since yesterday (not too long)

Post Views: 1

Related posts

1 comment

  1. Your robots file as of right now:

    User-agent: Googlebot
Disallow: 
User-agent: *
Disallow: 
Disallow: /cgi-bin/
Disallow: /wp-admin/
Disallow: /wp-includes/
Sitemap: http://www.yadfaeq.com

    You aren’t specifying anything for Googlebot so you should remove it. Additionally, Disallow: could be interpreted as Disallow: / which would block your entire site.

    What your robots file should be:

    User-agent: *
Disallow: /cgi-bin/
Disallow: /wp-admin/
Disallow: /wp-includes/
Sitemap: http://www.yadfaeq.com

    Google often caches the robots.txt file so it may take some time for it to check for a new one. I suggest you use Google Webmaster Tools to help control what Google is indexing.

    I do not see the changes you said you made to your robots.txt file. Perhaps your server is caching it as well?

Comments are closed.