A description for this result is not available because of this site’s robots.txt

Have you ever found your website Google search result with description like this, “A description for this result is not available because of this site’s robots.txt – learn more.”. All those SEO keywords, descriptions seems not working in this case.

visit-website

To troubleshoot this, the first thing to do, is to locate the robots.txt in root directory.

Strangely enough,Ā  in my case, there isn’t such a file existing at all. So I move on to next possible solution, check the WordPress Search Engine Visibility setting.

search-engine-visibility

In WordPress admin panel, there is a setting under Settings | Reading called “Search Engine Visibility“. It is the switch that controls “Disable search engines from indexing this site“. For whatever reason you think it is stupid to switch this option on, most developer may start their WordPress development when the development server is on a public server. When site goes live, this switch should be turned off.

After disable this option only a day, the search result changed to normal.