Google Explains Why URLs Blocked By Robots.txt Can Still Be Indexed via @sejournal, @martinibuster
via searchenginejournal.com
Short excerpt below. Read at the original source.
Search Console reported 51,000 URLs as “Indexed, though blocked by robots.txt,” and Google says that’s not necessarily a problem. The post Google Explains Why URLs Blocked By Robots.txt Can Still Be Indexed appeared first on Search Engine Journal.