Fix Your Robots.txt or Your Site Disappears from Google
via alanwsmith.com
Short excerpt below. Read at the original source.
Article URL: https://www.alanwsmith.com/en/37/wa/jz/s1/ Comments URL: https://news.ycombinator.com/item?id=46681454 Points: 3 # Comments: 0