Facebook’s Fascination with My Robots.txt
via blog.nytsoi.net
Short excerpt below. Read at the original source.
Article URL: https://blog.nytsoi.net/2026/02/23/facebook-robots-txt Comments URL: https://news.ycombinator.com/item?id=47121210 Points: 28 # Comments: 6