If a robots.txt returns a 503 for an extended period of time, Google will treat this as a permanent error and crawl the site normally to see what can be discovered.
The post Google Treats Permanently 503’ing Robots.txt as an Error & Eventually Crawls the Site Normally appeared first on Lumar.