A robots.txt file is used to instruct bots (such as search engine crawlers) what content on your website to crawl. This report will tell you if Semrush noticed any changes to your robots.txt file, and ...