It exhibits you that's linking to your website, which happens to be like getting suggestions from Other people on the web. A robots.txt file is a straightforward textual content file that instructs web crawlers about which elements of an internet site are open up for indexing and which should really https://www.seoprd.com