The robots.txt generator tool creates a txt file for uploading into your websites root folder on the server. The robots.txt file will advise search engine crawlers which pages they are allowed to crawl, for the purpose of page indexing in search engines.
Get an SEO audit of your website with the Website Review Tool