Generate sitemap.xml and robots.txt by crawling every page on your website.
Crawl your site and generate a ready-to-upload sitemap.xml with all discovered pages.
Create a search-engine-friendly robots.txt with sitemap reference for your domain.
