Builds a robots.txt file that tells search engine crawlers which parts of your site they may or may not visit. Pick a User-agent (use * for all bots), choose whether to allow or block the whole site, then add specific Disallow paths (like /admin/) and Allow exceptions. You can add as many paths as you need and point crawlers to your Sitemap.
Place the generated file at the root of your domain as /robots.txt. Everything runs locally in your browser.