How to use the Robots.txt Generator
Upload the file to the root of your site so it's reachable at https://yourdomain.com/robots.txt. robots.txt asks well-behaved crawlers not to visit paths; it doesn't hide pages from people or guarantee removal from search results (use noindex for that).
Frequently asked questions
Does blocking GPTBot affect Google rankings?
No. GPTBot is OpenAI's crawler. To opt out of Google's AI training without affecting Search, block Google-Extended.
Should I block my CSS and JS?
No. Google needs them to render pages correctly.