# Robots.txt configuration **URL:** \ **Category:** Developer help\ **Created:** [March 17, 2020, 4:50am UTC](https://forum.ghost.org/t/robots-txt-configuration/12767 "2020-03-17T04:50:32Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![Fathul](https://sea1.discourse-cdn.com/flex015/user_avatar/forum.ghost.org/fathul/32/2727_2.png) [@Fathul](https://forum.ghost.org/u/Fathul)\ **Post date:** [March 17, 2020, 4:50am UTC](https://forum.ghost.org/t/robots-txt-configuration/12767/1 "2020-03-17T04:50:32Z")
Want to modify the robots.txt, want to change currently robots.txt become: ```auto User-agent: * Sitemap: https://domain.com/sitemap.xml Disallow: /ghost/ Disallow: /p/ Disallow: /member/ Disallow: /tag/ Disallow: /author/ ``` Any body can help me? ---
**Author:** ![vikaspotluri123](https://sea1.discourse-cdn.com/flex015/user_avatar/forum.ghost.org/vikaspotluri123/32/24_2.png) [@vikaspotluri123](https://forum.ghost.org/u/vikaspotluri123)\ **Post date:** [March 17, 2020, 5:08am UTC](https://forum.ghost.org/t/robots-txt-configuration/12767/2 "2020-03-17T05:08:53Z")
As far as I’m aware, if you upload a robots.txt file as part of your theme, it should supersede the default Ghost robots file ---
**Author:** ![DanHakimi](https://sea1.discourse-cdn.com/flex015/user_avatar/forum.ghost.org/danhakimi/32/23986_2.png) [@DanHakimi](https://forum.ghost.org/u/DanHakimi)\ **Post date:** [December 12, 2023, 6:41pm UTC](https://forum.ghost.org/t/robots-txt-configuration/12767/3 "2023-12-12T18:41:51Z")
is there a way to modify robots.txt on ghost pro’s $9/month plan? ---
**Author:** ![XPGained](https://sea1.discourse-cdn.com/flex015/user_avatar/forum.ghost.org/xpgained/32/26887_2.png) [@XPGained](https://forum.ghost.org/u/XPGained)\ **Post date:** [December 12, 2023, 8:48pm UTC](https://forum.ghost.org/t/robots-txt-configuration/12767/4 "2023-12-12T20:48:38Z")
Download your theme files, create a robots.txt file, save and reupload the theme. ---
**Author:** ![DanHakimi](https://sea1.discourse-cdn.com/flex015/user_avatar/forum.ghost.org/danhakimi/32/23986_2.png) [@DanHakimi](https://forum.ghost.org/u/DanHakimi)\ **Post date:** [December 12, 2023, 11:18pm UTC](https://forum.ghost.org/t/robots-txt-configuration/12767/5 "2023-12-12T23:18:22Z")
You can’t upload themes in the basic plan. ---
**Author:** ![Cowgirl](https://sea1.discourse-cdn.com/flex015/user_avatar/forum.ghost.org/cowgirl/32/26746_2.png) [@Cowgirl](https://forum.ghost.org/u/Cowgirl)\ **Post date:** [December 13, 2023, 2:27pm UTC](https://forum.ghost.org/t/robots-txt-configuration/12767/6 "2023-12-13T14:27:51Z")
I wish it was. Such a bummer it isn’t doable on the lowest tier 🤐 ---
**Author:** ![jonhickman](https://sea1.discourse-cdn.com/flex015/user_avatar/forum.ghost.org/jonhickman/32/33102_2.png) [@jonhickman](https://forum.ghost.org/u/jonhickman)\ **Post date:** [December 14, 2023, 8:41am UTC](https://forum.ghost.org/t/robots-txt-configuration/12767/7 "2023-12-14T08:41:24Z")
Hey, Dan (and @Cowgirl too) depending on what your actual objective is there may be options to achieve them without even touching robots.txt (though I won’t know without chatting about that) - if you haven’t already, email [support@ghost.org](mailto:support@ghost.org) to discuss your Ghost(Pro) site. ---
**Author:** ![gmf](https://avatars.discourse-cdn.com/v4/letter/g/a88e4f/32.png) [@gmf](https://forum.ghost.org/u/gmf)\ **Post date:** [January 24, 2024, 12:15am UTC](https://forum.ghost.org/t/robots-txt-configuration/12767/8 "2024-01-24T00:15:51Z")
Do you put the robots.txt files in the theme’s root directory or does it go somewhere else? ---
**Author:** ![gmf](https://avatars.discourse-cdn.com/v4/letter/g/a88e4f/32.png) [@gmf](https://forum.ghost.org/u/gmf)\ **Post date:** [January 24, 2024, 12:23am UTC](https://forum.ghost.org/t/robots-txt-configuration/12767/9 "2024-01-24T00:23:13Z")
Answered my own question. Yes put `robots.txt` in the root directory of your theme. I ended up adding and excluding some of the AI bots from my site. I pulled these examples from the New York Times’ `robots.txt` file. I figured they would have a good handle on what to exclude since they are suing OpenAI and hate the idea of training AI services on their journalism. I added the text below to the existing text in the default ghost `robots.txt`. ```auto User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: ia_archiver Disallow: / User-Agent: omgili Disallow: / User-Agent: omgilibot Disallow: / ```