What’s your URL? https://ghost.optezo.com
What version of Ghost are you using? Latest, 3.37.1
How was Ghost installed and configured? Via CLI, ubuntu 18.04
What Node version, database, OS & browser are you using? Node 10.23.0, mysql local
What errors or information do you see in the console? None
I’m able to successfully put a custom robots.txt file in the base of my theme and have that file used, but I’m trying to run ghost headless, using the API from another site. When I make the site “private”, the robots.txt automatically turns into
User-agent: * Disallow: /
and my custom robots.txt file isn’t use. I need robots to access the /content/images folder, or things such as twitter cards and the like will not work. These agents will honor the robots.txt file and will not populate images.
How can I add a custom robots.txt file for when the site is in private mode? I can’t find anything in the docs or forums related to this. Thanks!