Crawlers are programs that read your site, such as search engines that list your posts and AI companies that collect text to train their models. The file robots.txt tells them which parts of the site they may read. Ghost writes one for you. Fantasma can add rules that keep AI crawlers out, or replace the file with your own.
Block AI crawlers
Open your project in Fantasma.
In the narrow column of icons at the left edge of the editor, click the sliders icon, Project settings.
Click SEO.
Turn on Block AI crawlers. A note says the file now ships in the theme.
The theme then carries a robots.txt with Ghost's usual rules, plus a rule that asks GPTBot, ClaudeBot, Google-Extended and PerplexityBot to stay out of the whole site. Google-Extended covers Google's AI models only, so Google Search still lists your site. It takes effect when you publish the theme, as Publish your theme to Ghost shows. To check, open robots.txt at your site's address, such as https://example.com/robots.txt. The file belongs to the theme, so activating another theme in Ghost brings back Ghost's own file.
robots.txt is a request. The crawlers named here follow it, but nothing in the file stops a crawler that ignores it.
Write your own robots.txt
On the SEO page, turn on Edit robots.txt. A text box opens with Ghost's usual rules, and the AI rules too if Block AI crawlers is on.
Change the rules in the text box.
The file ships in the theme exactly as you write it, up to 20,000 characters. Turning Block AI crawlers on or off adds or removes its four rules at the end of your text.
Ghost's usual rules keep crawlers out of the admin, the email previews and a few internal addresses:
The Sitemap line uses the address of the Ghost site connected to the project. With no site connected, the file has no Sitemap line. With Block AI crawlers on and Edit robots.txt off, the line follows the connected site each time you publish. In your own text, it stays as you wrote it, so add or change it yourself when you connect a site or move to another domain.
Turning off Edit robots.txt deletes your text, without a warning. To go back to Ghost's own file, turn off both switches.
Crawlers are programs that read your site, such as search engines that list your posts and AI companies that collect text to train their models. The file
robots.txttells them which parts of the site they may read. Ghost writes one for you. Fantasma can add rules that keep AI crawlers out, or replace the file with your own.Block AI crawlers
The theme then carries a
robots.txtwith Ghost's usual rules, plus a rule that asks GPTBot, ClaudeBot, Google-Extended and PerplexityBot to stay out of the whole site. Google-Extended covers Google's AI models only, so Google Search still lists your site. It takes effect when you publish the theme, as Publish your theme to Ghost shows. To check, openrobots.txtat your site's address, such ashttps://example.com/robots.txt. The file belongs to the theme, so activating another theme in Ghost brings back Ghost's own file.robots.txtis a request. The crawlers named here follow it, but nothing in the file stops a crawler that ignores it.Write your own robots.txt
The file ships in the theme exactly as you write it, up to 20,000 characters. Turning Block AI crawlers on or off adds or removes its four rules at the end of your text.
Ghost's usual rules keep crawlers out of the admin, the email previews and a few internal addresses:
The
Sitemapline uses the address of the Ghost site connected to the project. With no site connected, the file has noSitemapline. With Block AI crawlers on and Edit robots.txt off, the line follows the connected site each time you publish. In your own text, it stays as you wrote it, so add or change it yourself when you connect a site or move to another domain.Turning off Edit robots.txt deletes your text, without a warning. To go back to Ghost's own file, turn off both switches.