Search engines cannot find your sitemap or rules
Missing robots.txt or sitemap.xml
What this means
Your site does not publish a robots.txt file, a sitemap, or both. A sitemap is the list of pages you want indexed; robots.txt is where crawlers look first to learn the rules and find that list.
Why it matters
Without them crawlers discover pages only by following links, so anything not linked from the front page can stay unindexed for a long time. It is not a fault in the site, but it slows down every new page you publish.
When this is not a problem
Small single-page sites lose little by not having a sitemap. The robots.txt file, however, is expected by crawlers on any domain.
How to fix it
- Publish /robots.txt, even if it only allows everything and points to the sitemap.
- Generate /sitemap.xml with the pages you want indexed; most frameworks can do it at build time.
- Add a Sitemap: line to robots.txt so crawlers find it without guessing.
- Submit the sitemap in Google Search Console.
Prompt for your AI agent
The site has no robots.txt or sitemap.xml. Generate both, list the public routes in the sitemap and reference it from robots.txt.
How to verify the fix: open /robots.txt and /sitemap.xml and confirm both return content
References: developers.google.com