Skip to content

fix(seo): verify sitemap and robots crawl discovery - #16

Merged
Cynrath merged 5 commits into
mainfrom
fix/sitemap-robots-integrity-20261026
Oct 26, 2026
Merged

Cynrath merged 5 commits into
mainfrom
fix/sitemap-robots-integrity-20261026

Conversation

@Cynrath

@Cynrath Cynrath commented Oct 26, 2026

Copy link
Copy Markdown
Owner

Diagnosis

Search Console reports "Sitemap could not be read"; the 49 sitemap URLs already match the 49 published HTML index pages and robots.txt correctly advertises the sitemap. HTTP reachability from Google's infrastructure remains unverified. Both offline docs generators stamp every sitemap URL with the build date, making the optional lastmod unreliable.

Changes

  • Keep all 49 canonical sitemap URL entries; omit stale/unverifiable lastmod timestamps.
  • Stop both documentation generators from re-introducing incorrect lastmod values.
  • Extend existing dependency-free docs-integrity verifier to enforce valid sitemap envelope, unique/complete canonical URL coverage and robots.txt indexing/crawl rules.
  • Document baseline, acceptance criteria, tests and post-deployment Search Console follow-up in P002.

Verification

  • Repository-tree cross-check: 49 published HTML pages = 49 unique sitemap URLs, none missing or extra.
  • robots.txt contains one correct sitemap URL and allows crawling.
  • Required CI: docs-integrity; squash merge only, to maintain the main branch's linear-history rules.

Search Console follow-up

After Pages publishes main, verify live HTTP 200 + XML for /sitemap.xml and then resubmit sitemap.xml in Search Console. A green repository CI does not itself establish Google fetch success.

@Cynrath
Cynrath merged commit 18fe282 into main Oct 26, 2026
1 check passed
@Cynrath
Cynrath deleted the fix/sitemap-robots-integrity-20261026 branch October 26, 2026 07:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant