ENG-2221 Add sitemap and robots metadata routes

[mdroidian]

Adds Next.js sitemap and robots metadata routes for public marketing, blog, and documentation pages. The robots route allows public crawling and references the absolute sitemap URL. Validation: pnpm install --frozen-lockfile and pnpm ci:validate passed. Separate delegated review returned no findings.

[linear-code]

ENG-2221

[supabase]

This pull request has been ignored for the connected project zytfjzqyijgagqxrzbmz because there are no changes detected in packages/database/supabase directory. You can change this behaviour in Project Integrations Settings ↗︎.

---

Preview Branches by Supabase.
Learn more about Supabase Branching ↗︎.

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated
discourse-graph	Ready	Preview	Sep 7, 2026 3:41am UTC

[chatgpt-codex-connector]

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review	Status	Commit	Review trigger
📝 Code Review	✅ Completed 2026-09-07T03:42:36.154241Z	1dae6dd	New commits

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

• Open a pull request for review
• Mark a draft as ready
• Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

[chatgpt-codex-connector]

💡 Codex Review

discourse-graph/apps/website/vitest.unit.config.mts

Line 7 in 924129c

include: ["app/**/*.test.{ts,tsx}", "test/unit/**/*.test.{ts,tsx}"],

Include the existing search-index unit test

When pnpm ci:validate invokes this newly added unit-test configuration, apps/website/scripts/build-docs-search-index.test.mjs matches neither include pattern, so regressions in its route mapping and build-output assertions can pass required validation. Extend test:unit to run that Node test or migrate it into the configured Vitest suite.

AGENTS.md reference: AGENTS.md:L93-L98

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

• Open a pull request for review
• Mark a draft as ready
• Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

[chatgpt-codex-connector]

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 74eb07def8

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

• Open a pull request for review
• Mark a draft as ready
• Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

[mdroidian]

The search-index test finding is addressed by a46c452 in #1406 and included in this rebased branch. The website test:unit command now runs all four existing Node search-index tests before Vitest. Frozen install, ci:validate, and GitHub checks passed. This is a general PR comment rather than a resolvable review thread.