Skip to content

🤖 ci: preserve all check-suite failures in the native-stack workflow - #4196

Merged
ammario merged 3 commits into
mainfrom
docs-gh-stack-preference
Sep 10, 2026
Merged

ammario merged 3 commits into
mainfrom
docs-gh-stack-preference

Conversation

@ammar-agent

@ammar-agent ammar-agent commented Sep 9, 2026

Copy link
Copy Markdown
Collaborator

Summary

Make PR readiness use GitHub's complete check rollup instead of the name-deduplicated gh pr checks projection, and record the preference for gh stack to manage native stacked PRs.

Background

On #4194, successful Required and Codex Comments checks from one workflow run hid two still-failing checks with the same names in another run. The previous readiness workflow incorrectly reported success. The new discovery path was tested against that live failure and returns exit 1 with both failing job URLs.

Implementation

  • Share paginated, commit-pinned head/merge check discovery between the readiness waiter and log extractor; retain independent suite results while relying on GitHub's rollup to exclude superseded attempts.
  • Fail closed on API errors or incomplete pagination, and keep unknown check states pending. Revalidate PR refs and merge/review state before accepting collected checks; a concurrent push or base update returns pending.
  • Do not infer that a pending Pixel status explains GitHub's BLOCKED state. Failure output prioritizes failing checks and identifies their commits.
  • Run offline behavioral regressions in CI and update AGENTS.md plus its generated skill copy.

Stack

Only remaining open PR in native stack #4174, now based on main after #4172, #4173, and #4194 merged.

Validation

Risks

Readiness becomes intentionally stricter: independent failures and unexplained GitHub blockers can no longer be masked by same-name successes or optional Pixel statuses.

Production ledger

Workflow scripts/config: +125 / −51 (net +74), excluding tests and documentation. Removed repeated state predicates, duplicated discovery, and the unsafe Pixel/BLOCKED shortcut; added complete paginated discovery and validation.


Generated with xum • Model: openai:gpt-6-astra • Thinking: xhigh • Cost: $591.32

@ammar-agent
ammar-agent added this pull request to stack #4174 September 9, 2026 16:59
@ammar-agent

Copy link
Copy Markdown
Collaborator Author

@codex review

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Sep 9, 2026

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review Completed 2026-09-09T21:26:41.344562Z 46e66aa Manual request
🔒 Security Review Completed 2026-09-09T21:27:18.232423Z 46e66aa Manual request
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector

This comment has been minimized.

1 similar comment
@chatgpt-codex-connector

This comment has been minimized.

@ammar-agent

Copy link
Copy Markdown
Collaborator Author

The native stack is verified as #4172#4173#4194#4196 (stack #4174). Local make static-check, instruction-file formatting, and git diff --check pass.

Codex code/security reviews are blocked by a checkout-service error: Provided git ref f17a30586f7901cd0a06d33d8b04a039585621cf does not exist. Both GitHub's branch-ref API and commit API return this exact published SHA. The same service error is affecting the lower stack, so code changes would not address it. Leaving the review gate unresolved and pausing repeated identical requests pending service recovery; this PR is not yet ready to merge.

@ammar-agent

Copy link
Copy Markdown
Collaborator Author

@codex review

Please retry the current published head. Prior attempts failed in the review service with a missing-ref checkout error; no code changes were made since those attempts. Please complete both code and security review.

@chatgpt-codex-connector

This comment has been minimized.

1 similar comment
@chatgpt-codex-connector

This comment has been minimized.

@ammar-agent

Copy link
Copy Markdown
Collaborator Author

@codex review

Rebased onto fresh main b03d253 with gh stack; current head is 37003ac. The four-PR native stack is preserved. Local static checks and 2,476 backend/UI regression tests passed on the full rebased stack. Please review this new head, including code and security checks.

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Can't wait for the next one!

Reviewed commit: 37003ac431

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@chatgpt-codex-connector

Copy link
Copy Markdown

🛡️ Codex Security Review · Automatically triggered

Security review completed. No security issues were found in this pull request.

Reviewed commit: 37003ac431

View security finding report

Only the user who started this review can view the report in Codex.

ℹ️ About Codex security reviews in GitHub

This is an experimental Codex feature. Security reviews are triggered when:

  • You comment "@codex security review"
  • A regular code review gets triggered (for example, "@codex review" or when a PR is opened), and you’re opted in so security review runs alongside code review

Once complete, Codex will leave suggestions, or a comment if no findings are found.

@ammar-agent

Copy link
Copy Markdown
Collaborator Author

Code and security review both completed successfully on current head 37003ac, with no findings. The four earlier checkout-error comments all refer to pre-rebase head f17a305 and are now superseded; marking those technical-error comments outdated while retaining the approval and security report. CI's comment gate will be rerun after this cleanup.

@ammar-agent ammar-agent changed the title 🤖 ci: prefer gh stack for native stacked PRs 🤖 ci: preserve all check-suite failures in the native-stack workflow Sep 9, 2026
@ammar-agent

Copy link
Copy Markdown
Collaborator Author

@codex review

@chatgpt-codex-connector

Copy link
Copy Markdown

🛡️ Codex Security Review · Automatically triggered

Security review completed. No security issues were found in this pull request.

Reviewed commit: 6e661f08c9

View security finding report

Only the user who started this review can view the report in Codex.

ℹ️ About Codex security reviews in GitHub

This is an experimental Codex feature. Security reviews are triggered when:

  • You comment "@codex security review"
  • A regular code review gets triggered (for example, "@codex review" or when a PR is opened), and you’re opted in so security review runs alongside code review

Once complete, Codex will leave suggestions, or a comment if no findings are found.

Base automatically changed from fix-stable-local-agent-warning to main September 9, 2026 21:12

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 6e661f08c9

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread scripts/lib/pr_check_filters.sh Outdated
@ammar-agent

Copy link
Copy Markdown
Collaborator Author

Addressed PRRT_kwDOPxxmWM6g1iZU: the collector now compares the initial readiness metadata, pins check queries to head/merge OIDs, and re-fetches the complete PR snapshot before returning any results. A changed head, merge OID, merge/review state, or failed final read cannot yield stale success. Added concurrent-update regressions; 22 new gate tests, 12 existing gate tests, shellcheck, static checks, and the live #4194 gate pass.

@ammar-agent

Copy link
Copy Markdown
Collaborator Author

@codex review

## Summary

Record the user preference to use `gh stack` for GitHub-native stacked PRs, keeping every PR linked in the native stack rather than only chaining base branches. `AGENTS.md` points to `docs/AGENTS.md`; the generated built-in skill copy is synchronized.

## Stack

Fourth PR in native stack #4174, directly above #4194: #4172#4173#4194 → this PR. Stack membership is managed with `gh stack link`.

## Validation

- Formatting checked against the resolved `AGENTS.md` target.
- `make static-check` and `git diff --check`.
- No prose-only assertion tests added.

## Subtractive ledger

Production logic: +0 / −0. One documentation line and its generated string mirror; no behavior changes or unrelated subtractions.

---

_Generated with `xum` • Model: `openai:gpt-6-astra` • Thinking: `xhigh` • Cost: `$459.97`_

<!-- mux-attribution: model=openai:gpt-6-astra thinking=xhigh costs=459.97 -->
## Summary

Make PR readiness use GitHub's complete check rollup instead of the name-deduplicated `gh pr checks` projection, and record the preference for `gh stack` to manage native stacked PRs.

## Background

On #4194, successful `Required` and `Codex Comments` checks from one workflow run hid two still-failing checks with the same names in another run. The previous readiness workflow incorrectly reported success. The new discovery path was tested against that live failure and returns exit 1 with both failing job URLs.

## Implementation

- Share paginated, commit-pinned head/merge check discovery between the readiness waiter and log extractor; retain independent suite results while relying on GitHub's rollup to exclude superseded attempts.
- Fail closed on API errors or incomplete pagination, and keep unknown check states pending.
- Do not infer that a pending Pixel status explains GitHub's `BLOCKED` state. Failure output prioritizes failing checks and identifies their commits.
- Run offline behavioral regressions in CI and update AGENTS.md plus its generated skill copy.

## Stack

Remains directly above #4194 in native stack #4174; #4172 and #4173 have merged.

## Validation

- 19 new PR-check regressions and 12 existing Codex-gate tests passed.
- Shellcheck, `make static-check`, and `git diff --check` passed.
- Live reproduction on #4194 surfaced both hidden failures from run `34385271008`; retrying that exact run subsequently passed.

## Risks

Readiness becomes intentionally stricter: independent failures and unexplained GitHub blockers can no longer be masked by same-name successes or optional Pixel statuses.

## Production ledger

Workflow scripts/config: +100 / −49 (net +51), excluding tests and documentation. Removed repeated state predicates, duplicated discovery, and the unsafe Pixel/BLOCKED shortcut; added complete paginated discovery and validation.

---

_Generated with `xum` • Model: `openai:gpt-6-astra` • Thinking: `xhigh` • Cost: `$591.32`_

<!-- mux-attribution: model=openai:gpt-6-astra thinking=xhigh costs=591.32 -->
## Summary

Make PR readiness use GitHub's complete check rollup instead of the name-deduplicated `gh pr checks` projection, and record the preference for `gh stack` to manage native stacked PRs.

## Background

On #4194, successful `Required` and `Codex Comments` checks from one workflow run hid two still-failing checks with the same names in another run. The previous readiness workflow incorrectly reported success. The new discovery path was tested against that live failure and returns exit 1 with both failing job URLs.

## Implementation

- Share paginated, commit-pinned head/merge check discovery between the readiness waiter and log extractor; retain independent suite results while relying on GitHub's rollup to exclude superseded attempts.
- Fail closed on API errors or incomplete pagination, and keep unknown check states pending. Revalidate PR refs and merge/review state before accepting collected checks; a concurrent push or base update returns pending.
- Do not infer that a pending Pixel status explains GitHub's `BLOCKED` state. Failure output prioritizes failing checks and identifies their commits.
- Run offline behavioral regressions in CI and update AGENTS.md plus its generated skill copy.

## Stack

Remains directly above #4194 in native stack #4174; #4172 and #4173 have merged.

## Validation

- 22 new PR-check regressions and 12 existing Codex-gate tests passed.
- Shellcheck, `make static-check`, and `git diff --check` passed.
- Live reproduction on #4194 surfaced both hidden failures from run `34385271008`; retrying that exact run subsequently passed.

## Risks

Readiness becomes intentionally stricter: independent failures and unexplained GitHub blockers can no longer be masked by same-name successes or optional Pixel statuses.

## Production ledger

Workflow scripts/config: +125 / −51 (net +74), excluding tests and documentation. Removed repeated state predicates, duplicated discovery, and the unsafe Pixel/BLOCKED shortcut; added complete paginated discovery and validation.

---

_Generated with `xum` • Model: `openai:gpt-6-astra` • Thinking: `xhigh` • Cost: `$591.32`_

<!-- mux-attribution: model=openai:gpt-6-astra thinking=xhigh costs=591.32 -->
@ammar-agent
ammar-agent force-pushed the docs-gh-stack-preference branch from fed5d8f to 46e66aa Compare September 9, 2026 21:21
@ammar-agent

Copy link
Copy Markdown
Collaborator Author

@codex review

@mintlify

mintlify Bot commented Sep 9, 2026

Copy link
Copy Markdown

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated
Mux 🟢 Ready View Preview Sep 9, 2026, 9:22 PM

💡 Tip: Enable Automations to automatically generate PRs for you.

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. 🎉

Reviewed commit: 46e66aa459

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@chatgpt-codex-connector

Copy link
Copy Markdown

🛡️ Codex Security Review · Automatically triggered

Security review completed. No security issues were found in this pull request.

Reviewed commit: 46e66aa459

View security finding report

Only the user who started this review can view the report in Codex.

ℹ️ About Codex security reviews in GitHub

This is an experimental Codex feature. Security reviews are triggered when:

  • You comment "@codex security review"
  • A regular code review gets triggered (for example, "@codex review" or when a PR is opened), and you’re opted in so security review runs alongside code review

Once complete, Codex will leave suggestions, or a comment if no findings are found.

@ammario
ammario merged commit b68a36f into main Sep 10, 2026
36 of 39 checks passed
@ammario
ammario deleted the docs-gh-stack-preference branch September 10, 2026 03:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants