Skip to content

[chore] Remove obsolete sccache settings - #2860

Merged
juenglin merged 2 commits into
NVIDIA:mainfrom
juenglin:ci-cleanup
Sep 17, 2026
Merged

juenglin merged 2 commits into
NVIDIA:mainfrom
juenglin:ci-cleanup

Conversation

@juenglin

@juenglin juenglin commented Sep 14, 2026

Copy link
Copy Markdown
Contributor

Removes the SCCACHE_DIR and SCCACHE_CACHE_SIZE exports (and their comment) from the build branch of ci/tools/env-vars.

These configure sccache's local on-disk cache backend, but the wheel-build workflow (.github/workflows/build-wheel.yml) enables the GitHub Actions cache backend via SCCACHE_GHA_ENABLED=true and forwards the GHA runtime/cache credentials into cibuildwheel's container. There is no SCCACHE_MULTILEVEL_CHAIN configuration layering disk in front of GHA, so these two variables have no effect on cache hits or persistence.

Git history confirms this is leftover from the original sccache integration (#1156), which set SCCACHE_DIR/SCCACHE_CACHE_SIZE while the GHA-based approach was still being worked out. Later changes to the sccache setup (#1914, #1879, #2221) never removed them.

No functional change expected: sccache will use its default local state directory inside the build container instead of the host-mounted one.

@copy-pr-bot

copy-pr-bot Bot commented Sep 14, 2026

Copy link
Copy Markdown
Contributor

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@github-actions github-actions Bot added the CI/CD CI/CD infrastructure label Sep 14, 2026
@juenglin juenglin added the cuda.core Everything related to the cuda.core module label Sep 14, 2026
@juenglin juenglin self-assigned this Sep 14, 2026
@juenglin juenglin added cuda.bindings Everything related to the cuda.bindings module P1 Medium priority - Should do and removed cuda.core Everything related to the cuda.core module labels Sep 14, 2026
@juenglin
juenglin requested a review from mdboom September 14, 2026 23:26
@juenglin juenglin changed the title Remove obsolete sccache settings [chore] Remove obsolete sccache settings Sep 14, 2026
@juenglin

Copy link
Copy Markdown
Contributor Author

/ok to test d628e2d

@mdboom mdboom left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems fine in principle, but it does seem to break the build -- not sure why.

@copy-pr-bot

copy-pr-bot Bot commented Sep 16, 2026

Copy link
Copy Markdown
Contributor

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@juenglin

Copy link
Copy Markdown
Contributor Author

/ok to test e7c6ed4

@juenglin
juenglin requested a review from mdboom September 16, 2026 23:07
@juenglin
juenglin marked this pull request as ready for review September 16, 2026 23:07
@juenglin

Copy link
Copy Markdown
Contributor Author

/ok to test 00d8e24

@juenglin
juenglin enabled auto-merge (squash) September 17, 2026 18:15

@rwgk rwgk left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

codex gpt-5.6-sol ultra:

Finding

  • P2 — The removed variables are not no-ops. In the base, they configure and forward a host-backed disk cache alongside GHA: env-vars, build-wheel.yml. The exact installed sccache version creates a disk backend from these variables, collects it with GHA even without SCCACHE_MULTILEVEL_CHAIN, and wraps both in MultiLevelStorage: parsing, selection, construction.

CI Evidence

Based on inspecting CI logs, the workflow runs sccache --show-adv-stats:

  • The base Linux job reports Multi-level (2 levels): disk L0 at the host-mounted path and GHA L1. It recorded one L0 hit, 60 misses/backfills, and a 1 GiB maximum.
  • The matching PR-head job reports GHA only. Its preprocessor cache also moves from the host-mounted directory to container-local /root/.cache/sccache/preprocessor.
  • Four sampled base jobs showed the same pattern: the disk tier produced only one hit in the third build stage, while GHA served almost everything. Thus its observed value is small, but demonstrably nonzero.
  • All 31 current wheel-build jobs passed. The sole broader CI failure when checked was an unrelated docs deployment rejected for force-pushing gh-pages.

I would request a rationale correction rather than necessarily reject the implementation: describe this as intentionally removing a nearly ineffective Linux disk L0 tier, not as a no-op. If “no functional change” is required, retain the settings. Pinning sccache instead of downloading latest would also prevent backend semantics from changing underneath the workflow.

No additional code findings. I used GitHub MCP for PR metadata and authenticated read-only gh access for the job logs.

@juenglin
juenglin disabled auto-merge September 17, 2026 18:57
@github-actions

This comment has been minimized.

@juenglin

Copy link
Copy Markdown
Contributor Author

codex gpt-5.6-sol ultra:

Finding

  • P2 — The removed variables are not no-ops. ...

GPT is right. There are at least two implementations of sccache and the no-op claim in the PR description is correct for Mozilla's version (see here) but not RAPID's version that we are using.

Keeping a two-level cache seems useful then. But why is the hit rate for the L0 cache so low? It's because the runners are all ephemeral and this disk cache is empty for every new run. So not useful. But for a different reason I thought at first. Thanks for pointing that out.

@juenglin
juenglin merged commit dad598c into NVIDIA:main Sep 17, 2026
220 of 222 checks passed
@github-actions

Copy link
Copy Markdown
Contributor
Doc Preview CI
Preview removed because the pull request was closed or merged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI/CD CI/CD infrastructure cuda.bindings Everything related to the cuda.bindings module P1 Medium priority - Should do

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants