Skip to content

Use Pixi in macOS-intel CI - #13704

Draft
scott-huberty wants to merge 118 commits into
mne-tools:mainfrom
scott-huberty:pixi
Draft

Use Pixi in macOS-intel CI#13704
scott-huberty wants to merge 118 commits into
mne-tools:mainfrom
scott-huberty:pixi

Conversation

@scott-huberty

Copy link
Copy Markdown
Contributor

I'm exploring the feasibility of using Pixi to resolve the virtual environment and run tests specifically for the MacOS Intel CI, which currently uses Mamba to create the virtual environment.

My initial strategy was to just to do pixi init --import environment.yml, so that we can leverage our already defined YAML config file to pull in all the necessary dependencies, as well as configuring prefix-dev/setup-pixi to automatically activate our virtual environment, so that we can run commands like pytest etc without having to prepend pixi run everywhere for the pixi CI...

Unfortunately the only way I could get this to work was to disable use of a login shell.. Which of course makes all the condo-like CI's fail!!

@scott-huberty
scott-huberty marked this pull request as draft February 28, 2026 00:28
@tsbinns

tsbinns commented Feb 28, 2026

Copy link
Copy Markdown
Contributor

Hey @scott-huberty, looking at the current diff I noticed you're setting up pixi without activating the env, initing with environment.yml, then setting up again with env activation.

Found when switching to uv for the old job that the env can be activated at setup with a given Python ver and then have the required packages installed in github_actions_dependencies.sh:

- uses: astral-sh/setup-uv@v7
with:
version: ">=0.9"
activate-environment: true
cache-dependency-glob: |
**/pylock.ci-old.toml
python-version: ${{ matrix.python }}
if: matrix.kind == 'old'
- run: bash ./tools/github_actions_dependencies.sh

Wondered if a similar thing could work for pixi rather than needing 2 setups. Haven't looked through diffs for all commits, so apologies if you tried this already.

@drammock

Copy link
Copy Markdown
Member

TODO @scott-huberty make it so that the matrix python version specified in tests.yml gets inserted into the pixi.toml file

scott-huberty and others added 5 commits July 8, 2026 21:17
- The Pixi job replaces teh MacOS pip job on main.

- The MacOS pip job on main does not set MNE_TEST_ALLOW_SKIP

- mne/conftest.py:1357 treats unset MNE_TEST_ALLOW_SKIP as “allow all skips"

@scott-huberty scott-huberty left a comment

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Doh... Never submitted this review, which was just 1 comment!!

Comment thread .github/workflows/scheduled_updates.yml
@drammock

Copy link
Copy Markdown
Member

after adding a "this is autogenerated" comment to the top of pixi.toml (which may need slightly altering how we write it with tomlkit, i.e., dumping a tomlkit.document() instead of a dict), I think we'll be ready to merge here. @scott-huberty and I discussed migrating some of this into mne-tools/mne-tools already, and will do that in follow-up PRs

@scott-huberty

Copy link
Copy Markdown
Contributor Author

after adding a "this is autogenerated" comment to the top of pixi.toml ... I think we'll be ready to merge here.

done in e5bd471

Comment thread tools/write-pixi-toml.py Outdated
@drammock

Copy link
Copy Markdown
Member

@scott-huberty

scott-huberty commented Jul 29, 2026

Copy link
Copy Markdown
Contributor Author

possible problem: seems like environment is getting MNE stable release (not main/PR):

https://github.com/mne-tools/mne-python/actions/runs/30474035062/job/90651542841?pr=13704#step:18:61

probably because of this:

https://github.com/mne-tools/mne-python/actions/runs/30474035062/job/90651542841?pr=13704#step:9:372

hmm The pixi.lock file has: - conda: https://conda.anaconda.org/conda-forge/noarch/mne-base-1.12.1-pyh694c41f_200.conda

EDIT: Maybe because pixi.toml requests mne-qt-browser = "*" which pulls in MNE stable.

@@ -1,5 +1,6 @@
#!/bin/bash -ef

# TODO: I think that DEPS is cruft. Its not set anywhere??

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lingering TODO comment

echo "MNE_LOGGING_LEVEL=warning" | tee -a $GITHUB_ENV
echo "MNE_TEST_ALLOW_SKIP=.*(on conda|Requires (spm|brainstorm|misc) dataset|CUDA not|Flakey verbose behavior|PySide6 causes segfaults|SCIPY_ARRAY_API).*" | tee -a $GITHUB_ENV
echo "MNE_QT_BACKEND=PySide6" | tee -a $GITHUB_ENV
# NON-DRY but just gonna get it working and then refactor.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cruft comment?


set -eo pipefail


Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

extra newline?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants