CI: run the Python test suite on Windows and macOS #675
Description
Problem: the Python test job in .github/workflows/ci.yml runs only on ubuntu-latest (it varies the Python version, not the OS). Windows and macOS only run the Julia and C++ jobs. The CLI and the mkconcore.py script generation, including the Windows .bat scripts and the macOS/posix paths, are never tested on those systems in CI. Windows-specific bugs such as the quoting problems in run.bat/debug.bat are only found after merge, by users. Contributors on macOS also see failures (for example in the shared-memory tests) that CI never shows.
Proposal: add a separate test-os job that runs the existing pytest suite on windows-latest and macos-latest (Python 3.11, fail-fast: false). The existing Ubuntu test job stays unchanged. I would:
- run it once non-blocking to get the real list of failures on each OS,
- fix the ones that are real bugs, in small PRs,
- skip the ones that cannot work on that OS, each with a reason in the test,
- only then ask for the new job to be treated as required.
I'm happy to do all of this. Is this a direction you'd accept, and are there tests that you already know are Linux-only?
Activity
github-actions commentedon Nov 13, 2026
👋 Welcome to the CONTROL-CORE Project, @yadavchiragg! Thank you for opening your first issue in concore.
We appreciate your contribution to the organization and will review it as soon as possible.
Before we get started, please check out these resources:
yadavchiragg commentedon Nov 13, 2026
Update: I ran the proposed job on my fork as a dry run. Results:
shmget/shared-memory setup on macOS. I propose skipping those on macOS with a clear reason (and opening a separate issue for them) unless you'd prefer a fix.testjob with Python 3.9 fails on the new ubuntu-latest (26.04) because that image has no Python 3.9.I'll wait for your go-ahead before opening a PR for the workflow change.