Skip to content

ci: install conda explicitly in the workflows that need it - #8876

Merged
fstagni merged 1 commit into
DIRACGrid:integrationfrom
fstagni:ci/pilotwrapper-conda
Nov 9, 2026
Merged

fstagni merged 1 commit into
DIRACGrid:integrationfrom
fstagni:ci/pilotwrapper-conda

Conversation

@fstagni

@fstagni fstagni commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

CI fix: install conda explicitly in the PilotWrapper workflow

Summary

The PilotWrapper jobs have been failing on every PR since 2026-11-09 (runner image ubuntu26/20261101) with:

prepare environment: line 1: conda: command not found

The workflow assumes conda is preinstalled and on the PATH of ubuntu-latest runners — the new image no longer provides it. This PR provisions it explicitly:

       - name: Fail-fast for outdated pipelines
         run: .github/workflows/fail-fast.sh
+
+      # conda is no longer preinstalled (nor on the PATH) of the ubuntu-latest
+      # runner images; install it explicitly since the next steps rely on it
+      - name: Install conda
+        uses: conda-incubator/setup-miniconda@v3
+        with:
+          auto-update-conda: false
+          activate-environment: ""
 
       - name: prepare environment
         run: |
           conda config --set add_pip_as_python_dependency false

Two other workflows had the same problem (raw conda + the Miniconda PATH hack, both gone from the new image) and get the same treatment: cvmfs.yml (Deployment_test) and deployment.yml (deploy_CVMFS). Both are workflow_dispatch only, so their breakage was invisible on PRs.

Everything else — the conda config/conda create invocations, and the test itself — is unchanged.

Evidence

  • Failure timeline: pilotWrapper.yml runs pass up to 2026-11-06 (including this org's other PR branches), fail from 2026-11-09 regardless of branch — e.g. feat/add-custom-param-to-ps (runs 4259707... / 08:14 and 09:22 UTC) and feat/hs23-cpu-normalization (also retried once, same conda: command not found).
  • The runner image change is visible in the job logs: "Image Release: ubuntu26/20261101.186".
  • This PR's own PilotWrapper jobs will exercise the fix directly.

Merge Danger

Door: two-way — one workflow step added; if setup-miniconda misbehaves the jobs fail exactly as they do today.

Blast Radius: CI only; no product code.

@aldbr

aldbr commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Comment thread .github/workflows/pilotWrapper.yml Resolved
Comment thread .github/workflows/pilotWrapper.yml Resolved
@aldbr

aldbr commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Aren't you going to have the same issue with cvmfs.yml?

runs-on: "ubuntu-latest"
steps:
- name: Install system packages
run: |
echo "===== Install fetch-crl as a system package ====="
sudo apt-get update
sudo apt-get install -y fetch-crl
- name: prepare environment
run: |
conda create -c conda-forge -n cvmfs-env ca-policy-lcg openssl==3.0.7 gct

@fstagni fstagni changed the title ci: install conda explicitly in the PilotWrapper workflow ci: install conda explicitly in the workflows that need it Nov 9, 2026
…ent workflow

The ubuntu-latest runner images no longer ship conda on the PATH, so the
'prepare environment' step fails with 'conda: command not found' on
every PR since 2026-11-09 (runner image ubuntu26/20261101). Install
Miniconda explicitly with conda-incubator/setup-miniconda before the
steps that rely on it; the conda commands themselves are unchanged.
Also use python 3.6.9 from conda-forge in the PilotWrapper matrix

Co-authored-by: aldbr <aldbr@outlook.com>
@fstagni
fstagni force-pushed the ci/pilotwrapper-conda branch from f29ac02 to 1c7ba2d Compare November 9, 2026 14:02
@fstagni

fstagni commented Nov 9, 2026

Copy link
Copy Markdown
Contributor Author

All checks are green (23 passing; the two skipped jobs are intentional). Note that the approval was auto-dismissed by dismiss_stale_reviews after the last two pushes (the 3.6.9 matrix pin replacing 3.6.8 — which only existed in the defaults channel — and the same conda treatment for cvmfs.yml/deployment.yml), so the PR now shows BLOCKED pending a re-approval. Once merged, #8870 and #8874 will be rebased/updated onto the fix.

@fstagni
fstagni merged commit a2a986a into DIRACGrid:integration Nov 9, 2026
25 checks passed
@DIRACGridBot DIRACGridBot added the sweep:ignore Prevent sweeping from being ran for this PR label Nov 9, 2026
fstagni added a commit to fstagni/DIRAC that referenced this pull request Nov 9, 2026
Backport of DIRACGrid#8876: the ubuntu-latest runner images no longer ship conda
on the PATH, so the PilotWrapper jobs fail with 'conda: command not
found' on every PR (runner image ubuntu26/20261101). Install Miniforge
explicitly with conda-incubator/setup-miniconda before the steps that
rely on it; python 3.6.8 becomes 3.6.9, the nearest build on
conda-forge, and the unused 'free' channel is dropped. The CVMFS
deployment workflows get the same treatment.
fstagni added a commit to fstagni/DIRAC that referenced this pull request Nov 9, 2026
Backport of DIRACGrid#8876: the ubuntu-latest runner images no longer ship conda
on the PATH, so the PilotWrapper jobs fail with 'conda: command not
found' on every PR (runner image ubuntu26/20261101). Install Miniforge
explicitly with conda-incubator/setup-miniconda before the steps that
rely on it; python 3.6.8 becomes 3.6.9, the nearest build on
conda-forge, and the unused 'free' channel is dropped. The CVMFS
deployment workflows get the same treatment.
fstagni added a commit to fstagni/DIRAC that referenced this pull request Nov 9, 2026
Backport of DIRACGrid#8876: the ubuntu-latest runner images no longer ship conda
on the PATH, so the PilotWrapper jobs fail with 'conda: command not
found' on every PR (runner image ubuntu26/20261101). Install Miniforge
explicitly with conda-incubator/setup-miniconda before the steps that
rely on it; python 3.6.8 becomes 3.6.9, the nearest build on
conda-forge, and the unused 'free' channel is dropped. The CVMFS
deployment workflows get the same treatment.
fstagni added a commit to fstagni/DIRAC that referenced this pull request Nov 9, 2026
Backport of DIRACGrid#8876: the ubuntu-latest runner images no longer ship conda
on the PATH, so the PilotWrapper jobs fail with 'conda: command not
found' on every PR (runner image ubuntu26/20261101). Install Miniforge
explicitly with conda-incubator/setup-miniconda before the steps that
rely on it; python 3.6.8 becomes 3.6.9, the nearest build on
conda-forge, and the unused 'free' channel is dropped. The CVMFS
deployment workflows get the same treatment.
fstagni added a commit to fstagni/DIRAC that referenced this pull request Nov 9, 2026
Backport of DIRACGrid#8876: the ubuntu-latest runner images no longer ship conda
on the PATH, so the PilotWrapper jobs fail with 'conda: command not
found' on every PR (runner image ubuntu26/20261101). Install Miniforge
explicitly with conda-incubator/setup-miniconda before the steps that
rely on it; python 3.6.8 becomes 3.6.9, the nearest build on
conda-forge, and the unused 'free' channel is dropped. The CVMFS
deployment workflows get the same treatment.
fstagni added a commit to fstagni/DIRAC that referenced this pull request Nov 9, 2026
Backport of DIRACGrid#8876: the ubuntu-latest runner images no longer ship conda
on the PATH, so the PilotWrapper jobs fail with 'conda: command not
found' on every PR (runner image ubuntu26/20261101). Install Miniforge
explicitly with conda-incubator/setup-miniconda before the steps that
rely on it; python 3.6.8 becomes 3.6.9, the nearest build on
conda-forge, and the unused 'free' channel is dropped. The CVMFS
deployment workflows get the same treatment.
fstagni added a commit to fstagni/DIRAC that referenced this pull request Nov 9, 2026
Backport of DIRACGrid#8876: the ubuntu-latest runner images no longer ship conda
on the PATH, so the PilotWrapper jobs fail with 'conda: command not
found' on every PR (runner image ubuntu26/20261101). Install Miniforge
explicitly with conda-incubator/setup-miniconda before the steps that
rely on it; python 3.6.8 becomes 3.6.9, the nearest build on
conda-forge, and the unused 'free' channel is dropped. The CVMFS
deployment workflows get the same treatment.
fstagni added a commit to fstagni/DIRAC that referenced this pull request Nov 9, 2026
Backport of DIRACGrid#8876: the ubuntu-latest runner images no longer ship conda
on the PATH, so the PilotWrapper jobs fail with 'conda: command not
found' on every PR (runner image ubuntu26/20261101). Install Miniforge
explicitly with conda-incubator/setup-miniconda before the steps that
rely on it; python 3.6.8 becomes 3.6.9, the nearest build on
conda-forge, and the unused 'free' channel is dropped. The CVMFS
deployment workflows get the same treatment.
fstagni added a commit to fstagni/DIRAC that referenced this pull request Nov 9, 2026
Backport of DIRACGrid#8876: the ubuntu-latest runner images no longer ship conda
on the PATH, so the PilotWrapper jobs fail with 'conda: command not
found' on every PR (runner image ubuntu26/20261101). Install Miniforge
explicitly with conda-incubator/setup-miniconda before the steps that
rely on it; python 3.6.8 becomes 3.6.9, the nearest build on
conda-forge, and the unused 'free' channel is dropped. The CVMFS
deployment workflows get the same treatment.
fstagni added a commit to fstagni/DIRAC that referenced this pull request Nov 9, 2026
Backport of DIRACGrid#8876: the ubuntu-latest runner images no longer ship conda
on the PATH, so the PilotWrapper jobs fail with 'conda: command not
found' on every PR (runner image ubuntu26/20261101). Install Miniforge
explicitly with conda-incubator/setup-miniconda before the steps that
rely on it; python 3.6.8 becomes 3.6.9, the nearest build on
conda-forge, and the unused 'free' channel is dropped. The CVMFS
deployment workflows and the pylint-py27 job get the same treatment.
The Pilot artifacts are downloaded with 'gh run download', avoiding the
rate-limit flakiness of the unauthenticated API call.
fstagni added a commit to fstagni/DIRAC that referenced this pull request Nov 9, 2026
Backport of DIRACGrid#8876: the ubuntu-latest runner images no longer ship conda
on the PATH, so the PilotWrapper jobs fail with 'conda: command not
found' on every PR (runner image ubuntu26/20261101). Install Miniforge
explicitly with conda-incubator/setup-miniconda before the steps that
rely on it; python 3.6.8 becomes 3.6.9, the nearest build on
conda-forge, and the unused 'free' channel is dropped. The CVMFS
deployment workflows and the pylint-py27 job get the same treatment.
The Pilot artifacts are downloaded with 'gh run download', avoiding the
rate-limit flakiness of the unauthenticated API call.
aldbr added a commit that referenced this pull request Nov 10, 2026
ci: install conda explicitly in the workflows that need it (backport of #8876)
aldbr added a commit that referenced this pull request Nov 10, 2026
ci: install conda explicitly in the workflows that need it (backport of #8876)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

sweep:ignore Prevent sweeping from being ran for this PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants