Skip to content

ci: bootstrap Python dependencies before shard verification - #1778

Open
sd-db wants to merge 1 commit into
mainfrom
ci-fix/shard-verifier-bootstrap
Open

sd-db wants to merge 1 commit into
mainfrom
ci-fix/shard-verifier-bootstrap

Conversation

@sd-db

@sd-db sd-db commented Nov 17, 2026

Copy link
Copy Markdown
Collaborator

Description

On a runner without cached Python 3.10, setup-python reinstalls pip. The gather-shards jobs did not configure a package source first, so pip attempted blocked public PyPI and the jobs failed before downloading artifacts or verifying shard coverage, even when all functional shards passed.

Both integration workflows now restore the existing Python dependency cache before Python setup and configure the existing JFrog proxy fallback on a cache miss. Cache hits use the offline wheelhouse. Artifact handling and shard-verification behavior are unchanged.

Validation: 18 focused local bootstrap/verifier checks, five existing workflow regression tests, full code-quality checks, and an offline pip reinstall in a fresh Python 3.10 environment passed. The verifier checks execute both workflows' shell commands against valid artifacts and reject wrong test IDs or missing JUnit files for all three profiles. Cache-miss configuration was simulated; actual runner cache restoration and JFrog authentication remain to be verified in GitHub Actions.

Checklist

  • I have run this code in development and it appears to resolve the stated issue.
  • Additional committed tests are not required for this workflow-only change; focused local checks exercise both verifier paths.
  • No changelog entry is needed for this CI-only change with no adapter runtime impact.
  • [Optional] I have run the dbt-databricks-pr-ready project skill for this PR and addressed its merge-readiness feedback.

Signed-off-by: Shubham Dhal <shubham.dhal@databricks.com>
@sd-db
sd-db marked this pull request as ready for review November 17, 2026 16:00
@sd-db
sd-db enabled auto-merge (squash) November 17, 2026 16:01
@github-actions

Copy link
Copy Markdown

Coverage report

This PR does not seem to contain any modification to coverable code.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant