Repository navigation
Add the release workflow and its gates - #52
Merged
Merged
Conversation
A v* tag checks the gates in configs/release_gates.json on dev (accuracy and calibration reproduce the bundle's recorded numbers; p95 latency and memory within the targets on the runner), smoke-tests the SciBERT image with the pinned bundle, pushes it to ghcr.io and creates a GitHub release recording the image digest. A manual run publishes nothing.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Implements the planned
release.yml.scripts/release_check.py+configs/release_gates.json: on dev only, entity and end-to-end relation F1 must reproduce the bundle's recorded CPU evaluation (±0.002); precision at 30% coverage (±0.01) and post-calibration ECE (≤ +0.01) must reproduce the committed calibration report; p95 latency ≤ 3 s and peak RSS ≤ 3 GB on the runner. ONNX/INT8 parity is not gated (served runtime is PyTorch FP32)..github/workflows/release.yml: on av*tag, corpus at the pinned commit → dev split → bundle at the pinned Hub revision → gates → SciBERT image build → container smoke test with the real bundle → push to ghcr.io → GitHub release with the manifest and image digest.workflow_dispatchruns everything except publishing.Local run of the gates (Apple M1, 4 threads): all pass; entity F1 0.8003, relation F1 0.6389, precision@30% 0.9205, ECE after 0.0087, p95 1.13 s, peak RSS 915 MiB.