Skip to content

scripts/musebench/leak_map.py (unit-tested) has written /home/unohee/data/musebench/leak/leak_report.json naming the Art - #10

Merged
unohee merged 1 commit into
mainfrom
goal/09-scripts-musebench-leak-map-py
Nov 3, 2026
Merged

unohee merged 1 commit into
mainfrom
goal/09-scripts-musebench-leak-map-py

Conversation

@unohee

@unohee unohee commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Milestone of an auto-claude run.

Check: systemd-run --user --scope -q -p MemoryMax=6G ~/RTX_ENV/bin/python -m pytest -m "not slow" -q -p no:cacheprovider && ~/RTX_ENV/bin/python -I scripts/musebench/verify.py leak

Plan: .claude/auto-plan.md (local to the run).

… verifier

leak_map.py marks every runtime-manifest row seen_in_training by identity:
SONICS file name + size (Suno/Udio), FMA track id + local-copy size,
MTG-Jamendo title/artist + duration (Jamendo); transforms inherit from
their clean track and co-created remixes from their human source.
verify.py leak checks the report names model and training manifests,
methods, per-source counts and manifest fingerprint.

Assumptions (ArtifactNet v9.4): the per-row list of the v2 training set
(intrect/artifactnet-training-data) is unavailable (HF 404, local build
offloaded), so the candidate pool of scripts/build_hf_dataset.py
define_sources() is used: an upper bound. MTG-Jamendo folders 00-08 are
the pool because the 2026-09-04 download log lists them as pre-existing.
Machine paths live in MUSEBENCH_ROOT/leak/references.json, not the repo.
@unohee
unohee merged commit 7fd5595 into main Nov 3, 2026
1 check passed
@unohee
unohee deleted the goal/09-scripts-musebench-leak-map-py branch November 3, 2026 20:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant