Skip to content

Support loading pretrained weights from local checkpoints - #217

Merged
Jake Smith (jsmith13) merged 1 commit into
microsoft:mainfrom
jsmith13:local-checkpoint
Sep 24, 2026
Merged

Jake Smith (jsmith13) merged 1 commit into
microsoft:mainfrom
jsmith13:local-checkpoint

Conversation

@jsmith13

Copy link
Copy Markdown
Collaborator

Summary

  • add --pretrained-model-path for local Fairseq checkpoints and raw model state dictionaries
  • keep existing named checkpoint downloads and output-layer reset behavior unchanged
  • reject ambiguous name-plus-path configuration and provide explicit missing or malformed checkpoint errors
  • support the local path in the evaluation entry point and document trusted-source and distributed-filesystem requirements
  • add focused loader tests

This PR is independent of #216 and can be reviewed or merged separately.

Validation

  • 8 focused unit tests for local, named, invalid, and distributed-initialized loading paths
  • exact PCQM4Mv2 GPU inference parity from a mounted local checkpoint
  • output-layer reset verification with encoder weights retained
  • two-process distributed load from a shared local checkpoint
  • Fairseq CLI parsing for --pretrained-model-path

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@jsmith13
Jake Smith (jsmith13) marked this pull request as ready for review September 23, 2026 23:24
@jsmith13
Jake Smith (jsmith13) merged commit c27c6e8 into microsoft:main Sep 24, 2026
3 checks passed
@jsmith13
Jake Smith (jsmith13) deleted the local-checkpoint branch September 24, 2026 21:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants