Skip to content

[Feature] Add fused option for AdamW - #2078

Open
zzwwrr wants to merge 1 commit into
InternLM:mainfrom
zzwwrr:ready/fused-adamw
Open

zzwwrr wants to merge 1 commit into
InternLM:mainfrom
zzwwrr:ready/fused-adamw

Conversation

@zzwwrr

@zzwwrr zzwwrr commented Sep 8, 2026

Copy link
Copy Markdown

Expose the fused setting through AdamWConfig and the GLM-5.2 SFT example. Forward it to both optimizer paths and reject incompatible foreach/fused combinations.

Expose the fused setting through AdamWConfig and the GLM-5.2 SFT example. Forward it to both optimizer paths and reject incompatible foreach/fused combinations.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant