Skip to content

cecilia/feature/nki-flash-attention - #220

Closed
Cecilia123li wants to merge 2 commits into
mainfrom
cecilia/feature/nki-flash-attention
Closed

Cecilia123li wants to merge 2 commits into
mainfrom
cecilia/feature/nki-flash-attention

Conversation

@Cecilia123li

Copy link
Copy Markdown
Collaborator

Added the NKI kernel implementation for flash attention

@bowencui123

Copy link
Copy Markdown
Collaborator

Superseded by #276 (bowen/nki/flash_attention), which carries the newer consolidated version of this operator from cecilia/feature/nki-vector-add (nki-all-operators, #259) — migrated import nki API plus the later fixes — re-based onto main as an operator-only diff. Closing this older per-operator PR to keep one reviewable PR per operator; the branch is left in place.

Related: #261 (deterministic NEFF identity for NKI timing), #262 (Trainium peak/roofline infra).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants