All issues

Search results

FA4 + context parallelism produces NaN gradients on SM100 after flash-attention #2490

Status: Open.

#3528 In NVIDIA/TransformerEngine;

· nvegesna-netizen opened on Sep 16, 2026

Graph-Safe FP8 BlockScaling Support on Blackwell for GroupedLinear

Status: Open.

#3520 In NVIDIA/TransformerEngine;

· vthumbe1503 opened on Sep 15, 2026

MXFP8 GEMM rejects compact unswizzled scales that quantize_ accepts

Status: Open.

#3518 In NVIDIA/TransformerEngine;

· wujingyue opened on Sep 15, 2026

[PyTorch][Attention] THD P2P context-parallel regression when padded cu_seqlens are value-equal but not object-identical

attention

Status: Open.

#3487 In NVIDIA/TransformerEngine;

· cuichenx opened on Sep 5, 2026

[Bug] Backend selection picks FA3 for training with head_dim_qk=192 / v_head_dim=128, but FA3 backward cannot run it

attention

Status: Open.

#3481 In NVIDIA/TransformerEngine;

· yuweih205 opened on Sep 4, 2026

[Bug] Illegal memory access in grouped MXFP8 quantize on GB200 (sm_100) introduced by #3337; TMA store completion handoff missing in group_quantize_mxfp8.cuh

Status: Open.

#3474 In NVIDIA/TransformerEngine;

· janbernloehr opened on Sep 3, 2026

Tied weights do not accumulate with delayed wgrad

Status: Open.

#3437 In NVIDIA/TransformerEngine;

· wujingyue opened on Aug 28, 2026

NCCL EP hard link makes import transformer_engine require libcuda.so.1

Status: Open.

#3381 In NVIDIA/TransformerEngine;

· cuichenx opened on Aug 13, 2026

[Bug] Triton mask-map moe_permute ignores num_out_tokens

Status: Open.

#3346 In NVIDIA/TransformerEngine;

· truong-v opened on Aug 11, 2026

[Bug] Deferred init issue in te.pytorch.ops

bugSomething isn't workingSomething isn't working

Status: Open.

#3322 In NVIDIA/TransformerEngine;

· yaox12 opened on Aug 6, 2026

[Bug] CUDA graph backward replay illegal memory access after validation with mixed NVFP4/MXFP8 Mamba

Status: Open.

#3316 In NVIDIA/TransformerEngine;

· Phlip79 opened on Aug 4, 2026

thd + attention_dropout routes to the composite cuDNN SDPA engine and costs 5x on Blackwell

attention

Status: Open.

#3312 In NVIDIA/TransformerEngine;

· bzantium opened on Aug 4, 2026