Skip to content

hrx: pass logical row through shared F32 dequant reader - #187

Closed
AaronStGeorge wants to merge 1 commit into
users/astgeorg/p6dm24-qwen27-pr171-restored-20261104from
users/astgeorg/row64-shared-f32-reader
Closed

AaronStGeorge wants to merge 1 commit into
users/astgeorg/p6dm24-qwen27-pr171-restored-20261104from
users/astgeorg/row64-shared-f32-reader

Conversation

@AaronStGeorge

Copy link
Copy Markdown
Collaborator

Overview

Pass the logical row into the shared F32 dequant reader so row64 Q4/Q6 addressing uses the same operation and vector loop as standard-layout readers. Update its callers while preserving the shared F16 interface.

This is fix 1/5 in the row64 stack following #181. Stacks on #181; base branch: users/astgeorg/p6dm24-qwen27-pr171-restored-20261104. Commit: 826b09be989b4c7d5811d6a3525097ef071cd0fe. Keep each fix as a separate stacked PR.

Validation

Scalar references and ordinary Q4/native Q6/tiled controls passed. The inspected Q4/Q6 decode code matches the direct-reader control.

The complete stack at bd85479285423b239213519d0892c56d071864df was measured against frozen integration be335351871563a09520b0db4a63c21db2040807 with standalone llama-bench. The final fifteen-model table and separate Qwen3-0.6B stability result are in #181; those combined-stack results are not isolated gains from this commit.

Requirements

  • Contributing guidelines reviewed for this fork; human review and acceptance remain pending.
  • AI usage disclosure: YES. Codex assisted implementation, validation, independent review and this description under the user's direction.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant