Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
424 commits
Select commit Hold shift + click to select a range
d88040c
vocab : add clean_spaces GGUF key (#30940)
tkran2 Oct 22, 2026
7170cad
sycl: fix CONV_2D wrong results for non-contiguous input (#30363)
mctylr-gh Oct 22, 2026
1f4c2ee
ci : be able to reconfigure HTTP port for server pytest workers (#30972)
ggerganov Oct 22, 2026
5f5acfe
ci : disable slow WebGPU tests (#30963)
ggerganov Oct 22, 2026
a5d2227
server : support typed content input for RERANK endpoint (#29625)
timothywang21 Oct 22, 2026
0693dbf
nemotron : support non-standard GQA, BPE tokenizer and domyn-small pr…
martin-cimmino Oct 22, 2026
d772569
vulkan: replace std::aligned_alloc with posix_memalign for termux com…
bill88t Oct 22, 2026
d81d0d8
Multi-column on Intel XMX matrix engines refactored (#29864)
budiony Oct 22, 2026
d9ee007
model : fix qwen4exp layer inputs for DFlash drafters (#30927)
ggerganov Oct 22, 2026
5c19a5a
glm5 : optimize inputs (#30932)
ggerganov Oct 22, 2026
36cbf41
Fix !30793
gaugarg-nv Oct 22, 2026
19ab5a5
clef : include <algorithm> for std::find and std::copy (#30981)
kleinbem Oct 22, 2026
a08ab75
mtmd : add MiniCPM-OCR 1.0 support (#30979)
tc-mb Oct 22, 2026
970b51c
opencl: add depthwise conv2d (#30900)
kurquhar Oct 22, 2026
d814cbb
server: realtime API: send complete after committed audio drains (#30…
ngxson Oct 22, 2026
184f653
server: Substitute rerank placeholder from the original template only…
Pengkun-ZHU Oct 22, 2026
7377bad
sycl: Add graph record and replay (#28725)
malsbat Oct 23, 2026
0a9ef00
sycl: Replace host waits in fattn-mkl with explicit dependencies (#30…
malsbat Oct 23, 2026
643b0cd
hexagon: Op Fusion refactoring, optimizations and new fusions like `B…
max-krasnyansky Oct 23, 2026
f9599d0
vocab : fix Nemotron-3.5-Embed tokenization (#30974)
tokinasin Oct 23, 2026
1ab09d6
Extend probabilistic sampling for DFlash2 drafts (#30663)
praneshgo Oct 23, 2026
f64a498
sycl : pass device into mul_mat_uses_onednn (#31014)
Titaniumtown Oct 23, 2026
f5027fb
CANN: missing `const` qualifiers added for consistency (#30933)
rauletorresc Oct 23, 2026
f00c908
ci : add behavior check workflow (#31036)
CISC Oct 23, 2026
4231b23
ggml : fix time overflow in ggml_time_us (#30969)
frozenblade1224 Oct 23, 2026
e1e3b2c
ui : bump packages to clear npm audit (#31038)
allozaur Oct 23, 2026
36e36e6
hexagon: add CEIL op (#31006)
max-krasnyansky Oct 23, 2026
280141e
CUDA: chunk graphs to amortize graph launch (#30804)
am17an Oct 23, 2026
da2ee1e
vendor : update LibreSSL to 4.4.0 [no ci] (#31049)
angt Oct 23, 2026
5c31142
qwen4exp : build the QSA selection without the kq_mask (#30965)
sanmai Oct 23, 2026
06230cb
allows the usage of 4-10 gpus for stepfun and laguna in tensor paral…
krampenschiesser Oct 23, 2026
9ff0d7e
CUDA: fix build after chunked CUDA graphs (#30804) (#31053)
sreeram-11 Oct 23, 2026
1a24df1
ggm-cuda: Enforce DP4A MMQ tile height multiple of warp size (#30837)
thelittlefireman Oct 23, 2026
9145ddb
hip: fix bf16 WMMA operand vector type for gfx11/gfx12 (#30885)
waltercool Oct 23, 2026
21ec307
common : allow concurrent downloads across processes (#29312)
angt Oct 23, 2026
0ae0e19
hexagon: add SGN op (#30346)
kurquhar Oct 23, 2026
9ae73e6
mtmd : add Soprano TTS support (#28607)
hans00 Oct 23, 2026
edc3538
mtmd : lfm2 resize matches torchvision (#30943)
ykhrustalev Oct 24, 2026
7894e8b
mtmd: move build_inp_temporal_merge to base class (#31065)
ngxson Oct 24, 2026
1ddffe9
HIP: add byte permute fallback when __builtin_amdgcn_perm is unavaila…
aobolensk Oct 24, 2026
8e5a58d
vulkan: ggml src1 precision support (#30656)
0cc4m Oct 24, 2026
6b9ba4f
ci : fix data race between runners sharing the model cache (#31046)
ggerganov Oct 24, 2026
3642238
tests : add speculative rejection draft sampling test (#30213)
danbev Oct 24, 2026
701fd25
ggml : allow MUL_MAT_ID -1 index to skip the computation (#26631)
ngxson Oct 24, 2026
3032209
llama : deny -sm tensor for arches with moe amax rescaling (#31081)
ggerganov Oct 24, 2026
4d32b29
ci : exclude test-speculative-rejection-sampling from macos-latest-ar…
ggerganov Oct 24, 2026
df9beac
tests : fix test-llama-context for large n_batch (#31083)
sanmai Oct 24, 2026
73adf89
minimax-m3 : forward quant scales to the graph (fixes #31063) (#31097)
samgsx Oct 24, 2026
71255fe
ci : pass per-runner results dir to self-hosted jobs on T4 runners (#…
ggerganov Oct 24, 2026
ea1d7d6
fix(ui): align hover card and context popup styling with dropdown men…
allozaur Oct 24, 2026
e168e04
ui: Models Manager as Route + UI improvements (#30988)
allozaur Oct 24, 2026
9a0fde9
rpc : add bounds check in rdma_recv (#30399)
sohaibharraoui Oct 24, 2026
3f03b17
metal : remove mul_mm_id amax rescaling (#30924)
ggerganov Oct 24, 2026
f3269ef
server: refactor server entrypoint (#31113)
ngxson Oct 24, 2026
78a8ae1
hexagon: KV-head team split for multicore HMX flash attention (#31055)
ebateni Oct 24, 2026
d327bf1
jinja : fix select and selectattr argument handling (#31059)
JoeyPatricio Oct 24, 2026
74bca39
model: DSV4.1 flash (#31086)
am17an Oct 25, 2026
b3fa699
chat : reject JSON nested more than 128 levels before walking it (#30…
ykhrustalev Oct 25, 2026
344be0a
ci : update CPU job assignments (#31136)
ggerganov Oct 25, 2026
b083c38
opencl: add initial q2_k support (#30999)
lhez Oct 25, 2026
9a4580b
opencl: add topk and lightning indexer (#31026)
lhez Oct 25, 2026
f0fb598
hexagon: generic dims collapse/reshape for unary, binary and matmul o…
max-krasnyansky Oct 25, 2026
459a1ba
vulkan : one warp tile per subgroup in the small matmul tiles (#30106)
ianloic Oct 25, 2026
e321bda
vulkan: Add a larger tile size for conv3d (coopmat2 only) (#29920)
jeffbolznv Oct 25, 2026
a55c16e
ggml-cuda: fuse qwen MRoPE + set-rows (#31025)
am17an Oct 25, 2026
c49edf0
CUDA: fuse FFN gate/up matmuls and GLU in MMQ with interleaved gate/u…
anujj Oct 25, 2026
7790a92
tools : reject truncated GGUF tensor data in merge (#31044)
shreya-11733 Oct 25, 2026
fa3645f
llama : respect no_alloc in all memory caches (#31087)
ggerganov Oct 25, 2026
f1168ac
grammar: limit recursion depth to prevent stack overflow (#29495) (#2…
Hrushikesh-ramilla Oct 25, 2026
5c965fd
llama-quant : fix 4D tensor quantization using ggml_nrows() and name-…
anthony-wss Oct 25, 2026
63412d8
llama: fix exhausting CPU and MEM caused by dry sequence breaker (#31…
trunk-trick Oct 25, 2026
1a0b56c
ci : disable test-llama-context with fa off in the webgpu (#30977)
yomaytk Oct 25, 2026
2280f0f
qwen: merge tensors on convert (#31028)
am17an Oct 25, 2026
6050b46
tests : adjust default threads for test-llama-context (#31157)
ggerganov Oct 25, 2026
48c9f08
common, grammar: add recursive depth limit, make it a requirement (#3…
ngxson Oct 25, 2026
d854d98
cuda : use std::string instead of VLA for archName (#30463)
angt Oct 25, 2026
a074215
deepseekv4.1: follow-up review fixes (#31137)
am17an Oct 26, 2026
48c3611
ci : drop the `macos-latest-x64` job (#31175)
ggerganov Oct 26, 2026
224d94c
ci : bump server timeout during startup (#31174)
ggerganov Oct 26, 2026
69b3cc4
ui: Sidebar resizing improvements (#31119)
allozaur Oct 26, 2026
dc9e3be
ui: UX improvements (#31030)
allozaur Oct 26, 2026
9b8446b
metal : stop overflow from happening in large matrix output offsets (…
feni6 Oct 26, 2026
9125a2e
ci : fix race in webgpu memset (#31162)
eapache Oct 26, 2026
fd8f845
tests : refactor test-llama-archs to not link internal libllama symbo…
ggerganov Oct 26, 2026
8b28c23
ggml-cpu : fix unused variables in arm arch (#31180)
CISC Oct 26, 2026
c6fb3b5
mtmd: add mtmd_helper_get_capabilities (#31183)
ngxson Oct 26, 2026
74b104c
common: pin model resolution on real HF repo layouts (#30548)
ServeurpersoCom Oct 26, 2026
5320c87
sycl : bound reorder temp memory to 32 MiB (#31062)
KyleHagy Oct 26, 2026
02269b4
sycl: add set_tensor_2d for faster tensor-split loading (#30358)
Captain-Tripps Oct 26, 2026
38645c2
sycl: template the per-quant concat impls (#31008)
Titaniumtown Oct 26, 2026
5cd62ff
sycl: template the plain MMVQ launch triples (#31013)
Titaniumtown Oct 26, 2026
70c5f26
vulkan: rms norm optimization using subgroup reductions (#29882)
virajwad Oct 26, 2026
4d71b42
ggml-cpu : rewrite concat as one row kernel for all types (#31179)
ServeurpersoCom Oct 26, 2026
4b851fb
models : replace ggml_tensor** out-params with output structs (#31142)
ggerganov Oct 26, 2026
a469940
llama : move no_alloc out of llama_hparams (#31141)
ggerganov Oct 26, 2026
caa8191
hexagon: MUL_MAT_ID row skipping optimizations and improvements (#31169)
max-krasnyansky Oct 26, 2026
63b4b30
opencl: write KV-cache views in set_tensor so a state restore is not …
wanghqc Oct 26, 2026
4244ad7
ci : add windows behavior check (#31191)
CISC Oct 26, 2026
961c376
llama : enable moe amax rescaling for laguna (#31147)
begcdn Oct 26, 2026
7aca0d2
hexagon: add GGML_HEXAGON_VTCM_SIZE (#31221)
ebateni Oct 26, 2026
f5892ca
ui: use shared confirmation dialog for conversation deletion (#31187)
allozaur Oct 27, 2026
bc262f3
ui: Open model details in a drawer without leaving the page (#31176)
allozaur Oct 27, 2026
1a97e38
ui: add conversation compaction (#27401)
ServeurpersoCom Oct 27, 2026
823df7d
ui: Highlight reasoning toggle on hover and align it with model selec…
allozaur Oct 27, 2026
a2b3e12
opencl: initial support for q3_k (#31172)
lhez Oct 27, 2026
d930fe3
opencl: refine mul mat id -1 index (#31170)
lhez Oct 27, 2026
0d5ca60
ui: list org-less models first in the model selector (#31215)
allozaur Oct 27, 2026
7a2e5ab
llama : remove obsolete n_pad from memory instances (#31200)
ggerganov Oct 27, 2026
6666a73
tests : fix multi-seq split replay and partial-state cases for traine…
ggerganov Oct 27, 2026
de5122d
ggml : relax scale to non-contiguous views (#31146)
ggerganov Oct 27, 2026
a8276b7
ci : force python 3.12 on ubuntu 26.04 (#31222)
CISC Oct 27, 2026
fae9ac5
ci : use ccache depend mode for ROCm release builds (#31231)
sreeram-11 Oct 27, 2026
d78f40d
glm5-next : QSA without kq_mask (+ DSA) (#31009)
sanmai Oct 27, 2026
2763785
metal : add GGML_OP_TOP_K_MASK (#31230)
ggerganov Oct 27, 2026
7eed6b7
model: Add MiniCPM-OCR-Jev (#30980)
tc-mb Oct 27, 2026
74a1fd3
common : --model or -hf is required (#31242)
julien-c Oct 27, 2026
85cc432
server: add router device memory margin parameter for dynamic unloadi…
0cc4m Oct 27, 2026
3ab37ae
ui: fix system message row stretching to full prompt height in WebKit…
allozaur Oct 27, 2026
0c8c59e
mtmd-cli: Reduced scope of batch pointer (#31155) (#31165)
SamMalayek Oct 27, 2026
922f53e
vulkan: fix CI llvmpipe by allowing dim 3 broadcast in MUL_MAT (#31239)
ServeurpersoCom Oct 27, 2026
8542e94
tests : speed up tensor data generation and model saving (#31145)
ggerganov Oct 27, 2026
7ecb57f
rpc : catch std::length_error in recv_msg (#31204)
sohaibharraoui Oct 27, 2026
27b7a8a
llama : build the k-pool sparse selection independently of the kq_mas…
am17an Oct 27, 2026
e86f5fd
cmake: WASI doesn't support spawning (#30751)
MendyBerger Oct 27, 2026
19cce69
model : add LiquidAI/LFM3-1.7B and LiquidAI/LFM3-VL-2B (#31252)
tdakhran Oct 27, 2026
6c44591
snapdragon: switch QDC artifact upload and log download to v2 API (#3…
mengshengwu Oct 27, 2026
eb7818c
common : support deferred tools and tool_reference content parts (#31…
tdakhran Oct 27, 2026
19ff817
model : add LiquidAI/LFM3-Audio-2B and LiquidAI/LFM3-Omni-2B (#31257)
tdakhran Oct 27, 2026
338fce6
HIP/CUDA: remove pragma unroll from loops in conv2d where itteration …
IMbackK Oct 27, 2026
a919179
tests: fix CI riscv timeout in test-llama-context (#31265)
ServeurpersoCom Oct 27, 2026
1b4554e
server: expose the reasoning effort levels of the chat template (#31271)
ServeurpersoCom Oct 27, 2026
d05706b
model : add LiquidAI/d1-2B and LiquidAI/d1-omni-2B (#31275)
tdakhran Oct 27, 2026
8ca4060
server : add realtime conversation and transcription on /v1/realtime …
tdakhran Oct 28, 2026
6886628
ui : Search dialog (#31173)
allozaur Oct 28, 2026
b1756b2
ui: Fix draft for new message disappearing after using "Add System Me…
allozaur Oct 28, 2026
02d502f
ui: Support OGG audio attachments by converting them to WAV (#31237)
allozaur Oct 28, 2026
f4d8af6
ui : show save and reset settings buttons only when relevant (#31248)
allozaur Oct 28, 2026
a71c00f
chat : stop qwen3-coder reasoning and content before template separat…
7konigsberg Oct 28, 2026
2864937
vulkan: clamp A prefetch to end_k in coopmat1 int8 matmul (#30283)
SelfRef Oct 28, 2026
a7af149
cuda : add top-k MoE fusion for 384 experts (#31288)
developer0hye Oct 28, 2026
f1a7dea
tests : adjust constants to reduce irrelevant warnings (#31254)
ggerganov Oct 28, 2026
e486a4b
ui: build the reasoning menu from the template effort levels (#31273)
ServeurpersoCom Oct 28, 2026
ec941ee
ggml : bump version to v.28.0 (ggml/1676)
ggerganov Oct 28, 2026
5d7793d
sync : ggml
ggerganov Oct 28, 2026
d1eb0de
server : support tool calls in /v1/realtime (#31287)
tdakhran Oct 28, 2026
d4f1b18
mtmd: enable video input support for LFM3 model family (#31283)
tdakhran Oct 28, 2026
8642541
llama.cpp : bump version to 0.8.0 (#31309)
ggerganov Oct 28, 2026
28cb47c
gguf-py: fix np_roundf dropping the sign (#31310)
ngxson Oct 28, 2026
f5222f2
cuda: fuse MoE (MUL_MAT_ID) gate/up and GLU in MMQ (#31188)
anujj Oct 28, 2026
39febd2
sycl: work-group argmax for short TOP_K rows (#31110)
newjordan Oct 28, 2026
604cc43
codeowners : refresh teams and maintainer PRs link (#31316)
ggerganov Oct 28, 2026
838093f
llama : remove simple batch splitting for DSV4 (#31300)
developer0hye Oct 28, 2026
ff0d396
ci(s390x): switch to Ubuntu 26.04 runners (#31317)
taronaeo Oct 28, 2026
c02b5c6
ggml-cpu: SVE 256-bit Implementation of mxfp4 gemv kernel (#28141)
abhijain1204fujitsu Oct 28, 2026
ac8e169
ggml-cpu: SVE 256 bit implementation of gemm_q6_K_8x8_q8_K kernel (#2…
anubhavfujitsu Oct 28, 2026
c3df4b7
Speed up IQ4 quant creation with pre-computed halfway points (#31201)
bartowski1182 Oct 28, 2026
5220213
hexagon: add conv2d support (#30995)
tboinovski1 Oct 28, 2026
74a4fb0
opencl: add tiled q4_k GEMM for adreno (#30412)
wanghqc Oct 28, 2026
cf24317
common, mtmd: bound control vector layer indices and M-RoPE position …
ServeurpersoCom Oct 28, 2026
d0ff631
docs : fix DSpark confidence threshold flag name (--spec-draft-p-min)…
jajamabhijith Oct 29, 2026
369dcf3
ggml-cpu: add SVE implementation of ggml_gemv_q8_0_4x8_q8_0 (#30585)
nikhilfujitsu Oct 29, 2026
e09a78a
tests: fix CI flakes in server cancel and sleep tests (#31330)
ServeurpersoCom Oct 29, 2026
2e0d86b
Hexagon: IM2COL improvement - block based HVX parallelization (#31050)
rjtokenring Oct 29, 2026
7ac5727
ggml-openvino: slice view inputs of SCALE (#31334)
ravi9 Oct 29, 2026
6d5ac3c
tests : fix comp_padding CUDA graph reservation (#31344)
developer0hye Oct 29, 2026
bf48103
sycl : vectorize reordered-layout dequantization stores (Q4_0, K-quan…
anantshri Oct 29, 2026
f7c01c5
[SYCL] add DPAS flash attention kernel for quantized KV cache (#31125)
Torchit1 Oct 29, 2026
da6c30a
hexagon: improve DDR bw utilization in transposed CONCAT (#31277)
trivikram-reddy1 Oct 29, 2026
8a199ad
hexagon: support for UPSCALE op (#31331)
max-krasnyansky Oct 29, 2026
c9daee1
ggml-metal : fix unary kernels compile on older Metal toolchains (#31…
ggerganov Oct 29, 2026
fade717
tests : remove duplicate FA test cases added in #31125 (#31357)
Torchit1 Oct 29, 2026
6d19453
metal : faster MXFP4 mat-vec, full threadgroups for unary/binary/GLU …
am17an Oct 29, 2026
22183e5
opencl: initial support for iq2 (#31267)
lhez Oct 29, 2026
41be0bd
common: select A100 cores for SpaceMiT default threads (#30284)
inuEbisu Oct 29, 2026
abb76ab
model : Support Limite 1B - Violetto (#29433)
giuseppe Oct 29, 2026
78febba
HIP/CUDA: enable sparse attn on CDNA (#31259)
IMbackK Oct 29, 2026
3dd0f60
doc: update ops for opencl (#31347)
lhez Oct 29, 2026
b7cde58
ui: request persistent storage on startup (#31299)
allozaur Oct 29, 2026
f8fcef2
ui: add MCP group checkboxes in tools settings and fix indeterminate …
allozaur Oct 29, 2026
3ed915e
ui: reveal the collapsed sidebar from its logo and toggle it there (#…
allozaur Oct 29, 2026
f5d4d75
ui: show submit button when the chat input has content (#31324)
allozaur Oct 29, 2026
8ab29fa
ui: keep chats at the bottom until the reader scrolls up (#31311)
allozaur Oct 29, 2026
7df8b87
server : restore the spec checkpoint for drafts longer than n_rs_seq …
7konigsberg Oct 29, 2026
0ac1a7f
llama : reuse the tensor staging buffer and skip the direct-io bounce…
am17an Oct 29, 2026
78feec0
model: mistral le chonk (#31376)
ngxson Oct 29, 2026
0893ec9
skills: specify rule about ggml_build_forward_expand (#31375)
ngxson Oct 29, 2026
68d20b8
Quant: OCP FP8 E4M3 support (#27512)
ORippler Oct 29, 2026
eb4e244
ROCm/HIP: add RDNA4_M family for gfx1170/gfx1171 (#31373)
slojosic-amd Oct 29, 2026
418f905
ggml : add batched tensor copy API (#30881)
ggerganov Oct 29, 2026
36a0e2f
sycl: FLASH_ATTN_EXT failures (#30761)
mctylr-gh Oct 29, 2026
3c809f4
common : end reasoning budget forcing on an end tag from the prompt (…
tdakhran Oct 30, 2026
e0f142d
opencl: add initial q2_0 support (#31340)
shaofeiqi Oct 30, 2026
ab3768c
memory: refuse rollbacks past the snapshots of the last ubatch (#31368)
ServeurpersoCom Oct 30, 2026
fb59972
kv-cache : keep rotation constants on the GPU (#31073)
anton-iermolenko Oct 30, 2026
344846b
gemma3n, gemma4 : create token_embd before the tied output (#31394)
m4zar Oct 30, 2026
e216f4e
ci : extract most apple jobs into daily workflow (#31408)
danbev Oct 30, 2026
d63fbfe
cmake : embed an app manifest in all Windows exes (#31329)
angt Oct 30, 2026
27b8464
ci : add missing ccache-clear to windows behavior check (#31413)
CISC Oct 30, 2026
1ab23c3
vendor : update cpp-httplib to 0.64.0 (#31400)
cabelo Oct 30, 2026
889f2ec
quant : allow quantization for LFM3-Audio codec decoder (#31386)
tdakhran Oct 30, 2026
aa588a3
common : drop the Windows argv reconstruction (#31417)
angt Oct 30, 2026
a34de86
common : delete fs_path_to_utf8() (#31423)
angt Oct 30, 2026
792fcf4
opencl: add initial iq1 support (#31341)
shaofeiqi Oct 30, 2026
5047748
rpc : delete fs_path_to_utf8() (#31424)
angt Oct 30, 2026
8956c76
sycl: fix f32 to q2_0/q4_0/q5_0 rounding in CPY (#31120)
Torchit1 Oct 31, 2026
1052f7e
chat : strip the think block in the qwen3-coder with reasoning_format…
tdakhran Oct 31, 2026
0ec4027
opencl: add fwht (#31434)
shaofeiqi Oct 31, 2026
7bd1808
mtmd : resize Gemma 4 images without letterbox padding (#30922)
boshjerns Oct 31, 2026
2871678
server : fix /v1/responses endpoint to accept extra_params (#30959)
Dgarc359 Oct 31, 2026
f3586e6
server: cap shared decision prefixes at the first output (#30710)
aiqubits Oct 31, 2026
ddf48f8
reshaping so mm on 2d instead of 3d tensor for lfm sc (#30831)
anthonymaltsev Oct 31, 2026
0138937
llama : fix rotation of attention tensors in layers with shared KV (#…
nikwen Oct 31, 2026
f6312ad
vendor : update miniaudio to 0.11.26 (#31459)
cabelo Oct 31, 2026
bc428e4
llama : enable tensor split for LFM3 (#31431)
tdakhran Oct 31, 2026
79bce0c
tests : enable Gemma 4 in `test-llama-archs` (#31401)
nikwen Oct 31, 2026
d5ef408
mtmd : fix InternVL CLS token order (#30886)
boshjerns Oct 31, 2026
a91eab6
hexagon : fix DMA transfers with strides > 24 bits (#31442)
marktodorovich Oct 31, 2026
060b2fe
opencl: add initial iq3 support (#31338)
shaofeiqi Nov 1, 2026
dde879b
sycl: Try PkgConfig for LevelZero includes / libs (#31076)
mctylr-gh Nov 1, 2026
785322d
requirements : fix numpy dependencies (#31508)
CISC Nov 1, 2026
1c5ed70
webgpu : fix CI by keeping scratch alloc sizes monotonic in batch len…
ServeurpersoCom Nov 2, 2026
4e910a8
cmake : add explicit thread linkage (#31414)
o7si Nov 2, 2026
fcfe4b5
requirements : minor adjustments for python 3.14 wheels (#31534)
CISC Nov 2, 2026
f72dc30
docs: fix Huawei ascend brand (#31463)
licy666 Nov 2, 2026
a7a490a
ggml : fix clang-cl build with AVX512 BF16 (#31276)
YagUber Nov 2, 2026
5969566
jinja : implement map('filter') (#24033)
MuoDoo Nov 2, 2026
00ef136
tests : merge identical if branches (#31523)
nikwen Nov 2, 2026
aac6da8
docs : fix Vulkan example command in build.md (#31530)
Septa2112 Nov 2, 2026
b12b405
ui: don't reload a loading model on select, prefer it in pre-selectio…
allozaur Nov 2, 2026
64be95b
ui: show interrupted state for tool calls that never returned (#31314)
allozaur Nov 2, 2026
90080ce
ui: keep queued steering messages in their own conversation (#31304)
allozaur Nov 2, 2026
23426d7
ui: align alert dialog styling with other overlay surfaces (#31312)
allozaur Nov 2, 2026
5c2ea1a
ui: disable model deletion the server would refuse (#31305)
allozaur Nov 2, 2026
5e18eb0
sycl: dmmv code cleanup (#31325)
Titaniumtown Nov 2, 2026
2c93f0b
sycl : fast ggml_sycl_comm_exchange() on Intel Arc Pro B70s (#30956)
92es Nov 2, 2026
cb02250
vulkan: avoid redundant scans when zeroing skipped rows (#31266)
SG-Amadeus Nov 2, 2026
07ec7c8
vulkan: improve small-n split-K selection on RDNA3 and RDNA4 (#30146)
ravel7524 Nov 2, 2026
dcbb091
vulkan: add tensor-parallel allreduce function (#25051)
pwilkin Nov 2, 2026
84d9ce0
opencl: add topk_mask (#31441)
lhez Nov 2, 2026
ea24b95
ggml : use `vm_allocate` instead of `posix_memalign` on all Apple pla…
ykhrustalev Nov 2, 2026
6ed8120
ggml-zdnn: share buffers with host (#31481)
taronaeo Nov 2, 2026
458fcfc
docs: CANN backend supports BF16 on 910B, document GGML_CANN_NO_PINNE…
li-lizhe Nov 2, 2026
6b00d56
readme : fix links in README.md for maintainer PRs (#31487)
maternion Nov 2, 2026
cd8427d
context : simplify setters (#29730)
nikwen Nov 2, 2026
3f8af15
imatrix : fix --nextn crash (#31522)
sanmai Nov 2, 2026
1b6935b
llama : flash_attn_ext_rows - more efficient unified kv for multi-seq…
am17an Nov 2, 2026
e4b6c8c
model: add Clover support (#31306)
Maphist0 Nov 2, 2026
d02b4c0
mtmd: Pocket tts - support for voices without voice cloning (#31429)
rjtokenring Nov 2, 2026
29c720e
docs: update s390x build docs (#31546)
taronaeo Nov 2, 2026
dc8bede
Merge upstream/master into fork master
Nov 2, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
11 changes: 8 additions & 3 deletions .devops/intel.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,12 @@ RUN npm ci
COPY tools/ui/ ./
RUN LLAMA_BUILD_NUMBER="$APP_VERSION" npm run build

FROM docker.io/intel/oneapi-toolkit:$ONEAPI_VERSION AS build
FROM docker.io/intel/deep-learning-essentials:$ONEAPI_VERSION AS build

RUN echo "Download oneDNN installation package" && \
wget https://registrationcenter-download.intel.com/akdlm/IRC_NAS/94c3dbac-0852-45be-a57d-21c204cada3e/intel-onednn-2026.0.2.46_offline.sh -O intel-onednn_offline.sh && \
echo "Install oneDNN components" && \
bash intel-onednn_offline.sh -s -a --silent --eula accept

ARG GGML_SYCL_F16=ON
ARG LEVEL_ZERO_VERSION=1.28.2
Expand All @@ -45,7 +50,7 @@ RUN if [ "${GGML_SYCL_F16}" = "ON" ]; then \
fi && \
echo "Building with dynamic libs" && \
cmake -B build -DGGML_NATIVE=OFF -DGGML_SYCL=ON -DCMAKE_C_COMPILER=icx -DCMAKE_CXX_COMPILER=icpx -DGGML_BACKEND_DL=ON -DGGML_CPU_ALL_VARIANTS=ON -DLLAMA_BUILD_TESTS=OFF ${OPT_SYCL_F16} && \
cmake --build build --config Release -j$(nproc)
cmake --build build --config Release -j$((($(nproc)+1)/2))

RUN mkdir -p /app/lib && \
find build -name "*.so*" -exec cp -P {} /app/lib \;
Expand Down Expand Up @@ -102,7 +107,7 @@ RUN mkdir /tmp/neo/ && cd /tmp/neo/ \
&& dpkg --install *.deb

RUN apt-get update \
&& apt-get install -y libgomp1 curl ffmpeg \
&& apt-get install -y libgomp1 curl ffmpeg openssl libssl-dev \
&& apt autoremove -y \
&& apt clean -y \
&& rm -rf /tmp/* /var/tmp/* \
Expand Down
2 changes: 2 additions & 0 deletions .flake8
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,8 @@ exclude =
# Do not traverse examples and tools
examples,
tools,
# Do not traverse .venv directories
.venv*,
# Do not include package initializers
__init__.py,
# No need to traverse our git directory
Expand Down
172 changes: 172 additions & 0 deletions .github/workflows/behavior-check.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,172 @@
name: Behavior Check

on:
workflow_dispatch: # allows manual triggering
push:
branches:
- master
paths: [
'.github/workflows/behavior-check.yml',
'**/CMakeLists.txt',
'**/.cmake',
'**/*.h',
'**/*.hpp',
'**/*.c',
'**/*.cpp',
'**/*.py',
'**/requirements*.txt',
]

pull_request:
types: [opened, synchronize, reopened]
paths: [
'.github/workflows/behavior-check.yml',
'**/CMakeLists.txt',
'**/.cmake',
'**/*.h',
'**/*.hpp',
'**/*.c',
'**/*.cpp',
'**/*.py',
'**/requirements*.txt',
]

cache-mode: none
permissions:
contents: read

concurrency:
group: ${{ github.workflow }}-${{ github.head_ref && github.ref || github.run_id }}
cancel-in-progress: true

env:
GGML_NLOOP: 3
GGML_N_THREADS: 1
GGML_SCHED_DEBUG_REALLOC: 1
LLAMA_ARG_LOG_COLORS: 1
LLAMA_ARG_LOG_PREFIX: 1
LLAMA_ARG_LOG_TIMESTAMPS: 1

jobs:
ubuntu:
runs-on: ubuntu-26.04-arm

steps:
- name: Clone
id: checkout
uses: actions/checkout@v6

- name: ccache
uses: ggml-org/ccache-action@v1.2.24
with:
restore: false
save: false

- name: Build Dependencies
id: build_depends
run: |
sudo apt update
sudo apt install -y build-essential libssl-dev git-lfs libjpeg-dev python3 python3-venv python3-pip
- name: Python Dependencies
id: python_depends
run: |
python3 -m venv .venv
source .venv/bin/activate
pip install -r requirements/requirements-convert_hf_to_gguf.txt
- name: ccache-buckets-restore
uses: ./.github/actions/ccache-buckets
env:
HF_TOKEN: ${{ secrets.HF_TOKEN_CI }}
with:
key: behavior-check-ubuntu-26.04-arm
folder: llama.cpp
hf_bucket: ggml-org/cache

- name: Build
id: cmake_build
run: |
cmake -B build \
-DGGML_NATIVE=OFF \
-DGGML_BACKEND_DL=OFF \
-DLLAMA_FATAL_WARNINGS=ON
time cmake --build build --config Release -j $(nproc)
- name: ccache-buckets-save
if: ${{ github.event_name == 'push' && github.ref == 'refs/heads/master' }}
uses: ./.github/actions/ccache-buckets
env:
HF_TOKEN: ${{ secrets.HF_TOKEN_CACHE_OUTPUT }}
with:
key: behavior-check-ubuntu-26.04-arm
folder: llama.cpp
evict-old-files: 1d
hf_bucket: ggml-org/cache
save: true

- name: Test
id: cmake_test
run: |
source .venv/bin/activate
cd build
ctest -L behavior -LE 'model|backend' --verbose --timeout 900
windows:
runs-on: windows-2025

cache-mode: write
permissions:
actions: write
contents: read

steps:
- name: Clone
id: checkout
uses: actions/checkout@v6

- name: ccache
uses: ggml-org/ccache-action@v1.2.24
with:
key: behavior-check-windows-2025
evict-old-files: 1d
save: ${{ github.event_name == 'push' && github.ref == 'refs/heads/master' }}

- name: Python Dependencies
id: python_depends
shell: bash
run: |
python3 -m venv .venv
source .venv/Scripts/activate
pip install -r requirements/requirements-convert_hf_to_gguf.txt
- name: Build
id: cmake_build
shell: cmd
run: |
call "C:\Program Files\Microsoft Visual Studio\18\Enterprise\VC\Auxiliary\Build\vcvarsall.bat" x64
cmake -B build -G "Ninja Multi-Config" ^
-DCMAKE_TOOLCHAIN_FILE=cmake/x64-windows-llvm.cmake ^
-DCMAKE_BUILD_TYPE=Release ^
-DGGML_NATIVE=OFF ^
-DGGML_BACKEND_DL=OFF
set /A NINJA_JOBS=%NUMBER_OF_PROCESSORS%-1
cmake --build build --config Release -j %NINJA_JOBS%
- name: Test
id: cmake_test
shell: bash
run: |
source .venv/Scripts/activate
cd build
ctest -C Release -L behavior -LE 'model|backend' --verbose --timeout 900
- name: ccache-clear
uses: ./.github/actions/ccache-clear
env:
GH_TOKEN: ${{ github.token }}
with:
key: behavior-check-windows-2025
older: 5m
min: 1
dry-run: ${{ github.event_name != 'push' || github.ref != 'refs/heads/master' }}
10 changes: 5 additions & 5 deletions .github/workflows/build-and-test-snapdragon.yml
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ jobs:
android-ndk-snapdragon:
runs-on: ubuntu-24.04 # previously ubuntu-latest
container:
image: 'ghcr.io/snapdragon-toolchain/arm64-android:v0.7'
image: 'ghcr.io/snapdragon-toolchain/arm64-android:v0.8'
defaults:
run:
shell: bash
Expand Down Expand Up @@ -69,7 +69,7 @@ jobs:
linux-iot-snapdragon:
runs-on: ubuntu-24.04 # previously ubuntu-latest
container:
image: 'ghcr.io/snapdragon-toolchain/arm64-linux:v0.7'
image: 'ghcr.io/snapdragon-toolchain/arm64-linux:v0.8'
defaults:
run:
shell: bash
Expand Down Expand Up @@ -104,11 +104,11 @@ jobs:
name: Test on QDC Device (${{ matrix.device }})
needs: [android-ndk-snapdragon, linux-iot-snapdragon]
runs-on: ubuntu-24.04-arm
timeout-minutes: 90
timeout-minutes: 180
strategy:
fail-fast: false
matrix:
device: [SM8750, SM8850, QCS9075M]
device: [SM8850, QCS9075M]

permissions:
actions: read
Expand Down Expand Up @@ -155,7 +155,7 @@ jobs:
--pkg-dir pkg-snapdragon/llama.cpp \
--model-url "https://huggingface.co/bartowski/Llama-3.2-1B-Instruct-GGUF/resolve/main/Llama-3.2-1B-Instruct-Q4_0.gguf" \
--device ${{ matrix.device }} \
${{ startsWith(matrix.device, 'QCS') && '--retries 2 --retry-delay 300' || '' }}
${{ startsWith(matrix.device, 'QCS') && '--job-timeout 5400 --retries 2 --retry-delay 300' || '' }}
env:
QDC_API_KEY: ${{ secrets.QDC_API_KEY }}

Expand Down
Loading
Loading