Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
113 commits
Select commit Hold shift + click to select a range
b1122cf
spec(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): scope Flash Vis…
mudler Aug 31, 2026
95c18fa
merge: origin/main into the DeepSeek V4 Vision spec branch
mudler Aug 31, 2026
7905059
feat(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): port W1 prompt …
mudler Aug 31, 2026
7e8afb5
spec(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): require CUDA, R…
mudler Aug 31, 2026
8c10cad
feat(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): port W2 vision …
mudler Sep 5, 2026
7fb23f5
spec(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): pin the artifac…
mudler Sep 5, 2026
e238ef9
merge: origin/main into the DeepSeek V4 Vision row branch
mudler Sep 5, 2026
ebca4db
feat(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): account for and…
mudler Sep 5, 2026
ebfd35b
record(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): close the lan…
mudler Sep 5, 2026
303e691
feat(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): read the deepse…
mudler Sep 5, 2026
d9b1f58
merge: W3A into the DeepSeek V4 Vision row branch
mudler Sep 5, 2026
b9c0732
merge: W3B into the DeepSeek V4 Vision row branch
mudler Sep 5, 2026
1eb76b8
merge: origin/main into the DeepSeek V4 Vision row branch
mudler Sep 5, 2026
30026a1
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): name the row th…
mudler Sep 5, 2026
435942c
record(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): give the W2 t…
mudler Sep 5, 2026
aaa1d04
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): assert the routi…
mudler Sep 5, 2026
750cc66
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): refuse the fused…
mudler Sep 5, 2026
a4a17c1
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): make rope_theta…
mudler Sep 5, 2026
c9b90fb
docs(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): record the W3A …
mudler Sep 5, 2026
34f175f
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): assert the visi…
mudler Sep 5, 2026
608f403
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): stop the vision …
mudler Sep 5, 2026
5044eba
docs(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): stop the test h…
mudler Sep 5, 2026
a498b48
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): drive every vis…
mudler Sep 5, 2026
023aa10
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): refuse a bad rou…
mudler Sep 5, 2026
e21dd05
docs(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): record why the …
mudler Sep 5, 2026
d825a51
record(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): record the W2…
mudler Sep 5, 2026
a38da26
merge: the W3B review repairs into the DeepSeek V4 Vision row branch
mudler Sep 5, 2026
c5a9648
record(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): date the W3B …
mudler Sep 5, 2026
d7b458c
merge: the W3A review repairs into the DeepSeek V4 Vision row branch
mudler Sep 5, 2026
c211c50
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): drive the visio…
mudler Sep 5, 2026
ee2d7e8
merge: the W2 review repairs into the DeepSeek V4 Vision row branch
mudler Sep 6, 2026
7050e35
record(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): give the shar…
mudler Sep 6, 2026
78ecaf0
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): derive sup|GELU'…
mudler Sep 6, 2026
18e6aad
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): price the visio…
mudler Sep 6, 2026
8f44e7b
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): drive the five …
mudler Sep 6, 2026
6377127
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): correct why Vec1…
mudler Sep 6, 2026
8d6d0e0
record(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): state what th…
mudler Sep 6, 2026
70fc1c5
record(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): the deepseek4…
mudler Sep 6, 2026
68cad88
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): bound the PRODUC…
mudler Sep 6, 2026
06852de
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): record the one …
mudler Sep 6, 2026
2ffa024
record(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): owe the four …
mudler Sep 6, 2026
96ef8ba
record(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): put the suite…
mudler Sep 6, 2026
d95b63b
merge: origin/main into the DeepSeek V4 Vision row branch
mudler Sep 6, 2026
e94bb18
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): share the two W…
mudler Sep 6, 2026
5fbcd6e
feat(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): make an image r…
mudler Sep 6, 2026
2011f90
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): gate the project…
mudler Sep 6, 2026
fdc4800
feat(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): select the visi…
mudler Sep 6, 2026
252893a
feat(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): let an image sp…
mudler Sep 6, 2026
e55cf35
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): refuse an image …
mudler Sep 6, 2026
221833a
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): give every image…
mudler Sep 6, 2026
b3abeda
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): refuse an INTERI…
mudler Sep 6, 2026
13ff492
feat(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): let a user send…
mudler Sep 6, 2026
aea11a2
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): gate what the s…
mudler Sep 6, 2026
53d7220
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): drive two image…
mudler Sep 6, 2026
540796e
feat(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): put the multimo…
mudler Sep 6, 2026
f4995d4
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): stop gating on a…
mudler Sep 6, 2026
0558f3f
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): gate the projec…
mudler Sep 6, 2026
0cc5d0f
record(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): write down wh…
mudler Sep 6, 2026
1686a3f
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): drive the paged…
mudler Sep 6, 2026
511945e
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): make the aligner…
mudler Sep 6, 2026
bfbea89
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): refuse the chunk…
mudler Sep 6, 2026
24a9b88
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): the device atten…
mudler Sep 6, 2026
74215b6
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): say what the mul…
mudler Sep 6, 2026
bfc69e1
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): see the hash-la…
mudler Sep 6, 2026
98b399f
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): make the two ima…
mudler Sep 6, 2026
2f67bea
docs(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): cite the pinned…
mudler Sep 6, 2026
6a52160
docs(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): re-measure the …
mudler Sep 6, 2026
3ef7fc8
docs(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): the spec's Now …
mudler Sep 6, 2026
4b10ef2
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): hold the two li…
mudler Sep 6, 2026
2cba570
record(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): add the three…
mudler Sep 6, 2026
d01d48c
merge: W5 into the DeepSeek V4 Vision row branch
mudler Sep 6, 2026
46b680a
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): delete the refus…
mudler Sep 6, 2026
4993c72
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): stop reading a b…
mudler Sep 6, 2026
18929cb
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): add the W6 real…
mudler Sep 11, 2026
51ceb16
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): measure the ora…
mudler Sep 11, 2026
3ce9b6d
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): add an f32 arm …
mudler Sep 11, 2026
40a9475
docs(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): record W6, the …
mudler Sep 11, 2026
ef6388e
merge: origin/main into the DeepSeek V4 Vision row branch
mudler Sep 11, 2026
e434c5a
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): admit the W2 vi…
mudler Sep 11, 2026
8c742ad
feat(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): load the offici…
mudler Sep 11, 2026
03f86c8
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): pin the vision …
mudler Sep 11, 2026
4f73047
feat(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): let the W6 visi…
mudler Sep 11, 2026
bcf9dd6
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): stage the vision…
mudler Sep 12, 2026
8c085d2
docs(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): record W7-CUDA,…
mudler Sep 12, 2026
f0b9f82
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): repair the W7-CU…
mudler Sep 12, 2026
8c999b6
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): correct five sta…
mudler Sep 12, 2026
eb6009f
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): gate the EXL3 ar…
mudler Sep 12, 2026
6e55cc1
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): make the vision …
mudler Sep 12, 2026
5c2cf83
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): declare every ju…
mudler Sep 12, 2026
8010f76
fix(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): declare stage me…
mudler Sep 12, 2026
3f995eb
merge: origin/main into the DeepSeek-V4-Flash-Vision row
mudler Sep 12, 2026
5f86f9d
merge: origin/main into the DeepSeek-V4-Flash-Vision row, second inte…
mudler Sep 12, 2026
75b93b4
fix(MODEL-MM-deepseek-v4): name the tensor, layer and geometry the ho…
mudler Sep 12, 2026
2ca44e4
docs(MODEL-MM-deepseek-v4): correct the records the named refusal fal…
mudler Sep 12, 2026
0645fc2
test(MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm): mutate the visi…
mudler Sep 12, 2026
81b050a
fix(MODEL-MM-deepseek-v4): bind the keep-quant tower in the device fo…
mudler Sep 12, 2026
dc11e6f
docs(MODEL-MM-deepseek-v4): record the measured geometry and the root…
mudler Sep 12, 2026
c9129fb
fix(MODEL-MM-deepseek-v4): derive the scheduler block sizes from the …
mudler Sep 12, 2026
5ffc29b
fix(MODEL-MM-deepseek-v4): make the served-image expectation device-a…
mudler Sep 12, 2026
5a36da5
docs(MODEL-MM-deepseek-v4): close the CPU-only-premise issue, green o…
mudler Sep 13, 2026
4f1e92d
docs(MODEL-MM-deepseek-v4): record the measured outcome, and retire a…
mudler Sep 13, 2026
eadd089
merge: helper/dsv4v-manifest-checker-tests into the DeepSeek-V4-Flash…
mudler Sep 13, 2026
3229430
merge: row/MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm-matvec-name…
mudler Sep 13, 2026
7a70a50
merge: task/dsv4mm-kv-hash-block into the DeepSeek-V4-Flash-Vision row
mudler Sep 13, 2026
872b277
merge: origin/main into the DeepSeek-V4-Flash-Vision row, third integ…
mudler Sep 13, 2026
8091f0b
record(MODEL-MM-deepseek-v4): the multi-group coordinator abort is a …
mudler Sep 13, 2026
04fe5f4
spec(MODEL-MM-deepseek-v4): scope the per-row bias selector for the d…
mudler Sep 13, 2026
6d70f9c
merge: the KV hash-granularity record correction into the DeepSeek-V4…
mudler Sep 13, 2026
978930b
merge: origin/main into the DeepSeek-V4-Flash-Vision row, fourth inte…
mudler Sep 13, 2026
0ed086b
feat(MODEL-MM-deepseek-v4): give the device MoE router a per-row bias…
mudler Sep 13, 2026
4733d73
merge: the per-row vision bias selector into the DeepSeek-V4-Flash-Vi…
mudler Sep 13, 2026
d3e746d
merge: origin/main into the DeepSeek-V4-Flash-Vision row, fifth integ…
mudler Sep 13, 2026
2934035
merge: origin/main into the DeepSeek-V4-Flash-Vision row, sixth integ…
mudler Sep 13, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions .agents/claims/CLAIM-DEEPSEEK-V4-VISION-W1.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
# CLAIM-DEEPSEEK-V4-VISION-W1

| Claim | Row IDs | Agent | Worktree / remote dir | Branch | Owned scope | State | Last update |
|---|---|---|---|---|---|---|---|
| `CLAIM-DEEPSEEK-V4-VISION-W1` | `MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm` (`ACTIVE`) | OpenAI Codex (gpt-5.6-sol), helper role, fresh retry implementer for issue [#2411](https://github.com/mudler/vllm.cpp/issues/2411) | `/home/mudler/_git/vllm.cpp/.claude/worktrees/deepseek-v4-vision-w1` | `row/MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm-W1` | Owns only W1 and these files: `include/vllm/multimodal/deepseek_v4_processor.h`; `src/vllm/multimodal/deepseek_v4_processor.cpp`; `tests/vllm/multimodal/test_deepseek_v4_encoding.cpp`; `tests/vllm/multimodal/test_deepseek_v4_image_processor.cpp`; `CMakeLists.txt`; `tests/CMakeLists.txt`; `.agents/model-matrix.md`; `.agents/specs/deepseek-v4-flash-vision.md`; and this claim. Excludes ViT, aligner, weights and loader, model forward, image-span visibility, public ABI, server, GPU work, large downloads, push, and merge. | `ACTIVE` | 2026-08-31 — W1 prompt encoding and RGB image preprocessing passed retry verification. Next: fresh scoped review, then the operator reruns the W1 gate before integration; W2 owns the ViT and aligner. |
5 changes: 5 additions & 0 deletions .agents/claims/CLAIM-DEEPSEEK-V4-VISION-W2.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
# CLAIM-DEEPSEEK-V4-VISION-W2

| Claim | Row IDs | Agent | Worktree / remote dir | Branch | Owned scope | State | Last update |
|---|---|---|---|---|---|---|---|
| `CLAIM-DEEPSEEK-V4-VISION-W2` | `MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm` (`ACTIVE`) | OpenAI Codex (gpt-5.6-sol), helper role, fresh implementer for issue [#2411](https://github.com/mudler/vllm.cpp/issues/2411) | `/home/mudler/_git/vllm.cpp/.claude/worktrees/deepseek-v4-vision-w2` | `row/MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm-W2` | Owns only W2 and these files: `include/vllm/model_executor/models/deepseek_v4_vision.h`; `src/vllm/model_executor/models/deepseek_v4_vision.cpp`; `tests/vllm/models/test_deepseek_v4_vision.cpp`; `scripts/gen-deepseek-v4-vision-goldens.py`; `tests/parity/goldens/deepseek_v4_vision/`; `CMakeLists.txt`; `tests/CMakeLists.txt`; `.agents/specs/deepseek-v4-flash-vision.md` W2 evidence, Owed and Now; and this claim. Excludes DeepSeek-V4 text config, weights and loader, registered forward, image-span visibility, public ABI, server, device-specific kernels, GPU work, large downloads, push and merge. | `ACTIVE` | 2026-09-01 — W2 starts RED-first from the committed specification. The standalone ViT and aligner remain unreachable from production; W4 owns registered-forward reachability. |
5 changes: 5 additions & 0 deletions .agents/claims/CLAIM-DEEPSEEK-V4-VISION-W3A.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
# CLAIM-DEEPSEEK-V4-VISION-W3A

| Claim | Row IDs | Agent | Worktree / remote dir | Branch | Owned scope | State | Last update |
|---|---|---|---|---|---|---|---|
| `CLAIM-DEEPSEEK-V4-VISION-W3A` | `MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm` (`ACTIVE`) | Anthropic Claude (claude-opus-5-1m), helper role, fresh implementer for issue [#2411](https://github.com/mudler/vllm.cpp/issues/2411) | `/home/mudler/_git/vllm.cpp/.wt/dsv4v-w3a` | `row/MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm-W3A` | Owns only W3A and these files: `include/vllm/model_executor/models/clip_mmproj_gguf.h`; `src/vllm/model_executor/models/clip_mmproj_gguf.cpp`; `tests/vllm/models/test_deepseek_v4_mmproj.cpp`; `tests/CMakeLists.txt`; `.agents/specs/deepseek-v4-flash-vision.md` W3A evidence and Owed; and this claim. Excludes the language-model GGUF arm and `deepseek_v4_weights.cpp` (W3B owns them), the Qwen3-VL projector path's behaviour, registered forward, image-span visibility, public ABI, server, device-specific kernels, GPU work, large downloads, push and merge. | `ACTIVE` | 2026-09-05 — W3A starts RED-first from the committed specification. The `deepseek4v` mmproj reader is unreachable from production; W4 owns registered-forward reachability and the spec lists the gap under `## Owed`. |
5 changes: 5 additions & 0 deletions .agents/claims/CLAIM-DEEPSEEK-V4-VISION-W3B.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
# CLAIM-DEEPSEEK-V4-VISION-W3B

| Claim | Row IDs | Agent | Worktree / remote dir | Branch | Owned scope | State | Last update |
|---|---|---|---|---|---|---|---|
| `CLAIM-DEEPSEEK-V4-VISION-W3B` | `MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm` (`ACTIVE`) | Anthropic Claude (claude-opus-5-1m), helper role, fresh implementer for issue [#2411](https://github.com/mudler/vllm.cpp/issues/2411) | `/home/mudler/_git/vllm.cpp/.wt/dsv4v-w3b` | `row/MODEL-MM-deepseek-v4-deepseek-v4-for-causal-lm-W3B` | Owns only W3B, the `exp_probs_b_vl` routing bias's ACCOUNTING and LOADING, and these files: `include/vllm/model_executor/models/deepseek_v4.h` (the two layer-weight fields); `src/vllm/model_executor/models/deepseek_v4_weights.cpp`; `tests/vllm/models/test_deepseek_v4_mm_loader.cpp`; `tests/CMakeLists.txt`; `.agents/specs/deepseek-v4-flash-vision.md` W3B evidence and Owed; and this claim. Excludes per-token bias selection and the hash-layer replacement in `deepseek_v4_moe.cpp`, the non-causal image-span window, `clip_mmproj_gguf.{h,cpp}` and `deepseek_v4_vision.{h,cpp}` (W3A owns those), the registered forward, the public ABI, the server, device kernels, GPU work, large downloads, push and merge. | `ACTIVE` | 2026-09-05 — W3B starts RED-first from the committed specification. The loaded vision bias is a staged slice: nothing selects it, W4 owns the wiring, and the spec's `## Owed` lists it. |
Loading
Loading