feat: support ggml backend select and enhance the build system - #1368

Closed

Cyberhan123 wants to merge 61 commits into

leejet:masterfrom

Cyberhan123:ggml-new-backend

Commits on Mar 26, 2026

Select backend devices via arg

stduhpf
authored and
Cyberhan123
committed
b0545ab
fix build

stduhpf
authored and
Cyberhan123
committed
f89620c
show backend device description

stduhpf
authored and
Cyberhan123
committed
61af83e
CLI: add --list-devices arg

stduhpf
authored and
Cyberhan123
committed
c8ffbd3
null-terminate even if buffer is too small

stduhpf
authored and
Cyberhan123
committed
4e7bdb3
move stuff to ggml_extend.cpp

stduhpf
authored and
Cyberhan123
committed
53d32a9
--upscaler-backend-device

stduhpf
authored and
Cyberhan123
committed
1800c9a
use diffusion_backend for loading LoRAs

stduhpf
authored and
Cyberhan123
committed
c1fc286
--photomaker-backend-device (+fixes)

stduhpf
authored and
Cyberhan123
committed
9de5032
--vision-backend-device

stduhpf
authored and
Cyberhan123
committed
a85121f
check backends at runtime

Stéphane du Hamel
authored and
Cyberhan123
committed
4d0b24f
fix missing includes

Stéphane du Hamel
authored and
Cyberhan123
committed
ead7116
fix typo

Stéphane du Hamel
authored and
Cyberhan123
committed
4597013
multiple clip backend devices

Stéphane du Hamel
authored and
Cyberhan123
committed
10763be
update help message

stduhpf
authored and
Cyberhan123
committed
f3076ea
Add RPC documentation

stduhpf
authored and
Cyberhan123
committed
a97a978
update docs

stduhpf
authored and
Cyberhan123
committed
20e6ba4
update RPC docs

stduhpf
authored and
Cyberhan123
committed
970304e
fix apply_loras_immediately when using different non-CPU backends

stduhpf
authored and
Cyberhan123
committed
a792579
Force sequencial tensor loading when using RPC

stduhpf
authored and
Cyberhan123
committed
9e3229b
fix build

stduhpf
authored and
Cyberhan123
committed
61ed023
Get first stage backend for loading loras

stduhpf
authored and
Cyberhan123
committed
8fe2ccc
Fix lora loading when using multiple clip backends

stduhpf
authored and
Cyberhan123
committed
ae5b8ab
rm all head code for ggml
Cyberhan123
committed
229664d
feat: enhance the build system by adding CMake configuration and backend support, and eliminate hard-coded backend references.
Cyberhan123
committed
e302ee5
fix review
Cyberhan123
committed
83f7bab
format code
Cyberhan123
committed
1556395
up date ci job
Cyberhan123
committed
1428dc1
fix vision_backend null
Cyberhan123
committed
1cf3edc
rm -j args
Cyberhan123
committed
4e5471c
test ci
Cyberhan123
committed
7783b32
fix: remove trailing backslashes in CMake commands
Cyberhan123
committed
3d392a1

Commits on Mar 28, 2026

add cpu on
Cyberhan123
committed
2579bb1
add rpc and cpu on docker
Cyberhan123
committed
19bc8e2
try fix ci
Cyberhan123
committed
3e07a2b
add ggml-cpu.h
Cyberhan123
committed
54f2762
fix use cpu backend
Cyberhan123
committed
17db074
fix sycl docker build
Cyberhan123
committed
7b5d14f
Add a Windows ROCm job to use tarball distribution of TheRock

superm1
authored and
Cyberhan123
committed
755ee89
Update HIP target to use 26.Q1 (ROCm 7.1.1)

superm1
authored and
Cyberhan123
committed
dbea191
update rocm new build
Cyberhan123
committed
f246d83
sync and update rocm build
Cyberhan123
committed
29576a3
fix and add ccache
Cyberhan123
committed
ef54ba4
fix rocm build
Cyberhan123
committed
1e23dd4
fix rocm cache path
Cyberhan123
committed
5ff332b
add ninja_job
Cyberhan123
committed
9f4fc8d
rm -j params
Cyberhan123
committed
355dcda
fix cr
Cyberhan123
committed
ca6c96d
format code
Cyberhan123
committed
1a31a23
fix version backend
Cyberhan123
committed
e4d143b
format code
Cyberhan123
committed
8c8f2d0
fix hard_code with SD_USE_VULKAN
Cyberhan123
committed
0527541

Commits on Mar 30, 2026

Merge branch 'master' into ggml-new-backend
Cyberhan123
committed
64157ed
format code
Cyberhan123
committed
717ef5e

Commits on Mar 31, 2026

Merge branch 'master' into ggml-new-backend
Cyberhan123
authored
37891e9

Commits on Apr 2, 2026

Merge branch 'master' into ggml-new-backend
Cyberhan123
authored
c4ad357
fix backend has loaded
Cyberhan123
committed
55f8f3f

Commits on Apr 6, 2026

Commits on Apr 20, 2026