Skip to content

mtmd : add Soprano audio generation - #28607

Open
hans00 wants to merge 3 commits into
ggml-org:masterfrom
hans00:mtmd-soprano
Open

mtmd : add Soprano audio generation#28607
hans00 wants to merge 3 commits into
ggml-org:masterfrom
hans00:mtmd-soprano

Conversation

@hans00

@hans00 hans00 commented Sep 8, 2026

Copy link
Copy Markdown

Overview

Support https://huggingface.co/ekwek/Soprano-1.1-80M

Usage

# Convert Qwen3 backbone
python convert_hf_to_gguf.py /path/to/Soprano-1.1-80M \
    --outfile soprano.gguf \
    --outtype f16

# Convert Soprano decoder
python convert_hf_to_gguf.py /path/to/Soprano-1.1-80M \
    --mmproj \
    --mmproj-architecture SopranoModel \
    --outfile mmproj-soprano.gguf \
    --outtype f16

# Run TTS
llama-tts \
    -m soprano.gguf \
    -mm mmproj-soprano.gguf \
    -p "Hello world! This is a test of speech synthesis." \
    --temp 0 \
    -n 512 \
    -ngl 0 \
    --output out.wav

Requirements

@hans00
hans00 requested review from a team, CISC and ggerganov as code owners September 8, 2026 14:15
@github-actions github-actions Bot added documentation Improvements or additions to documentation mtmd Related to multimodal functionality (video/image/audio) conversion labels Sep 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

conversion documentation Improvements or additions to documentation mtmd Related to multimodal functionality (video/image/audio)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant