Skip to content

Audio: add independent payload lifecycle#2224

Draft
mohammadaaftabv wants to merge 1 commit into
NVIDIA-NeMo:mainfrom
mohammadaaftabv:aaftabv/audio-payload-lifecycle
Draft

Audio: add independent payload lifecycle#2224
mohammadaaftabv wants to merge 1 commit into
NVIDIA-NeMo:mainfrom
mohammadaaftabv:aaftabv/audio-payload-lifecycle

Conversation

@mohammadaaftabv

Copy link
Copy Markdown
Contributor

Summary

  • add generic admission-controlled PayloadRef storage, bounded prefetch, release, and dropped-task cleanup
  • materialize audio once with segment-aware FFmpeg I/O and let FastConformer consume waveform payloads
  • preserve structural batch envelopes through a payload-neutral items / with_items contract
  • wrap consumers that do not directly implement payload resolution, keeping this feature independent of global bucketing

Independence

This PR is based on main and does not contain Qwen-Omni, performance instrumentation, BatchPolicy, dispatch batches, or global planning. It can merge before or after the global-bucketing PR.

Test plan

  • Ruff check and format validation
  • Payload lifecycle, ref, prefetch, dropped-task, and audio-reader tests
  • FastConformer waveform-consumption proof
  • Structural-envelope materialize → consume → release proof
  • Merge-order composition validation with the independent global-bucketing branch

Provide admission-controlled single-decode transport and a structural consumer wrapper so FastConformer can use payload references without depending on global scheduling.

Signed-off-by: aaftaabv@gmail.com <aaftaabv@gmail.com>
@copy-pr-bot

copy-pr-bot Bot commented Jul 17, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant