Skip to content

[Crazy RoboTaxi] Add HDmap view, optionally show prompt in HUD - #616

Open
aidanfnv wants to merge 4 commits into
dev/aidanf/game/crazy-robotaxi/leaderboardsfrom
dev/aidanf/game/crazy-robotaxi/debug-views
Open

aidanfnv wants to merge 4 commits into
dev/aidanf/game/crazy-robotaxi/leaderboardsfrom
dev/aidanf/game/crazy-robotaxi/debug-views

Conversation

@aidanfnv

@aidanfnv aidanfnv commented Sep 11, 2026

Copy link
Copy Markdown
Collaborator

Closes #553

Split off from #553, this change adds a key to show the HDmap like the pre-API-port demo had. It also adds an option to have the HUD show the current prompt being used.

@aidanfnv
aidanfnv added this pull request to stack #610 September 11, 2026 00:53
@copy-pr-bot

copy-pr-bot Bot commented Sep 11, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@greptile-apps

greptile-apps Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

RetriggerConfidence Score: 5/5

The PR appears safe to merge; no outstanding correctness, security, or repository-rule issue was identified.

Summary

The PR adds an optional frame-aligned current-prompt HUD panel and an input-controlled view of the model’s HD-map conditioning.

  • Propagates the prompt-display setting through application, session, and UI configuration.
  • Publishes generated video and HD-map tensors as separate presentation outputs.
  • Adds keyboard and gamepad bindings for toggling the HD-map view during gameplay.
  • Caps and truncates the prompt panel while shifting affected HUD elements below it.
  • Adds coverage for configuration, controls, prompt composition, output alignment, rendering, and HUD layout.

Diagram

%%{init: {'theme': 'neutral'}}%%
flowchart LR
    Engine[Model engine step] --> Video[Generated video]
    Engine --> HDMap[HD-map conditioning]
    Engine --> Prompt[Active prompt]
    Video --> Presentation[Presentation manager]
    HDMap --> Presentation
    Prompt --> HUD[Frame-aligned HUD frame]
    Input[Toggle HD-map control] --> UI[ImGui UI loop]
    Presentation --> UI
    HUD --> UI
    UI --> Choice{HD-map enabled?}
    Choice -->|No| VideoOut[Display generated video]
    Choice -->|Yes| HDMapOut[Display HD-map conditioning]
Loading

Reviews (9) · Last reviewed commit: "[crazy-robotaxi] Offset live-edit HUD be..."

Comment thread apps/crazy_robotaxi/crazy_robotaxi/ui.py Outdated
@aidanfnv
aidanfnv force-pushed the dev/aidanf/game/crazy-robotaxi/debug-views branch from dac9f20 to 7590297 Compare September 11, 2026 02:30
@aidanfnv
aidanfnv force-pushed the dev/aidanf/game/crazy-robotaxi/debug-views branch from 439c172 to 42bf297 Compare September 11, 2026 23:45
Comment thread apps/crazy_robotaxi/crazy_robotaxi/ui.py Outdated
@aidanfnv

Copy link
Copy Markdown
Collaborator Author

/ok to test c3206c6

@aidanfnv
aidanfnv force-pushed the dev/aidanf/game/crazy-robotaxi/debug-views branch from c3206c6 to f4d605c Compare September 12, 2026 00:26
@aidanfnv
aidanfnv force-pushed the dev/aidanf/game/crazy-robotaxi/debug-views branch 2 times, most recently from a55bba2 to ef7a4d7 Compare September 14, 2026 16:40
@aidanfnv

Copy link
Copy Markdown
Collaborator Author

/ok to test ef7a4d7

Signed-off-by: Aidan Foster <aidanf@nvidia.com>
Signed-off-by: Aidan Foster <aidanf@nvidia.com>
Signed-off-by: Aidan Foster <aidanf@nvidia.com>
Signed-off-by: Aidan Foster <aidanf@nvidia.com>
@aidanfnv
aidanfnv force-pushed the dev/aidanf/game/crazy-robotaxi/debug-views branch from ef7a4d7 to f5fbfd5 Compare September 14, 2026 22:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant