Skip to content

[None][docs] drop ghost --backend tensorrt from trtllm-eval docs #18950

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
imitater-dou wants to merge 1 commit into
base: main
Choose a base branch
from
+2 −4
Open

[None][docs] drop ghost --backend tensorrt from trtllm-eval docs #18950

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 1 addition & 3 deletions docs/source/commands/trtllm-eval.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -85,9 +85,7 @@ Here are some examples:
trtllm-eval --model <model> --max_seq_len 36864 aime25
trtllm-eval --model <model> --max_seq_len 36864 aime26

The ``--model`` argument accepts either a Hugging Face model ID or a local checkpoint path. By default, ``trtllm-eval`` runs the model with the PyTorch backend; you can pass ``--backend tensorrt`` to switch to the TensorRT backend.

Alternatively, the ``--model`` argument also accepts a local path to pre-built TensorRT engines. In this case, you should pass the Hugging Face tokenizer path to the ``--tokenizer`` argument.
The ``--model`` argument accepts either a Hugging Face model ID or a local checkpoint path. ``trtllm-eval`` runs with the PyTorch backend (``--backend`` accepts only ``pytorch``); the TensorRT engine backend and pre-built engine paths were removed.

For more details, see ``trtllm-eval --help`` and ``trtllm-eval <task> --help``.

Expand Down
2 changes: 1 addition & 1 deletion examples/trtllm-eval/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ trtllm-eval --model meta-llama/Llama-3.1-8B-Instruct gsm8k
trtllm-eval --model meta-llama/Llama-3.3-70B-Instruct gpqa_diamond
```

The `--model` argument accepts either a Hugging Face model ID or a local checkpoint path. By default, `trtllm-eval` runs the model with the PyTorch backend; pass `--backend tensorrt` to switch to the TensorRT backend. Alternatively, the `--model` argument also accepts a local path to pre-built TensorRT engines; in that case, please pass the Hugging Face tokenizer path to the `--tokenizer` argument.
The `--model` argument accepts either a Hugging Face model ID or a local checkpoint path. `trtllm-eval` runs with the PyTorch backend (`--backend` accepts only `pytorch`); the TensorRT engine backend and pre-built engine paths were removed.

See more details by `trtllm-eval --help`.

Expand Down