Skip to content

Send reasoning_effort "none" for Kimi K3 thinking Off on Posit AI Pass - #192

Merged
wch merged 1 commit into
posit-dev:mainfrom
PavleProd:kimi-k3-thinking-off
Nov 18, 2026
Merged

wch merged 1 commit into
posit-dev:mainfrom
PavleProd:kimi-k3-thinking-off

Conversation

@PavleProd

Copy link
Copy Markdown
Contributor

Fixes #191.

Kimi K3 offers "off" in its capability entry, but positAiThinkingRequestFields only sends reasoning_effort: "none" for DeepSeek V4.1 Flash and Kimi K3.1 Pro. For Kimi K3 the request went out with no reasoning field, so Baseten's default effort applied and the model reasoned anyway. This adds Kimi K3 to the same exception, in the form of #176, plus a repro test next to the DeepSeek one.

Checks run on main at f456292:

  • The new test fails without the change (expected undefined to deeply equal { reasoning_effort: 'none' }) and passes with it.
  • ai-provider-bridge: vitest, 91 files, 1,112 tests passed; tsc --noEmit; oxlint.
  • oxfmt --check on the whole repo, and the shape guard (typechecks/tsconfig.json).

The measurements (cost and latency on Posit AI Pass with and without "none") and a capability-flag alternative for future models are in #191. The flag touches the chat params the host passes, so it is not in this PR.

🤖 Generated with Claude Code

Kimi K3 offers "off" in its capability entry, but positAiThinkingRequestFields
only maps "off" to reasoning_effort "none" for DeepSeek V4.1 Flash and
Kimi K3.1 Pro. For Kimi K3 the request carried no reasoning field, so
Baseten's default effort applied and the model reasoned anyway.

Fixes posit-dev#191

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@wch
wch merged commit afe8fe3 into posit-dev:main Nov 18, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Kimi K3 thinking "Off" sends no reasoning field on Posit AI Pass

2 participants