Skip to content

chore(main): release 1.22.0 - #687

Open
release-please[bot] wants to merge 1 commit into
mainfrom
release-please--branches--main--components--evalbench
Open

release-please[bot] wants to merge 1 commit into
mainfrom
release-please--branches--main--components--evalbench

Conversation

@release-please

@release-please release-please Bot commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

🤖 I have created a release beep boop

1.22.0 (2026-11-20)

Features

  • agent: reset the sandbox home and work_dir between trials (#709) (4234154)
  • agent: run num_trials trials of each scenario (#700) (921c7a9)
  • container: case runner, backend interface and cancellation for per-case containers (5b76345)
  • container: case spec, config schema and pool router for per-case containers (9229969)
  • container: case spec, config schema and pool router for per-case containers (67bb209)
  • container: Kubernetes Job backend for per-case containers (#695) (63f0cc1)
  • dataset_quality: tell judges about success_criteria (#685) (1523a53)

Bug Fixes

  • agent: mark agent infrastructure and simulated-user errors as unscored (#702) (f320ab7)
  • agent: report the correct summary when num_trials is above 1 (#712) (18683e0)
  • auth: use Workload Identity instead of the GKE SA key (#703) (1ff849f)
  • dataset_quality: don't count withheld data as Incomplete Result (926c9cf)
  • dataset_quality: don't count withheld data as Incomplete Result (1c40016)
  • datasets: split two records joined on one line in bat-interact (de30f82)
  • datasets: split two records joined on one line in bat-interact (ae1c85c)
  • datasets: verify the TLS certificate in the bird-interact download (#723) (1769517)
  • gemini_cli: resume follow-up turns by session ID (#699) (f7f909d)
  • generators: keep gcloud credentials off the shared session volume (#724) (90a2926)
  • gke: add health probes and make the deploy single-pod safe (0ce5185)
  • reporting: skip symlinks and special files in the GCS artifact zip (#721) (77d30b8)
  • scorers: raise on malformed goal_completion judge replies (#701) (b6023ba)
  • server: bind the loopback interface for --localhost (#722) (5684958)
  • sessionmgr: remove a symlinked session entry instead of walking it (#708) (21f7a5c)
  • tools: apply the fetch_url checks to redirect targets (#728) (6ca77dc)
  • viewer: accept only trusted model configs and run directories (#720) (0a2a06e)
  • viewer: bound the prompt size of the AI comparison (#725) (4167338)

This PR was generated with Release Please. See documentation.

@release-please
release-please Bot requested a review from IsmailMehdi as a code owner October 27, 2026 15:16
@release-please
release-please Bot force-pushed the release-please--branches--main--components--evalbench branch 2 times, most recently from 7c608ca to 4f2ab34 Compare October 30, 2026 06:39
@release-please release-please Bot changed the title chore(main): release 1.21.1 chore(main): release 1.22.0 Oct 30, 2026
@release-please
release-please Bot force-pushed the release-please--branches--main--components--evalbench branch 2 times, most recently from 90b00ab to 3ae1800 Compare November 2, 2026 06:58
@prernakakkar-google

Copy link
Copy Markdown
Collaborator

/gcbrun

@release-please
release-please Bot force-pushed the release-please--branches--main--components--evalbench branch 6 times, most recently from c48527a to 7e1a27a Compare November 11, 2026 10:06
@release-please
release-please Bot force-pushed the release-please--branches--main--components--evalbench branch 9 times, most recently from 802ae55 to 0fac105 Compare November 20, 2026 07:04
@release-please
release-please Bot force-pushed the release-please--branches--main--components--evalbench branch 2 times, most recently from 474852b to 3fa8592 Compare November 20, 2026 17:38
@release-please
release-please Bot force-pushed the release-please--branches--main--components--evalbench branch 4 times, most recently from 2d6f2b7 to 4607498 Compare November 20, 2026 18:15
@release-please
release-please Bot force-pushed the release-please--branches--main--components--evalbench branch from 4607498 to 1400199 Compare November 20, 2026 18:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant