Skip to content

#9 Add paired A/B suite comparison - #27

Merged
iray-tno merged 1 commit into
mainfrom
feature/9_paired_ab_suite_compare
Jun 14, 2026
Merged

#9 Add paired A/B suite comparison#27
iray-tno merged 1 commit into
mainfrom
feature/9_paired_ab_suite_compare

Conversation

@iray-tno

Copy link
Copy Markdown
Owner

Summary

  • add prepkit test suite compare A B cases for paired numeric comparisons
  • support --runs, --workers, --score-mode, preprocessing, and Rust/C++ compilation paths
  • report per-pair diff, A/B/tie sign consistency, mean diff, and diff stdev

Tests

  • uv run pytest tests/test_test_command.py -q
  • uv run pytest -q

@iray-tno
iray-tno merged commit fe985d4 into main Jun 14, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant