Skip to content

Characterize static evaluation semantics - #163

Merged
uriahf merged 4 commits into
mainfrom
semantics/stage-1a-characterization
Aug 21, 2026
Merged

Characterize static evaluation semantics#163
uriahf merged 4 commits into
mainfrom
semantics/stage-1a-characterization

Conversation

@uriahf

@uriahf uriahf commented Aug 21, 2026

Copy link
Copy Markdown
Owner

Goal

Implement Stage 1A of the cross-language semantic audit as characterization tests only.

Coverage

Adds focused tests for:

  • one model × one population
  • multiple models × the same population
  • the same model/prediction rule across populations with different prevalence
  • distinct populations with equal prevalence
  • explicitly paired model-population inputs
  • calibration grouping and the global identity line
  • performance-table input semantics
  • ROC, precision-recall, gains, lift, decision, and interventions-avoided plotted grouping/reference ownership
  • current color behavior for the single-model case

The tests use the Stage 0 vocabulary while deliberately recording the current R representation: model-labelled shared-outcome inputs use model, paired/multi-population inputs use population, and reference ownership changes by output.

Scope

Test-only. No statistical calculations, public APIs, production behavior, plotting code, package metadata, generated documentation, or rtichoke_viz are changed.

Any surprising current behavior is characterized rather than fixed in this PR.

Paired PR

Python: uriahf/rtichoke_python#365

github-actions Bot added a commit that referenced this pull request Aug 21, 2026
github-actions Bot added a commit that referenced this pull request Aug 21, 2026
@uriahf
uriahf marked this pull request as ready for review August 21, 2026 10:20
github-actions Bot added a commit that referenced this pull request Aug 21, 2026
@uriahf
uriahf merged commit f8ea883 into main Aug 21, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant