Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions ARCHITECTURE.md
Original file line number Diff line number Diff line change
Expand Up @@ -61,6 +61,7 @@ boundaries above remain the target modular MSA architecture.
| `tepp_simulation` | known-truth temporal/event data generation |
| `validation_core` | RMSE, bias, coverage, graph, and Monte Carlo metrics |
| `tepp_api` | versioned DTO, schema, and export contracts |
| `style_source` | house-voice style residue is not unique latent content and not stopword deletion |
| `stopword_deletion` | default stopword deletion is not a valid method for repeated report language |
| `copy_identity` | a template copy is not the source document and not a state transition |
| `intake_authorization` | untrusted intake fails closed without a grant; bounds are not authorization |
Expand Down
1 change: 1 addition & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,7 @@ All notable changes to TEPP are documented here. The format follows Keep a Chang

### Added

- `style_source` identity gate: house-voice style residue is not unique latent content and is not erased by a stopword list; recovered style kinds match known truth at a higher computed rate than collapsing every token to unique content (ADR 0004/0012).
- `stopword_deletion` method gate: a default or global stopword list cannot erase repeated report language; recovered deletion kinds match known truth at a higher computed rate than collapsing every token treatment to stopword deletion (ADR 0004/0012).
- `persistence_postgres` retention/deletion/legal-hold (migration `0007`): policy rows, legal holds that block completed deletion, evidence tombstones without raw-source restore, analysis exclusion only for `logical_revocation`/`identity_tombstone` (not `cache_export_removal`), and deletion requests bound to the cited retention policy's tenant/class/purpose.
- `copy_identity` identity gate: a template or pasted copy cannot reuse the source document identity or become a state transition; recovered copy kinds match known truth at a higher computed rate than collapsing every copy to the source (ADR 0003).
Expand Down
4 changes: 4 additions & 0 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 2 additions & 0 deletions Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ members = [
"crates/tepp_simulation",
"crates/validation_core",
"crates/tepp_api",
"crates/style_source",
"crates/stopword_deletion",
"crates/copy_identity",
"crates/provider_receipt",
Expand Down Expand Up @@ -55,6 +56,7 @@ default-members = [
"crates/tepp_simulation",
"crates/validation_core",
"crates/tepp_api",
"crates/style_source",
"crates/stopword_deletion",
"crates/copy_identity",
"crates/provider_receipt",
Expand Down
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -43,6 +43,7 @@ crates/corpus_split
crates/tepp_simulation
crates/validation_core
crates/tepp_api
crates/style_source
crates/stopword_deletion
crates/copy_identity
crates/provider_receipt
Expand Down
17 changes: 17 additions & 0 deletions crates/style_source/Cargo.toml
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
[package]
name = "style_source"
description = "House-voice style residue is not unique content and not stopword deletion."
version.workspace = true
edition.workspace = true
rust-version.workspace = true
license.workspace = true
authors.workspace = true
repository.workspace = true
homepage.workspace = true
readme.workspace = true
keywords.workspace = true
categories.workspace = true
publish = false

[lints]
workspace = true
57 changes: 57 additions & 0 deletions crates/style_source/src/error.rs
Original file line number Diff line number Diff line change
@@ -0,0 +1,57 @@
//! Fail-closed style-source errors.

use std::fmt;

/// A fail-closed style-source error.
#[derive(Clone, Copy, Debug, Eq, PartialEq)]
#[non_exhaustive]
pub enum StyleSourceError {
/// Style residue was treated as unique latent content.
StyleIsNotUniqueContent,
/// Style residue was treated as stopword deletion.
StyleIsNotStopwordDeletion,
/// A recovery slice was empty or length-mismatched.
InvalidStylePayload,
}

impl fmt::Display for StyleSourceError {
fn fmt(&self, formatter: &mut fmt::Formatter<'_>) -> fmt::Result {
let message = match self {
Self::StyleIsNotUniqueContent => {
"house-voice style residue is not unique latent content"
}
Self::StyleIsNotStopwordDeletion => {
"house-voice style residue is not stopword deletion"
}
Self::InvalidStylePayload => "invalid style-source payload",
};
formatter.write_str(message)
}
}

impl std::error::Error for StyleSourceError {}

#[cfg(test)]
mod tests {
use super::StyleSourceError;

#[test]
fn error_messages_are_stable() {
for (error, message) in [
(
StyleSourceError::StyleIsNotUniqueContent,
"house-voice style residue is not unique latent content",
),
(
StyleSourceError::StyleIsNotStopwordDeletion,
"house-voice style residue is not stopword deletion",
),
(
StyleSourceError::InvalidStylePayload,
"invalid style-source payload",
),
] {
assert_eq!(error.to_string(), message);
}
}
}
129 changes: 129 additions & 0 deletions crates/style_source/src/kind.rs
Original file line number Diff line number Diff line change
@@ -0,0 +1,129 @@
//! Style residue versus unique latent content.

use crate::StyleSourceError;

/// Closed vocabulary of style-related token treatments.
#[derive(Clone, Copy, Debug, Eq, PartialEq)]
pub enum StyleKind {
/// House-voice or style residue, not unique document meaning.
StyleResidue,
/// Token treatment reserved for unique latent content.
UniqueContent,
}

impl StyleKind {
/// Return the stable wire kind name.
#[must_use]
pub const fn wire_name(self) -> &'static str {
match self {
Self::StyleResidue => "style",
Self::UniqueContent => "unique_content",
}
}

/// Parse a stable wire kind name.
///
/// # Errors
///
/// Returns [`StyleSourceError::InvalidStylePayload`] for unrecognized names.
pub fn from_wire_name(name: &str) -> Result<Self, StyleSourceError> {
match name {
"style" => Ok(Self::StyleResidue),
"unique_content" => Ok(Self::UniqueContent),
_ => Err(StyleSourceError::InvalidStylePayload),
}
}
}

/// Refuse to treat style residue as unique latent content.
///
/// # Errors
///
/// Returns [`StyleSourceError::StyleIsNotUniqueContent`] when `kind` is
/// [`StyleKind::StyleResidue`].
pub fn refuse_style_as_unique_content(kind: StyleKind) -> Result<(), StyleSourceError> {
match kind {
StyleKind::StyleResidue => Err(StyleSourceError::StyleIsNotUniqueContent),
StyleKind::UniqueContent => Ok(()),
}
}

/// Refuse to treat style residue as stopword deletion.
///
/// # Errors
///
/// Returns [`StyleSourceError::StyleIsNotStopwordDeletion`] when `kind` is
/// [`StyleKind::StyleResidue`].
pub fn refuse_style_as_stopword_deletion(kind: StyleKind) -> Result<(), StyleSourceError> {
match kind {
StyleKind::StyleResidue => Err(StyleSourceError::StyleIsNotStopwordDeletion),
StyleKind::UniqueContent => Ok(()),
}
}

/// Fraction of recovered style kinds that match known truth.
///
/// # Errors
///
/// Returns [`StyleSourceError::InvalidStylePayload`] when either slice is
/// empty or the lengths differ.
pub fn identity_recovery_rate(
truth: &[StyleKind],
decided: &[StyleKind],
) -> Result<f64, StyleSourceError> {
if truth.is_empty() || truth.len() != decided.len() {
return Err(StyleSourceError::InvalidStylePayload);
}
let mut matches = 0_u32;
for (truth_kind, decided_kind) in truth.iter().zip(decided) {
if truth_kind == decided_kind {
matches += 1;
}
}
Ok(f64::from(matches) / truth.len() as f64)
}
Comment on lines +70 to +84

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

📝 Info: Recovery rate fail-closed logic is correct for empty/mismatched slices

identity_recovery_rate in kind.rs guards with truth.is_empty() || truth.len() != decided.len(). This covers all invalid-payload cases: empty truth, empty decided (length mismatch), and unequal lengths. The zip then only iterates matching pairs, and the divisor uses truth.len(), so the rate is a valid fraction in [0,1]. No off-by-one or division-by-zero risk exists.

Open in Devin Review

Was this helpful? React with 👍 or 👎 to provide feedback.


#[cfg(test)]
mod tests {
use super::{
StyleKind, identity_recovery_rate, refuse_style_as_stopword_deletion,
refuse_style_as_unique_content,
};
use crate::StyleSourceError;

#[test]
fn local_branches_cover_kinds_payloads_and_wire_names() {
assert_eq!(
refuse_style_as_unique_content(StyleKind::StyleResidue),
Err(StyleSourceError::StyleIsNotUniqueContent)
);
assert_eq!(
refuse_style_as_stopword_deletion(StyleKind::StyleResidue),
Err(StyleSourceError::StyleIsNotStopwordDeletion)
);
refuse_style_as_unique_content(StyleKind::UniqueContent).expect("unique");
refuse_style_as_stopword_deletion(StyleKind::UniqueContent).expect("unique");
for kind in [StyleKind::StyleResidue, StyleKind::UniqueContent] {
assert_eq!(
StyleKind::from_wire_name(kind.wire_name()).expect("round-trip"),
kind
);
}
assert_eq!(
StyleKind::from_wire_name("stopword"),
Err(StyleSourceError::InvalidStylePayload)
);
let matched =
identity_recovery_rate(&[StyleKind::StyleResidue], &[StyleKind::StyleResidue])
.expect("rate");
assert!((matched - 1.0).abs() < f64::EPSILON);
assert_eq!(
identity_recovery_rate(&[], &[]),
Err(StyleSourceError::InvalidStylePayload)
);
assert_eq!(
identity_recovery_rate(&[StyleKind::StyleResidue], &[]),
Err(StyleSourceError::InvalidStylePayload)
);
}
}
22 changes: 22 additions & 0 deletions crates/style_source/src/lib.rs
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
#![forbid(unsafe_code)]
#![deny(missing_docs)]
#![allow(clippy::cast_precision_loss)]
//! House-voice style residue is not unique latent content.
//!
//! Style and house-voice stay explicit method/background structure. They
//! are not unique document meaning and are not erased by a stopword list
//! (ADR 0004/0012).

mod error;
mod kind;

/// Fail-closed style-source errors.
pub use error::StyleSourceError;
/// Closed vocabulary of style-related token treatments.
pub use kind::StyleKind;
/// Fraction of recovered style kinds that match known truth.
pub use kind::identity_recovery_rate;
/// Refuse to treat style residue as stopword deletion.
pub use kind::refuse_style_as_stopword_deletion;
/// Refuse to treat style residue as unique latent content.
pub use kind::refuse_style_as_unique_content;
7 changes: 7 additions & 0 deletions crates/style_source/tests/crate_contract.rs
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
//! Integration contract for the `style_source` package identity.

#[test]
fn package_identity_is_stable() {
let observed = std::hint::black_box(env!("CARGO_PKG_NAME"));
assert_eq!(observed, "style_source");
}
67 changes: 67 additions & 0 deletions crates/style_source/tests/style_source_contract.rs
Original file line number Diff line number Diff line change
@@ -0,0 +1,67 @@
//! House-voice style residue is not unique content and not stopword deletion.

use style_source::{
StyleKind, StyleSourceError, identity_recovery_rate, refuse_style_as_stopword_deletion,
refuse_style_as_unique_content,
};

#[test]
fn style_residue_cannot_become_unique_content_or_stopword_deletion() {
assert_eq!(
refuse_style_as_unique_content(StyleKind::StyleResidue),
Err(StyleSourceError::StyleIsNotUniqueContent)
);
assert_eq!(
refuse_style_as_stopword_deletion(StyleKind::StyleResidue),
Err(StyleSourceError::StyleIsNotStopwordDeletion)
);
refuse_style_as_unique_content(StyleKind::UniqueContent).expect("unique");
refuse_style_as_stopword_deletion(StyleKind::UniqueContent).expect("unique");
}

#[test]
fn recovered_kinds_match_known_truth_better_than_a_unique_content_collapse() {
let truth = [
StyleKind::StyleResidue,
StyleKind::UniqueContent,
StyleKind::StyleResidue,
];
let recovered = truth;
let collapsed = [
StyleKind::UniqueContent,
StyleKind::UniqueContent,
StyleKind::UniqueContent,
];
let recovered_rate = identity_recovery_rate(&truth, &recovered).expect("recovered");
let collapsed_rate = identity_recovery_rate(&truth, &collapsed).expect("collapsed");
let expected = {
let mut matches = 0_u32;
for (truth_kind, decided_kind) in truth.iter().zip(recovered.iter()) {
if truth_kind == decided_kind {
matches += 1;
}
}
f64::from(matches) / f64::from(u32::try_from(truth.len()).expect("len"))
};
assert!((recovered_rate - expected).abs() < f64::EPSILON);
assert!(recovered_rate > collapsed_rate);
}

#[test]
fn empty_or_mismatched_kind_payloads_fail_closed() {
assert_eq!(
identity_recovery_rate(&[], &[]),
Err(StyleSourceError::InvalidStylePayload)
);
assert_eq!(
identity_recovery_rate(&[StyleKind::StyleResidue], &[]),
Err(StyleSourceError::InvalidStylePayload)
);
assert_eq!(
identity_recovery_rate(
&[StyleKind::StyleResidue, StyleKind::UniqueContent],
&[StyleKind::StyleResidue]
),
Err(StyleSourceError::InvalidStylePayload)
);
}
4 changes: 2 additions & 2 deletions docs/TRACEABILITY.md
Original file line number Diff line number Diff line change
Expand Up @@ -24,8 +24,8 @@ The full APA 7th standards/literature register remains `docs/research/standards-
| multilingual shared latent semantic space | PRD; ADR 0004 | future semantic/concept/topic crates | accepted-target |
| TRSL-TM temporal/relational topic posterior and backend compatibility | ADR 0012; ADR 0004 | future `topic_measurement` | accepted-target |
| global P0 topic identity with activity/dormancy/reactivation | ADR 0012 | future topic lineage/activity state | accepted-target |
| no default stopword deletion / no TF-IDF-BM25 inferential weighting | ADR 0004/0012; PRD/TRD | `stopword_deletion` default-list refusal on the active PR; TF-IDF/BM25 inferential-weight refusal remains accepted-target | partial |
| report template/section/copied/style/modality method effects | ADR 0004/0012; PRD/TRD | simulation truth factors implemented; estimator-side method model remains future | partial |
| no default stopword deletion / no TF-IDF-BM25 inferential weighting | ADR 0004/0012; PRD/TRD | future semantic/method-source model | accepted-target |

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Traceability matrix marks a built capability as future work

The no default stopword deletion row is rewritten to future semantic/method-source model | accepted-target, dropping the reference to the stopword_deletion crate and downgrading it from partial. That crate exists on this branch and is still listed as implemented in CHANGELOG.md, ARCHITECTURE.md, and temporal-event-foundation.md, so the matrix now contradicts them.

Prompt for agents
The row for "no default stopword deletion / no TF-IDF-BM25 inferential weighting" in docs/TRACEABILITY.md was changed to "future semantic/method-source model | accepted-target", which removes the reference to the existing stopword_deletion crate and downgrades its maturity. The stopword_deletion crate is still present and documented as active-PR/accepted-target in CHANGELOG.md, ARCHITECTURE.md, and docs/validation/temporal-event-foundation.md. Restore the stopword_deletion crate reference and its correct maturity in this traceability row (e.g. keep the existing \`stopword_deletion\` default-list refusal wording) while adding any new style_source content elsewhere as intended.
Open in Devin Review

Was this helpful? React with 👍 or 👎 to provide feedback.

| report template/section/copied/style/modality method effects | ADR 0004/0012; PRD/TRD | simulation truth factors implemented; `style_source` style-versus-unique-content identity on the active PR; estimator-side method model remains future | partial |
| candidate K statistical/Pareto gates + blinded LLM review | ADR 0012; research | future `model_selection` | accepted-target |
| compositional topic correlation / stable clustering | ADR 0005/0012; research | future `network_analysis` | accepted-target |
| posterior ESEM / longitudinal invariance / DSEM | ADR 0005 | `psychometric_fit` ESEM loading and DSEM lag gates on the active PR; `psychometric_core` input gates remain #49; invariance/multilevel remain accepted-target | active-PR |
Expand Down
1 change: 1 addition & 0 deletions docs/adr/0004-shared-multilingual-latent-space.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
# ADR 0004 — Shared multilingual latent semantic space

**Decision status:** Accepted
**Implementation maturity:** accepted-target — style-versus-unique-content identity in `style_source` on the active PR; shared-space estimators remain accepted-target
**Implementation maturity:** partial — default stopword-deletion refusal is `stopword_deletion` on the active PR; shared-space estimators, language profiles, and TF-IDF/BM25 inferential-weight refusal remain accepted-target
Comment on lines +4 to 5

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

📝 Info: Stacked conflicting maturity headers in ADR 0004

ADR 0004 now carries two **Implementation maturity:** lines with conflicting values (accepted-target vs partial). This follows the existing stacked-line convention in ADR 0012, so it looks deliberate, but no single line states the authoritative maturity.

Open in Devin Review

Was this helpful? React with 👍 or 👎 to provide feedback.

**Date:** 2026-08-05
**Supersedes:** None. ADR 0012 governs the complete topic-estimator/backend/global-topic contract built on this multilingual measurement decision.
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
# ADR 0012 — Temporal Relational Shared-Latent Topic Measurement

**Decision status:** Accepted
**Implementation maturity:** accepted-target — style-versus-unique-content identity in `style_source` on the active PR; estimator-side method model remains accepted-target
**Implementation maturity:** partial — default stopword-deletion refusal is `stopword_deletion` on the active PR; topic estimator, global topic identity, method-effect model, and TF-IDF/BM25 inferential-weight refusal remain accepted-target
**Implementation maturity:** active-PR — `topic_lineage` keeps one P0 identity across active/dormant/reactivated states; remaining TRSL-TM estimator, method effects, and backend interchange remain accepted-target
**Implementation maturity:** active-PR — `network_analysis` refuses raw-simplex Euclidean geometry and scores cluster pair precision/recall; remaining TRSL-TM estimator, global topic identity, method effects, and backend interchange remain accepted-target
Expand Down
Loading
Loading