Repository navigation

feat(typelayer)!: validate, coerce and filter through chtypes - #712

Draft

EricAndrechek wants to merge 140 commits into

mainfrom

Commits on Oct 1, 2026

build(chtypes): build, package and release against the chtypes SDK

EricAndrechek
and
claude
committed
d177545
docs: describe the chtypes type layer on the multi-tenant text

EricAndrechek
and
claude
committed
e58d17f
Merge docs for the chtypes migration into chtypes-v2
EricAndrechek
committed
b4779b2
feat(policy): resolved row-filter predicates and a typed WHERE renderer

EricAndrechek
and
claude
committed
e071158
feat(discovery): refresh hooks before loaded, and the server zone

EricAndrechek
and
claude
committed
6e1fce2
feat(typelayer): tenant-keyed chtypes engine with lazy handle pools

EricAndrechek
and
claude
committed
3f27439
Merge the Go foundation for the chtypes migration into chtypes-v2
EricAndrechek
committed
443b19a
feat(api)!: serve /v1/query and pipes through ClickHouse's HTTP interface

EricAndrechek
and
claude
committed
4995331
Merge branch 'chtypes-v2' into v2-w3
EricAndrechek
committed
e000751
feat(typelayer): parse a row under the INSERT column list it was published with

EricAndrechek
and
claude
committed
6dd65fb
feat(query): bind integer policy claims through the strict cast

EricAndrechek
and
claude
committed
35a008e
feat(config,ingest): chtypes registry key and typelayer insert settings

EricAndrechek
and
claude
committed
2aa6f7d
Merge the HTTP read path for the chtypes migration into chtypes-v2
EricAndrechek
committed
e87c9ce
Merge branch 'chtypes-v2' into v2-w5
EricAndrechek
committed
b02bdd2
feat(stream): judge row-level security with the type layer, per tenant

EricAndrechek
and
claude
committed
852d5f8
Merge the chtypes-backed stream filter into chtypes-v2
EricAndrechek
committed
91e86dc
feat(ingest)!: judge every body with ClickHouse's own parser

EricAndrechek
and
claude
committed
0537e89
Merge branch 'chtypes-v2' into v2-w5
EricAndrechek
committed
3ba7c6e
Merge branch 'chtypes-v2' into v2-w2
EricAndrechek
committed
6fec76e
test(e2e)!: pin ClickHouse's own ingest verdicts and exception_code

EricAndrechek
and
claude
committed
1ceb21d
Merge the chtypes-judged ingest path into chtypes-v2
EricAndrechek
committed
0499111
Merge branch 'chtypes-v2' into v2-w5
EricAndrechek
committed
8dcb496
feat(app): open the type layer in API processes and bind it per tenant

EricAndrechek
and
claude
committed
a776b2c
build(chtypes): move to SDK go/v0.5.1 and the ClickHouse 26.8 line

EricAndrechek
and
claude
committed
df6f93d
fix(typelayer): set each library's zone through the SDK default

EricAndrechek
and
claude
committed
3694f5e
fix(typelayer): compile with ClickHouse's type gates

EricAndrechek
and
claude
committed
cd1ddd7
Merge branch 'chtypes-v2' into v2-w1c
EricAndrechek
committed
e1e3404
test(integration): chtypes on the app harness, with policies and tokens

EricAndrechek
and
claude
committed
92c6c6e
Merge SDK go/v0.5.1 and the ClickHouse 26.8 line into chtypes-v2
EricAndrechek
committed
9f78c0b
Merge branch 'chtypes-v2' into v2-w5
EricAndrechek
committed
2f230f8
test(ingest): feed DateTime64 the way ClickHouse 26.8 reads a number

EricAndrechek
and
claude
committed
eb5ba5b
Merge app wiring, config and the integration suite into chtypes-v2
EricAndrechek
committed
be20317
refactor: delete the Go-side canonicalizer, row evaluator and compact encoder

EricAndrechek
and
claude
committed
99a4529
Merge the old-API sweep into chtypes-v2
EricAndrechek
committed
eb36644
docs: reconcile docs with the chtypes type layer as landed

EricAndrechek
and
claude
committed
6a72536
Merge the docs reconcile pass into chtypes-v2
EricAndrechek
committed
4c9786d
fix(query): parse timestamp filters in ClickHouse, send in lists as tables

EricAndrechek
and
claude
committed
c6b0128
docs(query): timestamp filters parse in ClickHouse; in lists are uncapped

EricAndrechek
and
claude
committed
3858fb7
Merge branch 'chtypes-v2' into v2-w3b
EricAndrechek
committed
9a044a0
docs(api): give the timestamp-filter rule its own paragraph

EricAndrechek
and
claude
committed
39d3528
Merge ClickHouse-parsed timestamp filters and external-data in-lists into chtypes-v2
EricAndrechek
committed
f32dd7a
docs(access-control): timestamp claims take the zone-less form

EricAndrechek
and
claude
committed
943a828
test(integration): fit the suite back under its timeout

EricAndrechek
and
claude
committed
9513fdb
Merge branch 'chtypes-v2' into v2-integ
EricAndrechek
committed
e2e057e
test(integration): run internal/api's live filter test in the target

EricAndrechek
and
claude
committed
6915489
build(chtypes): move to SDK go/v0.5.2

EricAndrechek
and
claude
committed
67e2b5d
fix(discovery): publish refreshes in the order they started

EricAndrechek
and
claude
committed
d0ba5de
test(integration): clear gosec's G703 on the settings cleanup

EricAndrechek
and
claude
committed
2dd4de7
docs: fix review-round findings across the chtypes docs

EricAndrechek
and
claude
committed
d02cb78
test(typelayer): move the test engine helpers into typelayertest

EricAndrechek
and
claude
committed
5aa1b81
fix(api): cap query-path connections per pool, not per server

EricAndrechek
and
claude
committed
db21526
perf(typelayer): grow a role shape's handle pool under contention

EricAndrechek
and
claude
committed
3c6d674
chore(api): note that the 64 MiB response cap covers every query path

EricAndrechek
and
claude
committed
60862a8
fix(api): render DateTime as RFC 3339 UTC on every read and stream surface

EricAndrechek
and
claude
committed
8464208
fix(sdk): compare timestamps as instants in stream filters and liveQuery

EricAndrechek
and
claude
committed
a888661
Merge per-tenant read cap and RFC 3339 UTC rendering
EricAndrechek
committed
3662865
Merge round-1 docs review fixes
EricAndrechek
committed
b708c1f
fix(ingest): role shapes keep denied columns, stamp _eq columns, take EPHEMERAL input

EricAndrechek
and
claude
committed
4aa01e3
fix(ingest): refuse content after a JSON array body

EricAndrechek
and
claude
committed
b6035d3
test(integration): stored rows for denied, stamped and ephemeral columns

EricAndrechek
and
claude
committed
3c8542a
Merge round-1 code review fixes (insert column policy, EPHEMERAL, role pools, typelayertest)
EricAndrechek
committed
c88603a
test(typelayer): use the in-package engine helper

EricAndrechek
and
claude
committed
330fd09
docs: match the role-shape, EPHEMERAL, timestamp and read-cap fixes

EricAndrechek
and
claude
committed
3674b79
docs: fix round-2 review findings (RFC 3339 examples, wire columns, retryable 500, fetch step)

EricAndrechek
and
claude
committed
9dde7ed
docs: tighten EPHEMERAL, timestamp rendering and check-literal claims

EricAndrechek
and
claude
committed
6221019
chore: label and coverage-exclude the typelayer package

EricAndrechek
and
claude
committed
dc9ee8f
chore: correct comments the type-layer migration left stale

EricAndrechek
and
claude
committed
eab6e3d
docs: fix round-3 findings (Nullable nulls, dedupe example, stale mechanisms)

EricAndrechek
and
claude
committed
9da80ec
fix(ingest): blank layout newlines after a JSON array's closing bracket

EricAndrechek
and
claude
committed
0343354
chore: correct comments contradicted by measurement on 26.8

EricAndrechek
and
claude
committed
56ba58f
docs: correct ingest codes, timestamp claims and stale mechanisms

EricAndrechek
and
claude
committed
4d35acf
ci: the fetch script takes no --frozen flag; it always fetches frozen

EricAndrechek
and
claude
committed
4950a59
docs: make dev OTel endpoint, operator-key scope, ClickHouse statuses

EricAndrechek
and
claude
committed
289d55a
perf(typelayer): compile role shapes outside the role cache lock

EricAndrechek
and
claude
committed
e7215e8
perf(typelayer): give every handle the whole filter cache budget

EricAndrechek
and
claude
committed
f367511
chore: reflow comments left over-long by the last round

EricAndrechek
and
claude
committed
6cb72bd
docs: name roweval.go in the stream package and who sets the e2e OTLP endpoint

EricAndrechek
and
claude
committed
e8ad99a
docs: show ClickHouse's escaped slashes in raw stream and pipe output

EricAndrechek
and
claude
committed
f09d96f
fix(api): leave / unescaped wherever ClickHouse renders JSON

EricAndrechek
and
claude
committed
417d7b0
test(stream): pin that an unreadable row is declined, not an error

EricAndrechek
and
claude
committed
e219066
docs: who labels each withheld row, and what the type layer holds in memory

EricAndrechek
and
claude
committed
7ad1be8
docs: the envelope re-encodes the writer's row without changing any value

EricAndrechek
and
claude
committed
871c86c
docs: finish the exact-bytes correction; say what the error reason means

EricAndrechek
and
claude
committed
241f869
docs: the last two copies of the exact-bytes claim; untangle the error reason

EricAndrechek
and
claude
committed
da0c0aa
docs: a table whose schema cannot compile is unavailable on its own

EricAndrechek
and
claude
committed
e3c3f14
docs: every copy of the unavailable claim names all four causes

EricAndrechek
and
claude
committed
9d8f95a
fix(policy): resolve row-filter predicates in column order

EricAndrechek
and
claude
committed
e07e0ce
refactor(api): inject the ClickHouse HTTP reader instead of a package global

EricAndrechek
and
claude
committed
53d874e
test(app): run the package's tests in parallel where they share no globals

EricAndrechek
and
claude
committed
63d7f45
Merge the internal/app test-time fix into chtypes-v2
EricAndrechek
committed
741f086
Merge origin/main (#711) into chtypes-v2
EricAndrechek
committed
755c108
fix(ingest): decline a body chtypes answers short, never report it short

EricAndrechek
and
claude
committed
2601574
docs: correct the type layer's unavailable causes, NaN rendering and literals

EricAndrechek
and
claude
committed
f0213ee
Merge branch 'chtypes-v2' into v2-uuid
EricAndrechek
committed
90860b6
fix(ingest): read BOM- and form-feed-led bodies the way ClickHouse does

EricAndrechek
and
claude
committed
a318830

Commits on Oct 4, 2026

feat(typelayer): move the type layer onto chtypes Go SDK v1.0.1

EricAndrechek
and
claude
committed
24c4adc
docs(typelayer): name the unknown-zone refusal among the tenant-wide causes

EricAndrechek
and
claude
committed
d699bcf
docs: move the type-layer docs to chtypes 1.0

EricAndrechek
and
claude
committed
0da30f7
build(chtypes): move the artifact fetch, lock, CI cache and images to chtypes 1.0

EricAndrechek
and
claude
committed
0b51b43
Merge branch 'v1-docs' into chtypes-v2

EricAndrechek
and
claude
committed
7b60408
docs: fix the chtypes 1.0 review findings

EricAndrechek
and
claude
committed
e6acc1f
fix(typelayer): let only a servable tenant set the image zone; refuse an unreadable artifact dir

EricAndrechek
and
claude
committed
2f14020
Merge branch 'v1-codefix' into chtypes-v2

EricAndrechek
and
claude
committed
c224bcf
Merge branch 'v1-docsfix' into chtypes-v2

EricAndrechek
and
claude
committed
a0f2d81
fix(typelayer): pin the artifact-error cause, scan records without oci-layout, embed tzdata

EricAndrechek
and
claude
committed
be86977
docs: document the image-zone latch and the remaining review findings

EricAndrechek
and
claude
committed
acd6a72
docs: close the round-3 review findings on the image-zone latch and #456

EricAndrechek
and
claude
committed
513c1dc
docs: tighten the image-zone and handle wording from the last review

EricAndrechek
and
claude
committed
7fd3500

Commits on Oct 6, 2026

build(chtypes): move to chtypes go v1.0.2 and the 20261004.052404 artifact build

EricAndrechek
and
claude
committed
f1d2b3e
fix(typelayer): drop the #458 latch from the setup-refusal cause

EricAndrechek
and
claude
committed
ec1b3a6
docs: describe the type layer on chtypes 1.0.2

EricAndrechek
and
claude
committed
522ad2a
docs(typelayer): cite the upstream issue for the remaining setup latch

EricAndrechek
and
claude
committed
3bf92db
test(typelayer): pin that a later tenant in a zone chtypes cannot load is refused per parse

EricAndrechek
and
claude
committed
c36e7d2
docs: scope the refused-zone cause to the first open and tighten the 1.0.2 wording

EricAndrechek
and
claude
committed
6d1dbdb
docs: scope the later-tenant zone refusal by body format and name its signal

EricAndrechek
and
claude
committed
30b9a07
feat(api)!: render NaN and infinities as strings on /v1/query and pipes

EricAndrechek
and
claude
committed
6a02ef9
feat(sdk)!: type generated Float columns as number or the nan/inf strings

EricAndrechek
and
claude
committed
0317182
Merge origin/main (#729) into chtypes-v2

EricAndrechek
and
claude
committed
6484ce8
Merge branch 'v1-nanstrings' into chtypes-v2

EricAndrechek
and
claude
committed
c63011f
feat(typelayer): fetch a tenant's chtypes line on its first bind

EricAndrechek
and
claude
committed
4e6809f
build: ship the chtypes CLI, not artifacts, and drop chtypes.lock

EricAndrechek
and
claude
committed
d502f1d
docs: describe autofetch, the chtypes cache, mirrors and the bundled CLI

EricAndrechek
and
claude
committed
187f76a
docs: say how a deployment refreshes its chtypes build, and cite #486/#487

EricAndrechek
and
claude
committed
337010e
Merge branch 'v1-artifacts' into chtypes-v2

EricAndrechek
and
claude
committed
d3b14af
build(chtypes): move to chtypes go v1.0.3; a failed first open no longer holds the zone

EricAndrechek
and
claude
committed
67f6d2c
feat(ingest)!: refuse a body with a malformed record whole, as ClickHouse does

EricAndrechek
and
claude
committed
8ff492e
build(chtypes): move to chtypes go v1.0.4 and drop the wrong-line guard

EricAndrechek
and
claude
committed
8d3ac03
Merge branch 'v1-sdk103' (chtypes go v1.0.4) into chtypes-v2

EricAndrechek
and
claude
committed
3afd3c1
Merge branch 'v1-alignguard' (ClickHouse-native ingest) into chtypes-v2
EricAndrechek
committed
e6c3e71
fix(ingest): use the server's async inserts and wait for them, instead of forcing synchronous inserts

EricAndrechek
and
claude
committed
58e15be
docs: fix the round-7 review findings (artifact model, #468 leftovers, #480 figures, fetch stalls)

EricAndrechek
and
claude
committed
ecceebb
fix(ingest): isolate rejected rows with synchronous inserts

EricAndrechek
and
claude
committed
921b1bb
Merge branch 'v1-docsfix7' into chtypes-v2

EricAndrechek
and
claude
committed
b69a5cb
Merge branch 'v1-asyncinsert' into chtypes-v2

EricAndrechek
and
claude
committed
d569b0d
docs: close the round-8 findings (CHECK exception, async-insert cause, changelog framing)

EricAndrechek
and
claude
committed
fedcb20
build(chtypes): move to chtypes go v1.1.0 and use its strict cache mode

EricAndrechek
and
claude
committed
226c9a4
fix(typelayer): narrow the missing-cache check and pin the cache-unusable cause

EricAndrechek
and
claude
committed
0e5d733
docs: shared-handle scaling is fixed in the production chtypes build

EricAndrechek
and
claude
committed
da5e72b
docs: close the v1.1.0 review findings (earlier-build figure, cache wording)

EricAndrechek
and
claude
committed
4339d2e
Merge origin/main into chtypes-v2

EricAndrechek
and
claude
committed
aafbce0