Skip to content

Commit 4e01ce6

Browse files
Ronald Tseronaldtse
authored andcommitted
release: ara-diac-small-int8static-2.1 (int8, parity cer_delta 0.1038pp on 2480 samples)
1 parent 8e75be6 commit 4e01ce6

2 files changed

Lines changed: 52 additions & 0 deletions

File tree

‎models.yaml‎

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -369,3 +369,16 @@ models:
369369
- {name: der_student_fullset, value: 4.5701, source: interscript/interscript-ml docs/RESULTS.md#run-006-r7-muon}
370370
parity: {samples: 2480, cer_delta: 0.0714}
371371
license: BSD-3-Clause
372+
ara-diac-small-int8static-2.1:
373+
task: diacritization
374+
scripts: [Arab, Arab]
375+
precision: int8
376+
filename: ara-diac-small-int8static-2.1-int8.zip
377+
url: https://github.com/interscript/interscript-ml/releases/download/ara-diac-small-int8static-2.1/ara-diac-small-int8static-2.1-int8.zip
378+
sha256: 7836bfd5582ad054ee419bfbd45a2b4a87fe8dc91e1f849898428faefd0c95da
379+
size: 515362212
380+
metrics:
381+
- {name: der_teacher_fullset, value: 2.289, source: interscript/interscript-ml docs/RESULTS.md#run-006-r7-muon}
382+
- {name: der_student_fullset, value: 4.5701, source: interscript/interscript-ml docs/RESULTS.md#run-006-r7-muon}
383+
parity: {samples: 2480, cer_delta: 0.1038}
384+
license: BSD-3-Clause
Lines changed: 39 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,39 @@
1+
format: imf-v1
2+
id: ara-diac-small-int8static-2.1
3+
task: diacritization
4+
source_script: Arab
5+
target: Arab
6+
tokenizer: bytes
7+
opset: 14
8+
decoder: kv
9+
precision: int8
10+
license: BSD-3-Clause
11+
trained_from: 'sequence-level KD from the r7 canonical teacher (rababa_arabic_byt5/run-007-news/best,
12+
2.2864 windowed DER-CE full protocol): fresh greedy r7 labels on the same r5-units
13+
corpus/limits as ara-diac-small-1.0, Muon optimizer (E3-adopted), vanilla ByT5-small
14+
(E4, pre-registered gate <= 6.26). Checkpoint rababa-checkpoints:/rababa_arabic_distill_small/run-007-r7-muon-6ep/best.
15+
The two measured wins compound: 8.259 -> 4.8218 full-set windowed DER-CE (teacher
16+
reproduces 2.289 in-run vs documented 2.2864) — a 42% error reduction on the 1.0
17+
release at the same architecture and artifact size. Still misses the strict teacher+0.5pp
18+
gate (+2.53pp; miss disclosed); the E2/E3 factorial attributes the residual to domain
19+
coverage.'
20+
metrics:
21+
- name: der_teacher_fullset
22+
value: 2.289
23+
protocol: windowed DER-CE (1400-byte windows, word-boundary split, greedy, haraqat-projected,
24+
Misraj evaluator); full 1,200-paragraph SadeedDiac-25; in-run reproduction of
25+
the documented 2.2864 (r7 canonical teacher)
26+
source: interscript/interscript-ml docs/RESULTS.md#run-006-r7-muon
27+
- name: der_student_fullset
28+
value: 4.5701
29+
protocol: same full-set harness; E4 (r7 teacher labels + Muon, vanilla ByT5-small)
30+
vs the 8.259 AdamW/r6-labels 1.0 release — a 42% error reduction at identical
31+
architecture and artifact size
32+
source: interscript/interscript-ml docs/RESULTS.md#run-006-r7-muon
33+
parity:
34+
samples: 2480
35+
cer_delta: 0.1038
36+
sha256:
37+
decoder-kv.onnx: f56a365df3c7acefcc96982ab3fb70d7c417aea9a4379bd1a39a784dc227db98
38+
decoder.onnx: 81852f41838f6ad8dd8ee5b72e709328afdad474ee28da6381abbd32659219d7
39+
encoder.onnx: 61afa9ded2e61966a2966f906650715183f95cccc24bac699ed4c4b2d766eecd

0 commit comments

Comments
 (0)