Skip to content

Commit 09d8d97

Browse files
author
Ronald Tse
committed
release: ara-diac-layerdrop-1.0-int8 (int8, parity cer_delta 0.0538pp on 2480 samples)
1 parent 0581cc8 commit 09d8d97

2 files changed

Lines changed: 48 additions & 0 deletions

File tree

‎models.yaml‎

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -330,3 +330,16 @@ models:
330330
- {name: der_student_fullset, value: 5.784, source: interscript/interscript-ml docs/RESULTS.md#layerdrop-6ep}
331331
parity: {samples: 2480, cer_delta: 0.0632}
332332
license: BSD-3-Clause
333+
ara-diac-layerdrop-1.0-int8:
334+
task: diacritization
335+
scripts: [Arab, Arab]
336+
precision: int8
337+
filename: ld-int8.zip
338+
url: https://github.com/interscript/interscript-ml/releases/download/ara-diac-layerdrop-1.0/ld-int8.zip
339+
sha256: 68dcc06cd8861e017c4d4912ce3e1fe057d78b79b0a7b6246ae8603c99930963
340+
size: 191603048
341+
metrics:
342+
- {name: der_teacher_fullset, value: 2.2921, source: interscript/interscript-ml docs/RESULTS.md#layerdrop-6ep}
343+
- {name: der_student_fullset, value: 5.784, source: interscript/interscript-ml docs/RESULTS.md#layerdrop-6ep}
344+
parity: {samples: 2480, cer_delta: 0.0538}
345+
license: BSD-3-Clause
Lines changed: 35 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,35 @@
1+
format: imf-v1
2+
id: ara-diac-layerdrop-1.0
3+
task: diacritization
4+
source_script: Arab
5+
target: Arab
6+
tokenizer: bytes
7+
opset: 14
8+
decoder: kv
9+
precision: int8
10+
license: BSD-3-Clause
11+
trained_from: 'the depth-cut rung: ByT5-small with the encoder halved 12->6 (surviving
12+
layers copied VERBATIM from pretraining - both width-cut approaches collapsed at
13+
74.68/82.96 while this works), Muon optimizer, r7 teacher labels (the 2.0 recipe),
14+
6 epochs. ~190M parameters (63% of ByT5-small). Full-set windowed DER-CE 5.784,
15+
delta CI [3.033, 3.491] vs in-run teacher 2.2921 — the depth premium over the full-depth
16+
G2a peer (4.5701, CI [1.911, 2.352]) is 1.21pp with non-overlapping intervals. The
17+
int4 variant (~95MB) is the browser-budget tier; margin-gated before ship. Checkpoint
18+
rababa-checkpoints:/rababa_arabic_distill_small/run-009-layerdrop-6ep/best.'
19+
metrics:
20+
- name: der_teacher_fullset
21+
value: 2.2921
22+
protocol: windowed DER-CE (1400-byte windows, word-boundary split, greedy, haraqat-projected,
23+
Misraj evaluator); full 1,200-paragraph SadeedDiac-25
24+
source: interscript/interscript-ml docs/RESULTS.md#layerdrop-6ep
25+
- name: der_student_fullset
26+
value: 5.784
27+
protocol: same harness; paired bootstrap delta 3.2455 [3.033, 3.491]
28+
source: interscript/interscript-ml docs/RESULTS.md#layerdrop-6ep
29+
parity:
30+
samples: 2480
31+
cer_delta: 0.0538
32+
sha256:
33+
decoder-kv.onnx: 2d6da11fcf78ed9fdf71e79766d6dfcc7cfbd1c3336b7a394562f4379da0f585
34+
decoder.onnx: a3ebfd2bc40e62a1cb7713bfb7522cb85feae3887877cc7e6c5f4e6e55d54f90
35+
encoder.onnx: 7cc08092dae68d742b93788100101a4fb323145ae4b7263b8915495a3938a87d

0 commit comments

Comments
 (0)