|
| 1 | +format: imf-v1 |
| 2 | +id: ara-diac-layerdrop-1.0 |
| 3 | +task: diacritization |
| 4 | +source_script: Arab |
| 5 | +target: Arab |
| 6 | +tokenizer: bytes |
| 7 | +opset: 14 |
| 8 | +decoder: kv |
| 9 | +precision: int8 |
| 10 | +license: BSD-3-Clause |
| 11 | +trained_from: 'the depth-cut rung: ByT5-small with the encoder halved 12->6 (surviving |
| 12 | + layers copied VERBATIM from pretraining - both width-cut approaches collapsed at |
| 13 | + 74.68/82.96 while this works), Muon optimizer, r7 teacher labels (the 2.0 recipe), |
| 14 | + 6 epochs. ~190M parameters (63% of ByT5-small). Full-set windowed DER-CE 5.784, |
| 15 | + delta CI [3.033, 3.491] vs in-run teacher 2.2921 — the depth premium over the full-depth |
| 16 | + G2a peer (4.5701, CI [1.911, 2.352]) is 1.21pp with non-overlapping intervals. The |
| 17 | + int4 variant (~95MB) is the browser-budget tier; margin-gated before ship. Checkpoint |
| 18 | + rababa-checkpoints:/rababa_arabic_distill_small/run-009-layerdrop-6ep/best.' |
| 19 | +metrics: |
| 20 | +- name: der_teacher_fullset |
| 21 | + value: 2.2921 |
| 22 | + protocol: windowed DER-CE (1400-byte windows, word-boundary split, greedy, haraqat-projected, |
| 23 | + Misraj evaluator); full 1,200-paragraph SadeedDiac-25 |
| 24 | + source: interscript/interscript-ml docs/RESULTS.md#layerdrop-6ep |
| 25 | +- name: der_student_fullset |
| 26 | + value: 5.784 |
| 27 | + protocol: same harness; paired bootstrap delta 3.2455 [3.033, 3.491] |
| 28 | + source: interscript/interscript-ml docs/RESULTS.md#layerdrop-6ep |
| 29 | +parity: |
| 30 | + samples: 2480 |
| 31 | + cer_delta: 0.0538 |
| 32 | +sha256: |
| 33 | + decoder-kv.onnx: 2d6da11fcf78ed9fdf71e79766d6dfcc7cfbd1c3336b7a394562f4379da0f585 |
| 34 | + decoder.onnx: a3ebfd2bc40e62a1cb7713bfb7522cb85feae3887877cc7e6c5f4e6e55d54f90 |
| 35 | + encoder.onnx: 7cc08092dae68d742b93788100101a4fb323145ae4b7263b8915495a3938a87d |
0 commit comments