length-only-20260704-155307-asr-cherokee-colon
This model is a fine-tuned version of facebook/wav2vec2-large-xlsr-53 on the None dataset. It achieves the following results on the evaluation set:
- Loss: 0.2431
- Wer: 0.1651
- Cer: 0.0276
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0003
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- gradient_accumulation_steps: 2
- total_train_batch_size: 16
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_ratio: 0.1
- num_epochs: 50
- mixed_precision_training: Native AMP
Training results
| Training Loss | Epoch | Step | Validation Loss | Wer | Cer |
|---|---|---|---|---|---|
| 13.0877 | 0.4264 | 100 | 5.3910 | 1.0 | 1.0 |
| 3.8261 | 0.8529 | 200 | 2.8246 | 1.0 | 1.0 |
| 2.839 | 1.2793 | 300 | 2.7347 | 1.0 | 1.0 |
| 2.7798 | 1.7058 | 400 | 2.5692 | 1.0 | 1.0 |
| 2.3555 | 2.1322 | 500 | 1.4907 | 1.0 | 0.6670 |
| 1.3922 | 2.5586 | 600 | 0.6072 | 1.0 | 0.1754 |
| 0.9563 | 2.9851 | 700 | 0.5123 | 0.9986 | 0.1474 |
| 0.7257 | 3.4115 | 800 | 0.4789 | 0.9876 | 0.1402 |
| 0.6646 | 3.8380 | 900 | 0.3468 | 0.6823 | 0.0951 |
| 0.6332 | 4.2644 | 1000 | 0.2612 | 0.3934 | 0.0568 |
| 0.5893 | 4.6908 | 1100 | 0.2501 | 0.3205 | 0.0513 |
| 0.5459 | 5.1173 | 1200 | 0.2458 | 0.3411 | 0.0533 |
| 0.5228 | 5.5437 | 1300 | 0.2639 | 0.3356 | 0.0543 |
| 0.5522 | 5.9701 | 1400 | 0.2495 | 0.3631 | 0.0557 |
| 0.4653 | 6.3966 | 1500 | 0.2661 | 0.3893 | 0.0600 |
| 0.4544 | 6.8230 | 1600 | 0.2662 | 0.4223 | 0.0742 |
| 0.4591 | 7.2495 | 1700 | 0.2318 | 0.2806 | 0.0468 |
| 0.428 | 7.6759 | 1800 | 0.2275 | 0.2916 | 0.0467 |
| 0.3861 | 8.1023 | 1900 | 0.2255 | 0.2765 | 0.0459 |
| 0.3885 | 8.5288 | 2000 | 0.2252 | 0.2710 | 0.0450 |
| 0.4052 | 8.9552 | 2100 | 0.2274 | 0.2806 | 0.0458 |
| 0.3732 | 9.3817 | 2200 | 0.2365 | 0.3095 | 0.0499 |
| 0.3719 | 9.8081 | 2300 | 0.2335 | 0.2710 | 0.0430 |
| 0.4061 | 10.2345 | 2400 | 0.2132 | 0.2847 | 0.0459 |
| 0.3441 | 10.6610 | 2500 | 0.2163 | 0.2944 | 0.0465 |
| 0.3164 | 11.0874 | 2600 | 0.2071 | 0.2256 | 0.0406 |
| 0.3336 | 11.5139 | 2700 | 0.2083 | 0.2572 | 0.0435 |
| 0.3504 | 11.9403 | 2800 | 0.2228 | 0.2834 | 0.0442 |
| 0.3114 | 12.3667 | 2900 | 0.2226 | 0.2751 | 0.0441 |
| 0.3184 | 12.7932 | 3000 | 0.2204 | 0.2572 | 0.0416 |
| 0.3558 | 13.2196 | 3100 | 0.2257 | 0.2792 | 0.0449 |
| 0.2944 | 13.6461 | 3200 | 0.2454 | 0.2971 | 0.0484 |
| 0.2922 | 14.0725 | 3300 | 0.2056 | 0.2352 | 0.0378 |
| 0.2867 | 14.4989 | 3400 | 0.1939 | 0.2297 | 0.0372 |
| 0.2767 | 14.9254 | 3500 | 0.1919 | 0.2270 | 0.0372 |
| 0.2691 | 15.3518 | 3600 | 0.2072 | 0.2270 | 0.0366 |
| 0.2784 | 15.7783 | 3700 | 0.2063 | 0.2462 | 0.0409 |
| 0.2712 | 16.2047 | 3800 | 0.2367 | 0.2558 | 0.0423 |
| 0.2672 | 16.6311 | 3900 | 0.2263 | 0.2531 | 0.0424 |
| 0.2428 | 17.0576 | 4000 | 0.2189 | 0.2572 | 0.0424 |
| 0.2604 | 17.4840 | 4100 | 0.2154 | 0.2545 | 0.0400 |
| 0.2471 | 17.9104 | 4200 | 0.2066 | 0.2187 | 0.0384 |
| 0.2306 | 18.3369 | 4300 | 0.2157 | 0.2325 | 0.0401 |
| 0.2365 | 18.7633 | 4400 | 0.1991 | 0.2077 | 0.0363 |
| 0.2324 | 19.1898 | 4500 | 0.2395 | 0.2503 | 0.0424 |
| 0.2147 | 19.6162 | 4600 | 0.2209 | 0.2476 | 0.0401 |
| 0.2354 | 20.0426 | 4700 | 0.2250 | 0.2352 | 0.0392 |
| 0.2232 | 20.4691 | 4800 | 0.2094 | 0.2352 | 0.0370 |
| 0.2038 | 20.8955 | 4900 | 0.2142 | 0.2448 | 0.0378 |
| 0.206 | 21.3220 | 5000 | 0.2084 | 0.2242 | 0.0383 |
| 0.2003 | 21.7484 | 5100 | 0.2222 | 0.2173 | 0.0375 |
| 0.199 | 22.1748 | 5200 | 0.2299 | 0.2517 | 0.0410 |
| 0.1834 | 22.6013 | 5300 | 0.2207 | 0.2325 | 0.0395 |
| 0.2171 | 23.0277 | 5400 | 0.2298 | 0.2696 | 0.0467 |
| 0.1848 | 23.4542 | 5500 | 0.2292 | 0.2586 | 0.0439 |
| 0.184 | 23.8806 | 5600 | 0.2199 | 0.2531 | 0.0433 |
| 0.1628 | 24.3070 | 5700 | 0.2247 | 0.2228 | 0.0403 |
| 0.1609 | 24.7335 | 5800 | 0.2393 | 0.2091 | 0.0360 |
| 0.1646 | 25.1599 | 5900 | 0.2532 | 0.2545 | 0.0419 |
| 0.1586 | 25.5864 | 6000 | 0.2450 | 0.2435 | 0.0400 |
| 0.1842 | 26.0128 | 6100 | 0.2244 | 0.2256 | 0.0400 |
| 0.1557 | 26.4392 | 6200 | 0.2126 | 0.2297 | 0.0398 |
| 0.1495 | 26.8657 | 6300 | 0.2203 | 0.2297 | 0.0370 |
| 0.1497 | 27.2921 | 6400 | 0.2233 | 0.2077 | 0.0349 |
| 0.1389 | 27.7186 | 6500 | 0.2316 | 0.1967 | 0.0341 |
| 0.1466 | 28.1450 | 6600 | 0.2357 | 0.2201 | 0.0378 |
| 0.1219 | 28.5714 | 6700 | 0.2214 | 0.2091 | 0.0370 |
| 0.1697 | 28.9979 | 6800 | 0.2314 | 0.2022 | 0.0372 |
| 0.1391 | 29.4243 | 6900 | 0.2392 | 0.2091 | 0.0377 |
| 0.1361 | 29.8507 | 7000 | 0.2478 | 0.2146 | 0.0360 |
| 0.125 | 30.2772 | 7100 | 0.2379 | 0.1994 | 0.0326 |
| 0.1283 | 30.7036 | 7200 | 0.2324 | 0.2063 | 0.0326 |
| 0.1229 | 31.1301 | 7300 | 0.2309 | 0.2132 | 0.0325 |
| 0.1199 | 31.5565 | 7400 | 0.2346 | 0.2036 | 0.0326 |
| 0.1319 | 31.9829 | 7500 | 0.2266 | 0.2008 | 0.0335 |
| 0.1054 | 32.4094 | 7600 | 0.2230 | 0.1926 | 0.0320 |
| 0.1355 | 32.8358 | 7700 | 0.2313 | 0.2077 | 0.0329 |
| 0.1157 | 33.2623 | 7800 | 0.2399 | 0.2256 | 0.0363 |
| 0.1085 | 33.6887 | 7900 | 0.2393 | 0.1884 | 0.0312 |
| 0.1062 | 34.1151 | 8000 | 0.2468 | 0.1843 | 0.0312 |
| 0.105 | 34.5416 | 8100 | 0.2317 | 0.1802 | 0.0305 |
| 0.104 | 34.9680 | 8200 | 0.2451 | 0.1774 | 0.0306 |
| 0.1003 | 35.3945 | 8300 | 0.2434 | 0.1857 | 0.0308 |
| 0.108 | 35.8209 | 8400 | 0.2426 | 0.1884 | 0.0315 |
| 0.094 | 36.2473 | 8500 | 0.2412 | 0.1843 | 0.0306 |
| 0.0968 | 36.6738 | 8600 | 0.2311 | 0.1912 | 0.0312 |
| 0.0903 | 37.1002 | 8700 | 0.2359 | 0.1843 | 0.0331 |
| 0.0825 | 37.5267 | 8800 | 0.2356 | 0.1802 | 0.0314 |
| 0.0949 | 37.9531 | 8900 | 0.2311 | 0.1774 | 0.0303 |
| 0.0929 | 38.3795 | 9000 | 0.2409 | 0.1912 | 0.0329 |
| 0.0876 | 38.8060 | 9100 | 0.2438 | 0.1967 | 0.0325 |
| 0.0967 | 39.2324 | 9200 | 0.2425 | 0.1871 | 0.0332 |
| 0.0798 | 39.6588 | 9300 | 0.2382 | 0.1829 | 0.0315 |
| 0.0803 | 40.0853 | 9400 | 0.2468 | 0.1884 | 0.0331 |
| 0.0878 | 40.5117 | 9500 | 0.2398 | 0.1802 | 0.0315 |
| 0.0841 | 40.9382 | 9600 | 0.2481 | 0.1829 | 0.0312 |
| 0.0805 | 41.3646 | 9700 | 0.2485 | 0.1884 | 0.0320 |
| 0.0656 | 41.7910 | 9800 | 0.2582 | 0.1912 | 0.0332 |
| 0.0704 | 42.2175 | 9900 | 0.2660 | 0.1871 | 0.0328 |
| 0.0865 | 42.6439 | 10000 | 0.2491 | 0.1857 | 0.0318 |
| 0.0697 | 43.0704 | 10100 | 0.2409 | 0.1829 | 0.0314 |
| 0.0778 | 43.4968 | 10200 | 0.2391 | 0.1747 | 0.0300 |
| 0.0726 | 43.9232 | 10300 | 0.2480 | 0.1761 | 0.0294 |
| 0.0716 | 44.3497 | 10400 | 0.2447 | 0.1706 | 0.0291 |
| 0.0668 | 44.7761 | 10500 | 0.2430 | 0.1678 | 0.0288 |
| 0.0669 | 45.2026 | 10600 | 0.2450 | 0.1747 | 0.0291 |
| 0.0668 | 45.6290 | 10700 | 0.2444 | 0.1678 | 0.0291 |
| 0.0702 | 46.0554 | 10800 | 0.2448 | 0.1747 | 0.0295 |
| 0.0671 | 46.4819 | 10900 | 0.2454 | 0.1774 | 0.0295 |
| 0.0604 | 46.9083 | 11000 | 0.2449 | 0.1774 | 0.0294 |
| 0.0591 | 47.3348 | 11100 | 0.2458 | 0.1678 | 0.0277 |
| 0.0614 | 47.7612 | 11200 | 0.2477 | 0.1664 | 0.0282 |
| 0.0634 | 48.1876 | 11300 | 0.2449 | 0.1637 | 0.0276 |
| 0.0603 | 48.6141 | 11400 | 0.2443 | 0.1596 | 0.0271 |
| 0.0673 | 49.0405 | 11500 | 0.2438 | 0.1623 | 0.0273 |
| 0.0656 | 49.4670 | 11600 | 0.2430 | 0.1637 | 0.0274 |
| 0.0619 | 49.8934 | 11700 | 0.2431 | 0.1651 | 0.0276 |
Framework versions
- Transformers 4.44.2
- Pytorch 2.3.1
- Datasets 2.21.0
- Tokenizers 0.19.1