length-only-20260704-211323-asr-cherokee-colon-real
This model is a fine-tuned version of facebook/wav2vec2-large-xlsr-53 on the None dataset. It achieves the following results on the evaluation set:
- Loss: 0.4104
- Wer: 0.3356
- Cer: 0.0479
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0003
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- gradient_accumulation_steps: 2
- total_train_batch_size: 16
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 50
- mixed_precision_training: Native AMP
Training results
| Training Loss | Epoch | Step | Validation Loss | Wer | Cer |
|---|---|---|---|---|---|
| 3.5575 | 0.4264 | 100 | 2.8651 | 1.0 | 1.0 |
| 2.7037 | 0.8529 | 200 | 2.3562 | 1.0 | 0.9512 |
| 1.6007 | 1.2793 | 300 | 0.6487 | 1.0 | 0.2202 |
| 0.9567 | 1.7058 | 400 | 0.4622 | 0.9986 | 0.1672 |
| 0.7577 | 2.1322 | 500 | 0.3808 | 0.6699 | 0.1054 |
| 0.6744 | 2.5586 | 600 | 0.3391 | 0.6327 | 0.0897 |
| 0.6502 | 2.9851 | 700 | 0.3291 | 0.5461 | 0.0818 |
| 0.5742 | 3.4115 | 800 | 0.3588 | 0.5901 | 0.0913 |
| 0.5623 | 3.8380 | 900 | 0.3539 | 0.6135 | 0.0919 |
| 0.5563 | 4.2644 | 1000 | 0.2814 | 0.4415 | 0.0648 |
| 0.529 | 4.6908 | 1100 | 0.2760 | 0.4319 | 0.0624 |
| 0.4955 | 5.1173 | 1200 | 0.2665 | 0.4333 | 0.0635 |
| 0.4751 | 5.5437 | 1300 | 0.2795 | 0.4704 | 0.0667 |
| 0.5026 | 5.9701 | 1400 | 0.2880 | 0.4938 | 0.0784 |
| 0.4583 | 6.3966 | 1500 | 0.2970 | 0.4498 | 0.0684 |
| 0.4439 | 6.8230 | 1600 | 0.2824 | 0.4594 | 0.0653 |
| 0.4467 | 7.2495 | 1700 | 0.2745 | 0.4374 | 0.0626 |
| 0.4238 | 7.6759 | 1800 | 0.2486 | 0.4099 | 0.0583 |
| 0.3757 | 8.1023 | 1900 | 0.2754 | 0.4099 | 0.0591 |
| 0.3955 | 8.5288 | 2000 | 0.2580 | 0.4072 | 0.0613 |
| 0.4049 | 8.9552 | 2100 | 0.2593 | 0.3920 | 0.0579 |
| 0.3717 | 9.3817 | 2200 | 0.2794 | 0.4305 | 0.0627 |
| 0.3682 | 9.8081 | 2300 | 0.2822 | 0.4044 | 0.0591 |
| 0.3995 | 10.2345 | 2400 | 0.2676 | 0.4154 | 0.0601 |
| 0.3423 | 10.6610 | 2500 | 0.2617 | 0.4402 | 0.0645 |
| 0.3222 | 11.0874 | 2600 | 0.2536 | 0.3810 | 0.0554 |
| 0.3372 | 11.5139 | 2700 | 0.2577 | 0.3893 | 0.0570 |
| 0.3444 | 11.9403 | 2800 | 0.2517 | 0.3700 | 0.0539 |
| 0.3136 | 12.3667 | 2900 | 0.2686 | 0.4099 | 0.0585 |
| 0.3166 | 12.7932 | 3000 | 0.2845 | 0.4003 | 0.0582 |
| 0.3463 | 13.2196 | 3100 | 0.2993 | 0.4085 | 0.0630 |
| 0.2977 | 13.6461 | 3200 | 0.2699 | 0.4154 | 0.0619 |
| 0.2971 | 14.0725 | 3300 | 0.2687 | 0.3865 | 0.0568 |
| 0.2978 | 14.4989 | 3400 | 0.2405 | 0.3714 | 0.0539 |
| 0.2892 | 14.9254 | 3500 | 0.2559 | 0.3741 | 0.0557 |
| 0.2636 | 15.3518 | 3600 | 0.2848 | 0.3783 | 0.0543 |
| 0.2681 | 15.7783 | 3700 | 0.2675 | 0.3824 | 0.0555 |
| 0.2805 | 16.2047 | 3800 | 0.2784 | 0.3824 | 0.0550 |
| 0.2554 | 16.6311 | 3900 | 0.2809 | 0.3783 | 0.0557 |
| 0.2418 | 17.0576 | 4000 | 0.2771 | 0.3535 | 0.0507 |
| 0.2493 | 17.4840 | 4100 | 0.2625 | 0.3535 | 0.0523 |
| 0.256 | 17.9104 | 4200 | 0.2774 | 0.3824 | 0.0545 |
| 0.2245 | 18.3369 | 4300 | 0.2724 | 0.3934 | 0.0552 |
| 0.2296 | 18.7633 | 4400 | 0.2849 | 0.3631 | 0.0512 |
| 0.2453 | 19.1898 | 4500 | 0.3169 | 0.4113 | 0.0614 |
| 0.2262 | 19.6162 | 4600 | 0.3147 | 0.3906 | 0.0538 |
| 0.2403 | 20.0426 | 4700 | 0.2831 | 0.3755 | 0.0547 |
| 0.217 | 20.4691 | 4800 | 0.2888 | 0.3700 | 0.0514 |
| 0.2066 | 20.8955 | 4900 | 0.2762 | 0.3686 | 0.0520 |
| 0.2065 | 21.3220 | 5000 | 0.3019 | 0.3728 | 0.0514 |
| 0.2026 | 21.7484 | 5100 | 0.2845 | 0.3714 | 0.0527 |
| 0.2022 | 22.1748 | 5200 | 0.3160 | 0.3948 | 0.0556 |
| 0.186 | 22.6013 | 5300 | 0.3102 | 0.3893 | 0.0555 |
| 0.2078 | 23.0277 | 5400 | 0.3004 | 0.3810 | 0.0548 |
| 0.1852 | 23.4542 | 5500 | 0.3103 | 0.3741 | 0.0539 |
| 0.1745 | 23.8806 | 5600 | 0.3180 | 0.3796 | 0.0545 |
| 0.1661 | 24.3070 | 5700 | 0.3059 | 0.3838 | 0.0545 |
| 0.1622 | 24.7335 | 5800 | 0.3126 | 0.3824 | 0.0579 |
| 0.1708 | 25.1599 | 5900 | 0.3044 | 0.3728 | 0.0569 |
| 0.162 | 25.5864 | 6000 | 0.3160 | 0.3893 | 0.0566 |
| 0.19 | 26.0128 | 6100 | 0.3070 | 0.3838 | 0.0536 |
| 0.1626 | 26.4392 | 6200 | 0.3693 | 0.3714 | 0.0521 |
| 0.1512 | 26.8657 | 6300 | 0.3303 | 0.3686 | 0.0520 |
| 0.1445 | 27.2921 | 6400 | 0.3229 | 0.3783 | 0.0530 |
| 0.1459 | 27.7186 | 6500 | 0.3386 | 0.3769 | 0.0514 |
| 0.1534 | 28.1450 | 6600 | 0.3311 | 0.3576 | 0.0524 |
| 0.1257 | 28.5714 | 6700 | 0.3382 | 0.3700 | 0.0530 |
| 0.1649 | 28.9979 | 6800 | 0.3628 | 0.3989 | 0.0559 |
| 0.1386 | 29.4243 | 6900 | 0.3720 | 0.3604 | 0.0520 |
| 0.1413 | 29.8507 | 7000 | 0.3499 | 0.3700 | 0.0542 |
| 0.1328 | 30.2772 | 7100 | 0.3669 | 0.3783 | 0.0534 |
| 0.1338 | 30.7036 | 7200 | 0.3642 | 0.3700 | 0.0510 |
| 0.129 | 31.1301 | 7300 | 0.3895 | 0.3755 | 0.0534 |
| 0.1201 | 31.5565 | 7400 | 0.3909 | 0.3604 | 0.0521 |
| 0.1293 | 31.9829 | 7500 | 0.3677 | 0.3480 | 0.0501 |
| 0.113 | 32.4094 | 7600 | 0.3670 | 0.3508 | 0.0501 |
| 0.1401 | 32.8358 | 7700 | 0.3845 | 0.3398 | 0.0478 |
| 0.1244 | 33.2623 | 7800 | 0.3540 | 0.3563 | 0.0507 |
| 0.1102 | 33.6887 | 7900 | 0.3564 | 0.3521 | 0.0493 |
| 0.1124 | 34.1151 | 8000 | 0.3551 | 0.3549 | 0.0494 |
| 0.1124 | 34.5416 | 8100 | 0.3737 | 0.3549 | 0.0498 |
| 0.1145 | 34.9680 | 8200 | 0.3516 | 0.3645 | 0.0515 |
| 0.1057 | 35.3945 | 8300 | 0.3834 | 0.3508 | 0.0491 |
| 0.1074 | 35.8209 | 8400 | 0.4032 | 0.3466 | 0.0484 |
| 0.1032 | 36.2473 | 8500 | 0.3740 | 0.3521 | 0.0485 |
| 0.1096 | 36.6738 | 8600 | 0.3839 | 0.3604 | 0.0493 |
| 0.0948 | 37.1002 | 8700 | 0.3955 | 0.3398 | 0.0470 |
| 0.0894 | 37.5267 | 8800 | 0.3862 | 0.3590 | 0.0507 |
| 0.0911 | 37.9531 | 8900 | 0.3879 | 0.3521 | 0.0489 |
| 0.0958 | 38.3795 | 9000 | 0.4035 | 0.3508 | 0.0488 |
| 0.0869 | 38.8060 | 9100 | 0.4030 | 0.3631 | 0.0498 |
| 0.0954 | 39.2324 | 9200 | 0.3750 | 0.3576 | 0.0500 |
| 0.0928 | 39.6588 | 9300 | 0.3765 | 0.3411 | 0.0480 |
| 0.0853 | 40.0853 | 9400 | 0.3750 | 0.3508 | 0.0478 |
| 0.0923 | 40.5117 | 9500 | 0.3912 | 0.3439 | 0.0476 |
| 0.087 | 40.9382 | 9600 | 0.3956 | 0.3370 | 0.0478 |
| 0.086 | 41.3646 | 9700 | 0.3908 | 0.3384 | 0.0476 |
| 0.0766 | 41.7910 | 9800 | 0.3867 | 0.3508 | 0.0484 |
| 0.0765 | 42.2175 | 9900 | 0.3919 | 0.3301 | 0.0467 |
| 0.0886 | 42.6439 | 10000 | 0.4019 | 0.3370 | 0.0479 |
| 0.083 | 43.0704 | 10100 | 0.3972 | 0.3590 | 0.0496 |
| 0.0858 | 43.4968 | 10200 | 0.3988 | 0.3411 | 0.0475 |
| 0.0809 | 43.9232 | 10300 | 0.3999 | 0.3370 | 0.0474 |
| 0.0862 | 44.3497 | 10400 | 0.3882 | 0.3301 | 0.0473 |
| 0.0734 | 44.7761 | 10500 | 0.3900 | 0.3329 | 0.0474 |
| 0.0705 | 45.2026 | 10600 | 0.4033 | 0.3398 | 0.0480 |
| 0.0735 | 45.6290 | 10700 | 0.4017 | 0.3398 | 0.0480 |
| 0.0707 | 46.0554 | 10800 | 0.4076 | 0.3439 | 0.0491 |
| 0.0711 | 46.4819 | 10900 | 0.4119 | 0.3425 | 0.0479 |
| 0.0679 | 46.9083 | 11000 | 0.4121 | 0.3453 | 0.0483 |
| 0.0737 | 47.3348 | 11100 | 0.4073 | 0.3411 | 0.0483 |
| 0.0661 | 47.7612 | 11200 | 0.4137 | 0.3453 | 0.0484 |
| 0.0686 | 48.1876 | 11300 | 0.4134 | 0.3439 | 0.0480 |
| 0.0648 | 48.6141 | 11400 | 0.4168 | 0.3384 | 0.0479 |
| 0.0707 | 49.0405 | 11500 | 0.4146 | 0.3370 | 0.0480 |
| 0.0753 | 49.4670 | 11600 | 0.4110 | 0.3398 | 0.0483 |
| 0.0678 | 49.8934 | 11700 | 0.4104 | 0.3356 | 0.0479 |
Framework versions
- Transformers 4.44.2
- Pytorch 2.3.1
- Datasets 2.21.0
- Tokenizers 0.19.1