mms-pa_Sep27_152songs
This model is a fine-tuned version of facebook/mms-1b-all on the None dataset. It achieves the following results on the evaluation set:
- Loss: 0.3949
- Wer: 0.3271
- Cer: 0.0971
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 5e-06
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- gradient_accumulation_steps: 2
- total_train_batch_size: 16
- optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: cosine
- lr_scheduler_warmup_steps: 150
- num_epochs: 60
Training results
| Training Loss | Epoch | Step | Validation Loss | Wer | Cer |
|---|---|---|---|---|---|
| 2.7509 | 0.2740 | 50 | 0.6833 | 0.6036 | 0.1907 |
| 2.2985 | 0.5479 | 100 | 0.5757 | 0.5521 | 0.1675 |
| 2.1027 | 0.8219 | 150 | 0.5240 | 0.5102 | 0.1537 |
| 1.8644 | 1.0932 | 200 | 0.4855 | 0.4797 | 0.1405 |
| 1.7971 | 1.3671 | 250 | 0.4664 | 0.4590 | 0.1344 |
| 1.6362 | 1.6411 | 300 | 0.4612 | 0.4465 | 0.1322 |
| 1.6054 | 1.9151 | 350 | 0.4523 | 0.4425 | 0.1325 |
| 1.7508 | 2.1863 | 400 | 0.4339 | 0.4389 | 0.1269 |
| 1.4391 | 2.4603 | 450 | 0.4383 | 0.4227 | 0.1250 |
| 1.5579 | 2.7342 | 500 | 0.4345 | 0.4152 | 0.1232 |
| 1.3312 | 3.0055 | 550 | 0.4221 | 0.4045 | 0.1209 |
| 1.4244 | 3.2795 | 600 | 0.4270 | 0.4073 | 0.1204 |
| 1.4004 | 3.5534 | 650 | 0.4094 | 0.3875 | 0.1151 |
| 1.2603 | 3.8274 | 700 | 0.4090 | 0.3861 | 0.1138 |
| 1.2537 | 4.0986 | 750 | 0.4136 | 0.3836 | 0.1149 |
| 1.3443 | 4.3726 | 800 | 0.4006 | 0.3743 | 0.1117 |
| 1.2952 | 4.6466 | 850 | 0.4080 | 0.3906 | 0.1181 |
| 1.2847 | 4.9205 | 900 | 0.4109 | 0.3836 | 0.1151 |
| 1.2665 | 5.1918 | 950 | 0.4078 | 0.3710 | 0.1111 |
| 1.1511 | 5.4658 | 1000 | 0.4103 | 0.3701 | 0.1103 |
| 1.1325 | 5.7397 | 1050 | 0.4121 | 0.3769 | 0.1144 |
| 1.0639 | 6.0110 | 1100 | 0.3900 | 0.3604 | 0.1071 |
| 1.2327 | 6.2849 | 1150 | 0.3959 | 0.3701 | 0.1122 |
| 1.0608 | 6.5589 | 1200 | 0.3856 | 0.3584 | 0.1073 |
| 1.1720 | 6.8329 | 1250 | 0.3805 | 0.3556 | 0.1076 |
| 1.1301 | 7.1041 | 1300 | 0.3951 | 0.3545 | 0.1063 |
| 1.1214 | 7.3781 | 1350 | 0.3814 | 0.3629 | 0.1090 |
| 1.1240 | 7.6521 | 1400 | 0.3902 | 0.3525 | 0.1068 |
| 1.0473 | 7.9260 | 1450 | 0.3981 | 0.3556 | 0.1057 |
| 1.0065 | 8.1973 | 1500 | 0.3830 | 0.3598 | 0.1069 |
| 0.9898 | 8.4712 | 1550 | 0.3835 | 0.3450 | 0.1043 |
| 0.9212 | 8.7452 | 1600 | 0.3821 | 0.3411 | 0.1044 |
| 0.8486 | 9.0164 | 1650 | 0.3757 | 0.3408 | 0.1034 |
| 1.0368 | 9.2904 | 1700 | 0.3817 | 0.3430 | 0.1028 |
| 1.0036 | 9.5644 | 1750 | 0.3852 | 0.3402 | 0.1019 |
| 0.8797 | 9.8384 | 1800 | 0.3793 | 0.3369 | 0.1027 |
| 0.9657 | 10.1096 | 1850 | 0.3931 | 0.3363 | 0.1016 |
| 0.9775 | 10.3836 | 1900 | 0.3876 | 0.3500 | 0.1061 |
| 0.8758 | 10.6575 | 1950 | 0.3718 | 0.3369 | 0.1006 |
| 0.9403 | 10.9315 | 2000 | 0.3819 | 0.3472 | 0.1019 |
| 0.7950 | 11.2027 | 2050 | 0.3887 | 0.3330 | 0.0997 |
| 0.9006 | 11.4767 | 2100 | 0.3863 | 0.3394 | 0.1008 |
| 0.8309 | 11.7507 | 2150 | 0.3875 | 0.3366 | 0.1005 |
| 0.7627 | 12.0219 | 2200 | 0.3787 | 0.3302 | 0.0995 |
| 0.9672 | 12.2959 | 2250 | 0.3747 | 0.3304 | 0.0982 |
| 0.8601 | 12.5699 | 2300 | 0.3842 | 0.3363 | 0.0993 |
| 0.9406 | 12.8438 | 2350 | 0.3884 | 0.3349 | 0.1003 |
| 1.0528 | 13.1151 | 2400 | 0.3882 | 0.3296 | 0.1005 |
| 0.8922 | 13.3890 | 2450 | 0.3703 | 0.3237 | 0.0980 |
| 0.9111 | 13.6630 | 2500 | 0.3727 | 0.3215 | 0.0989 |
| 0.6972 | 13.9370 | 2550 | 0.3687 | 0.3170 | 0.0976 |
| 0.7772 | 14.2082 | 2600 | 0.3752 | 0.3246 | 0.0973 |
| 0.8084 | 14.4822 | 2650 | 0.3897 | 0.3268 | 0.0999 |
| 0.8432 | 14.7562 | 2700 | 0.3884 | 0.3346 | 0.1028 |
| 0.7271 | 15.0274 | 2750 | 0.3859 | 0.3296 | 0.0985 |
| 0.7835 | 15.3014 | 2800 | 0.3949 | 0.3271 | 0.0971 |
Framework versions
- Transformers 5.16.1
- Pytorch 2.11.0+cu128
- Datasets 4.8.5
- Tokenizers 0.23.1