Training issues latest version

[WoutDeRijck]

System Info

• transformers version: 4.48.0.dev0
• Platform: Linux-5.15.167.4-microsoft-standard-WSL2-x86_64-with-glibc2.39
• Python version: 3.11.11
• Huggingface_hub version: 0.27.0
• Safetensors version: 0.4.5
• Accelerate version: 1.2.1
• Accelerate config: not found
• PyTorch version (GPU?): 2.5.1+cu121 (True)
• Tensorflow version (GPU?): not installed (NA)
• Flax version (CPU?/GPU?/TPU?): not installed (NA)
• Jax version: not installed
• JaxLib version: not installed
• Using distributed or parallel set-up in script?:
• Using GPU in script?:
• GPU type: NVIDIA GeForce RTX 3060 Laptop GPU

Who can help?

No response

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction

Steps to reproduce:

1. Clone ModernBert repo
2. Install latest transformers version (4.48.0-dev0)
3. Run examples/train_st.py to finetune modernbert.

Expected behavior

I would expect no errors.
However when building transformers from an earlier commit it works.

pip install git+https://github.com/huggingface/transformers.git@f42084e6411c39b74309af4a7d6ed640c01a4c9e

So I think something broke during the latest commits.

[athinaanv]

Greetings from Greece!
I would like to express my interest in contributing to this project. I believe I can provide valuable assistance to the team.Look forward to the opportunity to collaborate and contribute.