The models are available at:
https://huggingface.co/alexyalunin/RuBioBERT
https://huggingface.co/alexyalunin/RuBioRoBERTa
-
Download RuMedBench and install
requirements.txt
-
For pre-training run
scripts/1_pretrain.sh
orscripts/1_pretrain_distributed.sh
-
For fine-tuning on RuMedBench run
scripts/2_RuMedBench.sh
If you have any questions, please post a Github issue.
If you find this repo useful, please cite as: