This repository contains the code used for distillation and fine-tuning of compact biomedical transformers that have been introduced in the paper "On The Effectiveness of Compact Biomedical Transformers"
-
Updated
Mar 26, 2024 - Python
This repository contains the code used for distillation and fine-tuning of compact biomedical transformers that have been introduced in the paper "On The Effectiveness of Compact Biomedical Transformers"
Add a description, image, and links to the distilbiobert topic page so that developers can more easily learn about it.
To associate your repository with the distilbiobert topic, visit your repo's landing page and select "manage topics."