Oversampling effect in pretraining for bidirectional encoder representations from transformers (BERT) to localize medical BERT and enhance biomedical BERT.
Shoya WadaToshihiro TakedaKatsuki OkadaShirou ManabeShozo KonishiJun KamoharaYasushi MatsumuraPublished in: Artif. Intell. Medicine (2024)