Self-evolving vision transformer for chest X-ray diagnosis through knowledge distillation
oleh: Sangjoon Park, Gwanghyun Kim, Yujin Oh, Joon Beom Seo, Sang Min Lee, Jin Hwan Kim, Sungjun Moon, Jae-Kwang Lim, Chang Min Park, Jong Chul Ye
| Format: | Article |
|---|---|
| Diterbitkan: | Nature Portfolio 2022-07-01 |
Deskripsi
Although deep learning-based computer-aided diagnosis systems have recently achieved expert level performance, developing a robust model requires large, high-quality data with annotations. Here, the authors present a framework which can improve the performance of vision transformer simultaneously with self-supervision and self-training.