Find in Library
Search millions of books, articles, and more
Indexed Open Access Databases
An Adaptive Mixup Hard Negative Sampling for Zero-Shot Entity Linking
oleh: Shisen Cai, Xi Wu, Maihemuti Maimaiti, Yichang Chen, Zhixiang Wang, Jiong Zheng
Format: | Article |
---|---|
Diterbitkan: | MDPI AG 2023-10-01 |
Deskripsi
Recently, the focus of entity linking research has centered on the zero-shot scenario, where the entity purposed to be labeled at the time of testing was never observed during the training phase, or it may belong to a different domain than the source domain. Current studies have used BERT as the base encoder, as it effectively establishes distributional links between source and target domains. The currently available negative sampling methods all use an extractive approach, which makes it difficult for the models to learn diverse and more challenging negative samples. To address this problem, we propose a generative negative sampling method, adaptive_mixup_hard, which generates more difficult negative entities by fusing the features of both positive and negative samples on top of hard negative sampling and introduces a transformable adaptive parameter, <i>W</i>, to increase the diversity of negative samples. Next, we fuse our method with the Biencoder architecture and evaluate its performance under three different score functions. Ultimately, experimental results on the standard benchmark dataset, Zeshel, demonstrate the effectiveness of our method.