Find in Library
Search millions of books, articles, and more
Indexed Open Access Databases
Coreference Resolution Based on High-Dimensional Multi-Scale Information
oleh: Yu Wang, Zenghui Ding, Tao Wang, Shu Xu, Xianjun Yang, Yining Sun
Format: | Article |
---|---|
Diterbitkan: | MDPI AG 2024-06-01 |
Deskripsi
Coreference resolution is a key task in Natural Language Processing. It is difficult to evaluate the similarity of long-span texts, which makes text-level encoding somewhat challenging. This paper first compares the impact of commonly used methods to improve the global information collection ability of the model on the BERT encoding performance. Based on this, a multi-scale context information module is designed to improve the applicability of the BERT encoding model under different text spans. In addition, improving linear separability through dimension expansion. Finally, cross-entropy loss is used as the loss function. After adding BERT and span BERT to the module designed in this article, F1 increased by 0.5% and 0.2%, respectively.