Introduction
Bimonthly, started in 1957
Administrator
Shanxi Provincial Education Department
Sponsor
Taiyuan University of Technology
Publisher
Ed. Office of Journal of TYUT
Editor-in-Chief
SUN Hongbin
ISSN: 1007-9432
CN: 14-1220/N
Administrator
Shanxi Provincial Education Department
Sponsor
Taiyuan University of Technology
Publisher
Ed. Office of Journal of TYUT
Editor-in-Chief
SUN Hongbin
ISSN: 1007-9432
CN: 14-1220/N
location: home > paper >
Research on the Method and Application of Joint Extraction of Entity Relations Based on Multihop Attention
DOI:
10.16355/j.cnki.issn1007-9432tyut.2022.01.008
Received:
Accepted:
Corresponding author | Institute | |
WANG Hong | School of Computer Science and Technology, Civil Aviation University of China |
abstract:
Aiming at the problems of lack of potential implicit relation mining between entities and insufficient head entity information extraction in existing methods, a head entityenhanced multihop attention implicit relations joint mining model MultiAir (multihop attention implicit relations joint mining method) was proposed. The method first uses the BERT (bidirectional encoder representations from transformers) model to encode the features of the input sentence and predicts the position of the head entity through the Sigmoid function, and then uses the bidirectional gated recurrent unit (BiGRU) to enhance the feature of the head entity. After making full use of the highlevel information of the head entities, the model can output the possible starting and ending positions of the tail entities with multiple relationships. Then the model continues to use the tail entities as the head entities of the next hop and iteratively perform the prediction of the multihop tail entities. At the same time, the model uses the attention weight to dynamically adjust the features of the learned entities and relationships so as to realize the mining of potential relationship triples in the plain text. The MultiAir model has made good improvements in both the public dataset NYT and the civil aviation emergency dataset.
Keywords:
implicit relations; attention mechanism; civil aviation emergency; joint mining; BiGRU; feature enhancement