%0 Journal Article %A Daiyi LI %A Xiangsheng ZHOU %A Yangming ZHANG %A Yaofeng TU %A Zongmin MA %T End-to-End Chinese Entity Recognition Based on BERT-BiLSTM-ATT-CRF %D 2022 %R 10.12142/ZTECOM.2022S1005 %J ZTE Communications %P 27-35 %V 20 %N S1 %X

Traditional named entity recognition methods need professional domain knowledge and a large amount of human participation to extract features, as well as the Chinese named entity recognition method based on a neural network model, which brings the problem that vector representation is too singular in the process of character vector representation. To solve the above problem, we propose a Chinese named entity recognition method based on the BERT-BiLSTM-ATT-CRF model. Firstly, we use the bidirectional encoder representations from transformers (BERT) pre-training language model to obtain the semantic vector of the word according to the context information of the word; Secondly, the word vectors trained by BERT are input into the bidirectional long-term and short-term memory network embedded with attention mechanism (BiLSTM-ATT) to capture the most important semantic information in the sentence; Finally, the conditional random field (CRF) is used to learn the dependence between adjacent tags to obtain the global optimal sentence level tag sequence. The experimental results show that the proposed model achieves state-of-the-art performance on both Microsoft Research Asia (MSRA) corpus and people’s daily corpus, with F1 values of 94.77% and 95.97% respectively.

%U http://zte.magtechjournal.com/EN/10.12142/ZTECOM.2022S1005