Chinese named entity recognition method based on BERT and fusion attention mechanism

Zhijun Bao; Shiyi Wang

doi:10.1117/12.2634541

4 May 2022 Chinese named entity recognition method based on BERT and fusion attention mechanism

Zhijun Bao, Shiyi Wang

Proceedings Volume 12172, International Conference on Electronic Information Engineering and Computer Communication (EIECC 2021); 121720E (2022) https://doi.org/10.1117/12.2634541
Event: International Conference on Electronic Information Engineering and Computer Communication (EIECC 2021), 2021, Nanchang, China

Abstract

To address the existing problems of Chinese named entity recognition, the traditional pre-training model fails to characterize the multiple meanings of words and the model does not sufficiently dig into the potential semantic features at the Chinese word level. This paper proposes a Chinese named entity recognition method based on BERT and fused attention mechanism. First, the word vector features are obtained by the pre-training of large-scale corpus with the use of BERT model to deal with the problem of multiple meanings in one word. Then, the contextual features are recognised through the use of BiLSTM and thus passing the results into the attention layer. This is to exploit the potential semantic features within the text in order to face the shortcomings of unpromising relevance with the given information of semantic feature in previous models. Last, the output results are annotated in sequential order by CRF to reduce the probability of incorrect labelling. Through comparative experiments, the F1 values of this paper's model are 95.12% and 95.43% on MSRA corpus and People's Daily corpus datasets, respectively, which are both better than the comparison models, revealing the effective improvement in the named entity recognition.

Citation Download Citation

Zhijun Bao and Shiyi Wang "Chinese named entity recognition method based on BERT and fusion attention mechanism", Proc. SPIE 12172, International Conference on Electronic Information Engineering and Computer Communication (EIECC 2021), 121720E (4 May 2022); https://doi.org/10.1117/12.2634541

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Data modeling

Pollution

Feature extraction

Performance modeling

Transformers

Associative arrays

Computer programming

Show All Keywords

Keywords/Phrases

Search In:

Publication Years