2611005659
  • Open Access
  • Article

Improving Named Entity Recognition Using Multi-Domain Knowledge Transfer

  • Ziyan Wang 1,   
  • Peng Zhu 1,*,   
  • Yuanzhe Chen 2 and 
  • Qinyuan Liu 1

Received: 21 April 2026 | Revised: 12 July 2026 | Accepted: 06 November 2026 | Published: 13 November 2026

Abstract

Neural networks have been widely used for named entity recognition (NER) and have shown stateof-the-art performance. However, in real applications, we often need to consider new types of entities in new domains where we do not have sufficient annotated data, which inevitably leads to a degradation in NER model performance. To this end, we propose an end-to-end domain adversarial named entity recognition (DANER) model. Unlike previous rule-based methods, DANER explicitly addresses NER-specific token-level context shifts by deeply integrating a gradient reversal layer with a sequence tagging architecture. Extensive experiments on our newly constructed FIND-2026, to our knowledge, the first large-scale Chinese NER corpus explicitly enriched with fine-grained domain annotations, demonstrate the superiority of our proposed model over six state-of-the-art methods. Moreover, on two public datasets (MSRA and Weibo), our approach achieves remarkable zero-shot knowledge transfer capabilities, yielding an absolute F-score gain of more than 22 percentage points compared with non-domain baselines without utilizing any target-domain labels.

References 

  • 1.

    Zhu, P.; Cheng, D.; Yang, F.; et al. Improving Chinese Named Entity Recognition by Large-Scale Syntactic Dependency Graph. IEEE ACM Trans. Audio Speech Lang. Process. 2022, 30, 979–991. https://doi.org/10.1109/taslp.2022.3153261.

  • 2.

    Feng, X.; Feng, X.; Qin, B.; et al. Improving Low Resource Named Entity Recognition using Cross-lingual Knowledge Transfer. In Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence (IJCAI-18), Stockholm, Sweden, 13–19 July 2018; pp. 4071–4077. https://doi.org/10.24963/ijcai.2018/566.

  • 3.

    Chiu, J.P.C.; Nichols, E. Named Entity Recognition with Bidirectional LSTM-CNNs. Trans. Assoc. Comput. Linguist. 2016, 4, 357–370. https://doi.org/10.1162/tacl_a_00104.

  • 4.

    Zhu, P.; Li, Y.; Hu, Y.; et al. MCI-GRU: Stock prediction model based on multi-head cross-attention and improved GRU. Neurocomputing 2025, 638, 130168. https://doi.org/10.1016/j.neucom.2025.130168.

  • 5.

    Huang, Z.; Xu, W.; Yu, K. Bidirectional LSTM-CRF Models for Sequence Tagging. arXiv 2015, arXiv:1508.01991.

  • 6.

    Mikolov, T.; Sutskever, I.; Chen, K.; et al. Distributed representations of words and phrases and their compositionality. In Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA, 5–10 December 2013; pp. 3111–3119.

  • 7.

    Pennington, J.; Socher, R.; Manning, C. Glove: Global vectors for word representation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, Doha, Qatar, 25–29 October 2014; pp. 1532–1543.

  • 8.

    Devlin, J.; Chang, M.W.; Lee, K.; et al. Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA, 2–7 June 2019; pp. 4171–4186.

  • 9.

    Sasikumar, N.; Mantri, K.S.I. Transfer learning for low-resource clinical named entity recognition. In Proceedings of the Clinical Natural Language Processing Workshop, Toronto, ON, Canada, 14 July 2023; pp. 514–518.

  • 10.

    Ganin, Y.; Ustinova, E.; Ajakan, H.; et al. Domain-adversarial training of neural networks. J. Mach. Learn. Res. 2016, 17, 2096–2030.

  • 11.

    Bousmalis, K.; Silberman, N.; Dohan, D.; et al. Unsupervised pixel-level domain adaptation with generative adversarial networks. In Proceedings of the The IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017; pp. 3722–3731.

  • 12.

    Rozantsev, A.; Salzmann, M.; Fua, P. Beyond Sharing Weights for Deep Domain Adaptation. IEEE Trans. Pattern Anal. Mach. Intell. 2018, 41, 801–814. https://doi.org/10.1109/tpami.2018.2814042.

  • 13.

    Lotte, F.; Bougrain, L.; Cichocki, A.; et al. A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update. J. Neural Eng. 2018, 15, 031005. https://doi.org/10.1088/1741-2552/aab2f2.

  • 14.

    Wu, D.; Lee, W.S.; Ye, N.; et al. Domain adaptive bootstrapping for named entity recognition. In Proceedings of the 2009 Conference, Singapore, 6–7 August 2009; pp. 1523–1532. https://doi.org/10.3115/1699648.1699699.

  • 15.

    Chiticariu, L.; Krishnamurthy, R.; Li, Y.; et al. Domain adaptation of rule-based annotators for named-entity recognition tasks. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, Cambridge, MA, USA, 9–11 October 2010; pp. 1002–1012.

  • 16.

    Curran, J.R.; Murphy, T.; Scholz, B. Minimising semantic drift with mutual exclusion bootstrapping. In Proceedings of the Conference of the Pacific Association for Computational Linguistics, Melbourne, Australia, 19–21 September 2007; pp. 172–180.

  • 17.

    Li, Z.; He, Y.; Gu, B.; et al. Diagnosing and Minimizing Semantic Drift in Iterative Bootstrapping Extraction. IEEE Trans. Knowl. Data Eng. 2018, 30, 852–865. https://doi.org/10.1109/tkde.2017.2782697.

  • 18.

    Lafferty, J.; McCallum, A.; Pereira, F.C.N. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the International Conference on Machine Learning, Williamstown, MA, USA, 28 June–1 July 2001; pp. 282–289.

  • 19.

    LeCun, Y.; Bengio, Y.; Hinton, G. Deep learning. Nature 2015, 521, 436–444. https://doi.org/10.1038/nature14539.

  • 20.

    Strubell, E.; Verga, P.; Belanger, D.; et al. Fast and accurate entity recognition with iterated dilated convolutions. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, Copenhagen, Denmark, 7–11 September 2017; pp. 2670–2680.

  • 21.

    Lample, G.; Ballesteros, M.; Subramanian, S.; et al. Neural architectures for named entity recognition. In Proceedings of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, CA, USA, 12–17 June 2016; pp. 260–270.

  • 22.

    Yang, Z.; Salakhutdinov, R.; Cohen, W.W. Transfer learning for sequence tagging with hierarchical recurrent networks. In Proceedings of the International Conference on Learning Representations, Toulon, France, 24–26 April 2017; pp. 1–10.

  • 23.

    Peters, M.E.; Ammar, W.; Bhagavatula, C.; et al. Semi-supervised sequence tagging with bidirectional language models. In Proceedings of the Annual Meeting of the Association for Computational Linguistics, Vancouver, BC, Canada, 30 July–4 August 2017; pp. 1756–1765.

  • 24.

    Akbik, A.; Blythe, D.; Vollgraf, R. Contextual string embeddings for sequence labeling. In Proceedings of the International Conference on Computational Linguistics, Santa Fe, NM, USA, 20–26 August 2018; pp. 1638–1649.

  • 25.

    Zhao, D.; Chen, X.; Chen, Y. Named Entity Recognition for Chinese Texts on Marine Coral Reef Ecosystems Based on the BERT-BiGRU-Att-CRF Model. Appl. Sci. 2024, 14, 5743. https://doi.org/10.3390/app14135743.

  • 26.

    Pan, S.J.; Yang, Q. A Survey on Transfer Learning. IEEE Trans. Knowl. Data Eng. 2010, 22, 1345–1359. https://doi.org/10.1109/tkde.2009.191.

  • 27.

    Pan, S.J.; Tsang, I.W.; Kwok, J.T.; et al. Domain Adaptation via Transfer Component Analysis. IEEE Trans. Neural Netw. 2011, 22, 199–210. https://doi.org/10.1109/tnn.2010.2091281.

  • 28.

    Fernando, B.; Habrard, A.; Sebban, M.; et al. Unsupervised Visual Domain Adaptation Using Subspace Alignment. In Proceedings of the 2013 IEEE International Conference on Computer Vision (ICCV), Sydney, Australia, 1–8 December 2013; pp. 2960–2967. https://doi.org/10.1109/iccv.2013.368.

  • 29.

    Long, M.; Zhu, H.; Wang, J.; et al. Unsupervised domain adaptation with residual transfer networks. In Proceedings of the Advances in Neural Information Processing Systems, Barcelona, Spain, 5–10 December 2016; pp. 136–144.

  • 30.

    Tzeng, E.; Hoffman, J.; Saenko, K.; et al. Adversarial discriminative domain adaptation. In Proceedings of the Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017; pp. 7167–7176.

  • 31.

    Chen, Y.H.; Chen, W.Y.; Chen, Y.T.; et al. No more discrimination: Cross city adaptation of road scene segmenters. In Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy, 22–29 October 2017; pp. 1992–2001.

  • 32.

    Panareda Busto, P.; Iqbal, A.; Gall, J. Open Set Domain Adaptation for Image and Action Recognition. IEEE Trans. Pattern Anal. Mach. Intell. 2018, 42, 413–429. https://doi.org/10.1109/tpami.2018.2880750.

  • 33.

    Polyak, A.; Taigman, Y.; Wolf, L. Unsupervised Generation of Free-Form and Parameterized Avatars. IEEE Trans. Pattern Anal. Mach. Intell. 2018, 42, 444–459. https://doi.org/10.1109/tpami.2018.2863282.

  • 34.

    Panareda Busto, P.; Gall, J. Open set domain adaptation. In Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy, 22–29 October 2017; pp. 754–763.

  • 35.

    Sankaranarayanan, S.; Balaji, Y.; Castillo, C.D.; et al. Generate to adapt: Aligning domains using generative adversarial networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18–22 June 2018; pp. 8503–8512.

  • 36.

    Cao, Z.; Long, M.; Wang, J.; et al. Partial transfer learning with selective adversarial networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18–22 June 2018; pp. 2724–2732.

  • 37.

    Zheng, Z.; Teng, L.; Zhang, W.; et al. Knowledge Transfer Learning via Dual Density Sampling for Resource-Limited Domain Adaptation. IEEE CAA J. Autom. Sin. 2023, 10, 2269–2291. https://doi.org/10.1109/jas.2023.123342.

  • 38.

    Lu, H.; Wu, J.; Ruan, Y.; et al. A multi-source transfer learning model based on LSTM and domain adaptation for building energy prediction. Int. J. Electr. Power Energy Syst. 2023, 149, 109024. https://doi.org/10.1016/j.ijepes.2023.109024.

  • 39.

    Liu, L.; Shang, J.; Ren, X.; et al. Empower sequence labeling with task-aware neural language model. In Proceedings of the Association for the Advancement of Artificial Intelligence, New Orleans, LA, USA, 2–7 February 2018; pp. 1–8.

  • 40.

    Tzeng, E.; Hoffman, J.; Zhang, N.; et al. Deep Domain Confusion: Maximizing for Domain Invariance. arXiv 2014, arXiv:1412.3474.

  • 41.

    Long, M.; Cao, Y.; Wang, J.; et al. Learning transferable features with deep adaptation networks. In Proceedings of the International Conference on International Conference on Machine Learning, Lille, France, 6–11 July 2015; pp. 97–105.

  • 42.

    Ganin, Y.; Lempitsky, V. Unsupervised domain adaptation by backpropagation. In Proceedings of the International Conference on Machine Learning, Lille, France, 6–11 July 2015; pp. 1180–1189.

  • 43.

    Kingma, D.P.; Ba, J.L. Adam: A method for stochastic optimization. In Proceedings of the International Conference on Learning Representations, San Diego, CA, USA, 7–9 May 2015; pp. 1–15.

  • 44.

    Fan, J.; Furger, A.; Xiu, D. Incorporating Global Industrial Classification Standard Into Portfolio Allocation: A Simple Factor-Based Large Covariance Matrix Estimator With High-Frequency Data. J. Bus. Econ. Stat. 2016, 34, 489–503. https://doi.org/10.1080/07350015.2015.1052458.

  • 45.

    Wang, S.; Sun, X.; Li, X.; et al. GPT-NER: Named entity recognition via large language models. arXiv 2023, arXiv:2304.10428.

  • 46.

    Levow, G.A. The third international Chinese language processing bakeoff: Word segmentation and named entity recognition. In Proceedings of the SIGHAN Workshop on Chinese Language Processing, Sydney, Australia, 22–23 July 2006; pp. 108–117.

  • 47.

    Peng, N.; Dredze, M. Named entity recognition for chinese social media with jointly trained embeddings. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal, 17–21 September 2015; pp. 548–554.

  • 48.

    van der Maaten, L.; Hinton, G.E. Visualizing Data using t-SNE. J. Mach. Learn. Res. 2008, 9, 2579–2605.

  • 49.

    Maaten, L.V.D. Barnes-hut-sne. In Proceedings of the International Conference on Learning Representations, Scottsdale, AZ, USA, 2–4 May 2013; pp. 1–11.

Share this article:
How to Cite
Wang, Z.; Zhu, P.; Chen, Y.; Liu, Q. Improving Named Entity Recognition Using Multi-Domain Knowledge Transfer. International Journal of Network Dynamics and Intelligence 2026, 5 (4), 27. https://doi.org/10.53941/ijndi.2026.100027.
RIS
BibTex
Copyright & License
article copyright Image
Copyright (c) 2026 by the authors.
Article Metrics
58
Article Views
0
Citations