CODER: Knowledge-infused cross-lingual medical term embedding for term normalization. Academic Article uri icon

Overview

abstract

  • OBJECTIVE: This paper aims to propose knowledge-aware embedding, a critical tool for medical term normalization. METHODS: We develop CODER (Cross-lingual knowledge-infused medical term embedding) via contrastive learning based on a medical knowledge graph (KG) named the Unified Medical Language System, and similarities are calculated utilizing both terms and relation triplets from the KG. Training with relations injects medical knowledge into embeddings and can potentially improve their performance as machine learning features. RESULTS: We evaluate CODER based on zero-shot term normalization, semantic similarity, and relation classification benchmarks, and the results show that CODER outperforms various state-of-the-art biomedical word embeddings, concept embeddings, and contextual embeddings. CONCLUSION: CODER embeddings excellently reflect semantic similarity and relatedness of medical concepts. One can use CODER for embedding-based medical term normalization or to provide features for machine learning. Similar to other pretrained language models, CODER can also be fine-tuned for specific tasks. Codes and models are available at https://github.com/GanjinZero/CODER.

publication date

  • January 4, 2022

Research

keywords

  • Natural Language Processing
  • Unified Medical Language System

Identity

Scopus Document Identifier

  • 85122317264

Digital Object Identifier (DOI)

  • 10.1016/j.jbi.2021.103983

PubMed ID

  • 34990838

Additional Document Info

volume

  • 126