Extracting Drug-Drug and Protein-Protein Interactions from Text using a Continuous Update of Tree-Transformers

Sudipta Singha Roy, Robert E. Mercer


Abstract
Understanding biological mechanisms requires determining mutual protein-protein interactions (PPI). Obtaining drug-drug interactions (DDI) from scientific articles provides important information about drugs. Extracting such medical entity interactions from biomedical articles is challenging due to complex sentence structures. To address this issue, our proposed model utilizes tree-transformers to generate the sentence representation first, and then a sentence-to-word update step to fine-tune the word embeddings which are again used by the tree-transformers to generate enriched sentence representations. Using the tree-transformers helps the model preserve syntactical information and provide semantic information. The fine-tuning provided by the continuous update step adds improved semantics to the representation of each sentence. Our model outperforms other prominent models with a significant performance boost on the five standard PPI corpora and a performance boost on the one benchmark DDI corpus that are used in our experiments.
Anthology ID:
2023.bionlp-1.25
Volume:
The 22nd Workshop on Biomedical Natural Language Processing and BioNLP Shared Tasks
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Dina Demner-fushman, Sophia Ananiadou, Kevin Cohen
Venue:
BioNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
280–291
Language:
URL:
https://aclanthology.org/2023.bionlp-1.25
DOI:
10.18653/v1/2023.bionlp-1.25
Bibkey:
Cite (ACL):
Sudipta Singha Roy and Robert E. Mercer. 2023. Extracting Drug-Drug and Protein-Protein Interactions from Text using a Continuous Update of Tree-Transformers. In The 22nd Workshop on Biomedical Natural Language Processing and BioNLP Shared Tasks, pages 280–291, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Extracting Drug-Drug and Protein-Protein Interactions from Text using a Continuous Update of Tree-Transformers (Singha Roy & Mercer, BioNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.bionlp-1.25.pdf