DSR: A Collection for the Evaluation of Graded Disease-Symptom Relations

Authors: 
Markus Zlabinger
Sebastian Hofstätter
Navid Rekabsaz
Allan Hanbury
Type: 
Proceedings contribution
Proceedings: 
Advances in Information Retrieval 42nd European Conference on IR Research, ECIR 2020, Lisbon, Portugal, April 14-17, 2020, Proceedings, Part II
Publisher: 
Springer Nature Switzerland AG 2021
Pages: 
433 - 440
ISBN: 
ISBN: 978-3-030-45441-8
Year: 
2020
Abstract: 
The effective extraction of ranked disease-symptom relationships is a critical component in various medical tasks, including computer-assisted medical diagnosis or the discovery of unexpected associations between diseases. While existing disease-symptom relationship extraction methods are used as the foundation in the various medical tasks, no collection is available to systematically evaluate the performance of such methods. In this paper, we introduce the Disease-Symptom Relation Collection (dsr-collection), created by five physicians as expert annotators. We provide graded symptom judgments for diseases by differentiating between relevant symptoms and primary symptoms. Further, we provide several strong baselines, based on the methods used in previous studies. The first method is based on word embeddings, and the second on co-occurrences of MeSH-keywords of medical articles. For the co-occurrence method, we propose an adaption in which not only keywords are considered, but also the full text of medical articles. The evaluation on the dsr-collection shows the effectiveness of the proposed adaption in terms of nDCG, precision, and recall.
TU Focus: 
Information and Communication Technology
Reference: 

M. Zlabinger, S. Hofstätter, N. Rekabsaz, A. Hanbury:
"DSR: A Collection for the Evaluation of Graded Disease-Symptom Relations";
in: "Advances in Information Retrieval 42nd European Conference on IR Research, ECIR 2020, Lisbon, Portugal, April 14-17, 2020, Proceedings, Part II", Lecture Notes in Computer Science, vol 12036; Springer Nature Switzerland AG 2021, 2020, ISBN: 978-3-030-45441-8, S. 433 - 440.

Zusätzliche Informationen

Last changed: 
09.01.2021 03:18:22
TU Id: 
294082
Accepted: 
Accepted
Invited: 
Department Focus: 
Business Informatics
Abstract German: 
Author List: 
M. Zlabinger, S. Hofstätter, N. Rekabsaz, A. Hanbury