Corpus ID: 631114

Task 1: ShARe/CLEF eHealth Evaluation Lab 2013

@inproceedings{Mowery2013Task1S,
  title={Task 1: ShARe/CLEF eHealth Evaluation Lab 2013},
  author={Danielle L. Mowery and Sumithra Velupillai and Brett R. South and Lee M. Christensen and David Mart{\'i}nez and Liadh Kelly and Lorraine Goeuriot and No{\'e}mie Elhadad and Sameer Pradhan and Guergana K. Savova and Wendy W. Chapman},
  booktitle={CLEF},
  year={2013}
}
This report outlines the Task 1 of the ShARe/CLEF eHealth evaluation lab pilot. This task focused on identification (1a) and normalization (1b) of diseases and disorders in clinical reports. It used annotations from the ShARe corpus. A total of 22 teams competed in Task 1a and 17 of them also participated Task 1b. The best systems had an F1 score of 0.75 (0.80 Precision, 0.71 Recall) in Task 1a and an accuracy of 0.59 in Task 1b. The organizers have made the text corpora, annotations, and… Expand
Overview of the CLEF eHealth Evaluation Lab 2019
TLDR
An overview of the seventh annual edition of the CLEF eHealth evaluation lab is provided and the resources created for these tasks and evaluation methodology adopted are described. Expand
SemEval-2014 Task 7: Analysis of Clinical Text
TLDR
This task was a follow-up to the ShARe/CLEF eHealth 2013 shared task, subtasks 1a and 1b, 2 but using a larger test set and the best group had the best strict accuracy. Expand
Evaluating the state of the art in disorder recognition and normalization of the clinical narrative
TLDR
The task of disorder normalization is more challenging than that of identification, and the ShARe corpus is available to the community as a reference standard for future studies. Expand
ShARe/CLEF eHealth Evaluation Lab 2013, Task 3: Information Retrieval to Address Patients' Questions when Reading Clinical Reports
TLDR
This paper presents the results of task 3 of the ShARe/CLEF eHealth Evaluation Lab 2013, investigating the effect of using additional information such as the discharge summaries and external resources such as medical ontologies on the IR eectiveness. Expand
Overview of the CLEF eHealth Evaluation Lab 2015
TLDR
This paper reports on the 3rd CLEFeHealth evaluation lab, which continues the evaluation resource building activities for the medical domain and focuses on easing patients and nurses in authoring, understanding, and accessing eHealth information. Expand
Overview of the ShARe/CLEF eHealth Evaluation Lab 2013
TLDR
An evaluation lab with an aim to support the continuum of care by developing methods and resources that make clinical reports in English easier to understand for patients, and which helps them in finding information related to their condition. Expand
Normalizing acronyms and abbreviations to aid patient understanding of clinical texts: ShARe/CLEF eHealth Challenge 2013, Task 2
TLDR
The Consumer Health Vocabulary could enrich its knowledge base with missed concept unique identifiers from the ShARe test set to further support patient understanding of unfamiliar medical terms. Expand
ThinkMiners: Disorder Recognition using Conditional Random Fields and Distributional Semantics
TLDR
A Conditional Random Fields based approach to recognize disorder entities and participated in the task A and developed a clinical disorder recognition system. Expand
A Light-weight & Robust System for Clinical Concept Disambiguation
TLDR
This paper presents a system for the normalization of concept mentions in clinical narratives that combines two unsupervised approaches that are easy to implement and computationally inexpensive and shows that some ambiguities can only be resolved by adapting to annotation guidelines and preferences which are solved via the introduction of heuristics. Expand
IxaMed: Applying Freeling and a Perceptron Sequential Tagger at the Shared Task on Analyzing Clinical Texts
TLDR
This paper presents the results of the IxaMed team at the SemEval-2014 Shared Task 7 on Analyzing Clinical Texts, presenting a general-purpose morphosyntactic analyzer enriched with the SNOMED CT terminology content, and a perceptron sequential tagger based on a Global Linear Model. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 53 REFERENCES
ShARe/CLEF eHealth Evaluation Lab 2014, Task 3: User-centred Health Information Retrieval
TLDR
This paper presents the results of task 3 of the ShARe/CLEF eHealth Evaluation Lab 2014, which investigated the eectiveness of information retrieval systems in a monolingual and a multilingual context. Expand
Task 2 : ShARe/CLEF eHealth Evaluation Lab 2014
TLDR
This paper reports on Task 2 of the 2014 Share/CLEF eHealth evaluation lab which extended Task 1 of the 2013 ShARe/cleF e health evaluation lab by focusing on template filling of disorder attributes by instructed participants to develop a system which kept or updated a default attribute value for each task. Expand
Overview of the ShARe/CLEF eHealth Evaluation Lab 2013
TLDR
An evaluation lab with an aim to support the continuum of care by developing methods and resources that make clinical reports in English easier to understand for patients, and which helps them in finding information related to their condition. Expand
The CLEF Corpus: Semantic Annotation of Clinical Text
TLDR
An annotation methodology is described and encouraging initial results of inter-annotator agreement are reported, and Comparisons are made between different text sub-genres, and between annotators with different skills. Expand
Task 1 of the CLEF eHealth Evaluation Lab 2014
TLDR
The FLPolytech team augmented the discharge summary by linking to external resources, insert- ing structure related to timing of the information need, and providing meta-information, e.g., how to make future appointments. Expand
Extracting medication information from clinical text
TLDR
Although rule-based systems dominated the top 10, the best performing system was a hybrid and durations and reasons were the most difficult for all systems to detect. Expand
Evaluating temporal relations in clinical text: 2012 i2b2 Challenge
TLDR
A corpus of discharge summaries annotated with temporal information was provided to be used for the development and evaluation of temporal reasoning systems, and the best systems overwhelmingly adopted a rule based approach for value normalization. Expand
Community annotation experiment for ground truth generation for the i2b2 medication challenge
TLDR
The authors found that the community annotators achieved comparable inter-annotator agreement to expert annotators, regardless of whether the experts annotated from the pool, indicating the value of the community as a source of high-quality ground truth even on intricate and domain-specific annotation tasks. Expand
2010 i2b2/VA challenge on concepts, assertions, and relations in clinical text
TLDR
The 2010 i2b2/VA Workshop on Natural Language Processing Challenges for Clinical Records presented three tasks, which showed that machine learning approaches could be augmented with rule-based systems to determine concepts, assertions, and relations. Expand
A shared task involving multi-label classification of clinical free text
TLDR
A shared task involving the assignment of ICD-9-CM codes to radiology reports resulted in the first freely distributable corpus of fully anonymized clinical text, suggesting that human-like performance on this task is within the reach of currently available technologies. Expand
...
1
2
3
4
5
...