TLDR at SemEval-2024 Task 2: T5-generated clinical-Language summaries for DeBERTa Report Analysis

Spandan Das, Vinay Samuel, Shahriar Noroozizadeh
4/14/2024
cs.CLcs.AIcs.LG

No confident code implementation found for this paper.

Abstract

This paper introduces novel methodologies for the Natural Language Inference for Clinical Trials (NLI4CT) task. We present TLDR (T5-generated clinical-Language summaries for DeBERTa Report Analysis) which incorporates T5-model generated premise summaries for improved entailment and contradiction analysis in clinical NLI tasks. This approach overcomes the challenges posed by small context windows and lengthy premises, leading to a substantial improvement in Macro F1 scores: a 0.184 increase over truncated premises. Our comprehensive experimental evaluation, including detailed error analysis and ablations, confirms the superiority of TLDR in achieving consistency and faithfulness in predictions against semantically altered inputs.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

SEME at SemEval-2024 Task 2: Comparing Masked and Generative Language Models on Natural Language Inference for Clinical Trials

85% match2024

SemEval-2024 Task 2: Safe Biomedical Natural Language Inference for Clinical Trials

83% match1 repo2024

DFKI-NLP at SemEval-2024 Task 2: Towards Robust LLMs Using Data Perturbations and MinMax Training

83% match2024

NLI4CT: Multi-Evidence Natural Language Inference for Clinical Trial Reports

82% match1 repo142023

Lisbon Computational Linguists at SemEval-2024 Task 2: Using A Mistral 7B Model and Data Augmentation

82% match1 repo2024

SemEval-2023 Task 7: Multi-Evidence Natural Language Inference for Clinical Trial Data

82% match2023

Cite this paper

@article{das2024tldr,
  title  = {TLDR at SemEval-2024 Task 2: T5-generated clinical-Language summaries for DeBERTa Report Analysis},
  author = {Spandan Das and Vinay Samuel and Shahriar Noroozizadeh},
  year   = {2024},
  eprint = {2404.09136},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2404.09136v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2404.09136.svg)](https://codeofpaper.com/paper/2404.09136)

Discussion