DS@GT eRisk 2024: Sentence Transformers for Social Media Risk Assessment

David Guecha, Aaryan Potdar, Anthony Miyaguchi
7/10/2024
cs.CLcs.IR

No confident code implementation found for this paper.

Abstract

We present working notes for DS@GT team in the eRisk 2024 for Tasks 1 and 3. We propose a ranking system for Task 1 that predicts symptoms of depression based on the Beck Depression Inventory (BDI-II) questionnaire using binary classifiers trained on question relevancy as a proxy for ranking. We find that binary classifiers are not well calibrated for ranking, and perform poorly during evaluation. For Task 3, we use embeddings from BERT to predict the severity of eating disorder symptoms based on user post history. We find that classical machine learning models perform well on the task, and end up competitive with the baseline models. Representation of text data is crucial in both tasks, and we find that sentence transformers are a powerful tool for downstream modeling. Source code and models are available at \url{https://github.com/dsgt-kaggle-clef/erisk-2024}.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Evaluating Transformer Models for Suicide Risk Detection on Social Media

82% match2024

Detection of depression on social networks using transformers and ensembles

82% match2023

Traditional Machine Learning Models and Bidirectional Encoder Representations From Transformer (BERT)-Based Automatic Classification of Tweets About Eating Disorders: Algorithm Development and Validation Study

81% match2024

Depression detection in social media posts using transformer-based models and auxiliary features

81% match2024

Sentiment Informed Sentence BERT-Ensemble Algorithm for Depression Detection

81% match2024

Strategies to Harness the Transformers' Potential: UNSL at eRisk 2023

81% match2023

Cite this paper

@article{guecha2024dsgt,
  title  = {DS@GT eRisk 2024: Sentence Transformers for Social Media Risk Assessment},
  author = {David Guecha and Aaryan Potdar and Anthony Miyaguchi},
  year   = {2024},
  eprint = {2407.08008},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2407.08008v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2407.08008.svg)](https://codeofpaper.com/paper/2407.08008)

Discussion