Numerical Claim Detection in Finance: A New Financial Dataset, Weak-Supervision Model, and Market Analysis

Agam Shah, Arnav Hiray, Pratvi Shah, Arkaprabha Banerjee, Anushka Singh +4 more
2/18/2024
cs.CLcs.LGq-fin.CP
benchmark-dataset

No official code found. Best implementation: gtfintechlab/fin-num-claim (0 stars, last commit 2024-10-04).

Abstract

In this paper, we investigate the influence of claims in analyst reports and earnings calls on financial market returns, considering them as significant quarterly events for publicly traded companies. To facilitate a comprehensive analysis, we construct a new financial dataset for the claim detection task in the financial domain. We benchmark various language models on this dataset and propose a novel weak-supervision model that incorporates the knowledge of subject matter experts (SMEs) in the aggregation function, outperforming existing approaches. We also demonstrate the practical utility of our proposed model by constructing a novel measure of optimism. Here, we observe the dependence of earnings surprise and return on our optimism measure. Our dataset, models, and code are publicly (under CC BY 4.0 license) available on GitHub.

View on arXivView PDF

Code Implementations(1)

gtfintechlab/fin-num-claimCommunity100%
01Python, Jupyter NotebookOct 4, 20242 years agoNOASSERTION

Similar Papers

Financial Statement Analysis with Large Language Models

78% match2024

Financial misstatement detection: a realistic evaluation

78% match2023

From SEC Filings to Financial Signals: Evaluating LLMs on Stock Market Reactions and Analyst Forecasts

78% match2026

FinReport: Explainable Stock Earnings Forecasting via News Factor Analyzing Model

78% match1 repo1092024

Evaluating Large Language Models for Stance Detection on Financial Targets from SEC Filing Reports and Earnings Call Transcripts

78% match2025

MiMIC: Multi-Modal Indian Earnings Calls Dataset to Predict Stock Prices

77% match2025

Cite this paper

@article{shah2024numerical,
  title  = {Numerical Claim Detection in Finance: A New Financial Dataset, Weak-Supervision Model, and Market Analysis},
  author = {Agam Shah and Arnav Hiray and Pratvi Shah and Arkaprabha Banerjee and Anushka Singh and Dheeraj Eidnani and Sahasra Chava and Bhaskar Chaudhury and Sudheer Chava},
  year   = {2024},
  eprint = {2402.11728},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2402.11728v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2402.11728.svg)](https://codeofpaper.com/paper/2402.11728)

Discussion