Trusting Language Models in Education

Jogi Suda Neto, Li Deng, Thejaswi Raya, Reza Shahbazi, Nick Liu +4 more
8/7/2023
cs.CLcs.AI

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

Language Models are being widely used in Education. Even though modern deep learning models achieve very good performance on question-answering tasks, sometimes they make errors. To avoid misleading students by showing wrong answers, it is important to calibrate the confidence - that is, the prediction probability - of these models. In our work, we propose to use an XGBoost on top of BERT to output the corrected probabilities, using features based on the attention mechanism. Our hypothesis is that the level of uncertainty contained in the flow of attention is related to the quality of the model's response itself.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

IMPACTX: Improving Model Performance by Appropriately predicting CorrecT eXplanations

84% match2025

Language Model Uncertainty Quantification with Attention Chain

83% match1 repo112025

Improving Prediction Performance and Model Interpretability through Attention Mechanisms from Basic and Applied Research Perspectives

83% match2023

The Confidence-Competence Gap in Large Language Models: A Cognitive Study

82% match2023

Learning to Look: Cognitive Attention Alignment with Vision-Language Models

82% match2025

Improving the Reliability of Large Language Models by Leveraging Uncertainty-Aware In-Context Learning

82% match2023

Cite this paper

@article{neto2023trusting,
  title  = {Trusting Language Models in Education},
  author = {Jogi Suda Neto and Li Deng and Thejaswi Raya and Reza Shahbazi and Nick Liu and Adhitya Venkatesh and Miral Shah and Neeru Khosla and Rodrigo Capobianco Guido},
  year   = {2023},
  eprint = {2308.03866},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2308.03866v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2308.03866.svg)](https://codeofpaper.com/paper/2308.03866)

Discussion