Evaluating the Performance of Large Language Models for Spanish Language in Undergraduate Admissions Exams

Sabino Miranda, Obdulia Pichardo-Lagunas, Bella Martínez-Seis, Pierre Baldi
12/28/2023
cs.CLcs.AI

No confident code implementation found for this paper. 3 possible matches can be shown below.

Abstract

This study evaluates the performance of large language models, specifically GPT-3.5 and BARD (supported by Gemini Pro model), in undergraduate admissions exams proposed by the National Polytechnic Institute in Mexico. The exams cover Engineering/Mathematical and Physical Sciences, Biological and Medical Sciences, and Social and Administrative Sciences. Both models demonstrated proficiency, exceeding the minimum acceptance scores for respective academic programs to up to 75% for some academic programs. GPT-3.5 outperformed BARD in Mathematics and Physics, while BARD performed better in History and questions related to factual information. Overall, GPT-3.5 marginally surpassed BARD with scores of 60.94% and 60.42%, respectively.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 3 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Performance of Large Language Models in a Computer Science Degree Program

89% match2023

Performance Comparison of Large Language Models on VNHSGE English Dataset: OpenAI ChatGPT, Microsoft Bing Chat, and Google Bard

88% match2023

Evaluating the Performance of Large Language Models in Competitive Programming: A Multi-Year, Multi-Grade Analysis

87% match2024

ChatGPT is Good but Bing Chat is Better for Vietnamese Students

86% match2023

Performance of ChatGPT on the US Fundamentals of Engineering Exam: Comprehensive Assessment of Proficiency and Potential Implications for Professional Environmental Engineering Practice

86% match2023

Evaluating GPT-3.5 and GPT-4 on Grammatical Error Correction for Brazilian Portuguese

86% match2023

Cite this paper

@article{miranda2023evaluating,
  title  = {Evaluating the Performance of Large Language Models for Spanish Language in Undergraduate Admissions Exams},
  author = {Sabino Miranda and Obdulia Pichardo-Lagunas and Bella Martínez-Seis and Pierre Baldi},
  year   = {2023},
  eprint = {2312.16845},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2312.16845v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2312.16845.svg)](https://codeofpaper.com/paper/2312.16845)

Discussion