MEGA-Bench: Scaling Multimodal Evaluation to over 500 Real-World Tasks

Jiacheng Chen, Tianhao Liang, Sherman Siu, Zhengqing Wang, Kai Wang +11 more
2/12/2026

No official code found. Best implementation: TIGER-AI-Lab/MEGA-Bench (83 stars, Apache-2.0, last commit 2025-07-01).

Semantic Scholar

Code Implementations(1)

TIGER-AI-Lab/MEGA-BenchCommunity67%
Apache-2.0

This repo contains the code for "MEGA-Bench Scaling Multimodal Evaluation to over 500 Real-World Tasks" [ICLR 2025]

837PythonOct 10, 20241 years agoApache-2.0
benchmarkevaluationmultimodal

Similar Papers

GReaTer: Gradients Over Reasoning Makes Smaller Language Models Strong Prompt Optimizers

67% match1 repo362026

Neural Network Accelerated Implicit Filtering: Integrating Neural Network Surrogates With Provably Convergent Derivative Free Optimization Methods

67% match2026

NUDGE: Lightweight Non-Parametric Fine-Tuning of Embeddings for Retrieval

66% match2026

PEACE: A Dataset of Pharmaceutical Care for Cancer Pain Analgesia Evaluation and Medication Decision

65% match2026

TAU-106K: A New Dataset for Comprehensive Understanding of Traffic Accident

65% match1 repo232026

GAIA: a benchmark for General AI Assistants

65% match2026

Cite this paper

@article{chen2026megabench,
  title  = {MEGA-Bench: Scaling Multimodal Evaluation to over 500 Real-World Tasks},
  author = {Jiacheng Chen and Tianhao Liang and Sherman Siu and Zhengqing Wang and Kai Wang and Yubo Wang and Yuansheng Ni and Ziyan Jiang and Wang Bill Zhu and Bohan Lyu and Dongfu Jiang and Xuan He and Yuan-Ting Liu and Hexiang Hu and Xiang Yue and Wenhu Chen},
  year   = {2026},
  url    = {https://api.semanticscholar.org/CorpusID:30151f7bca0a06fb92eaa3300ce900acb145521a},
  journal = {ICLR 2025 2025}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/30151f7bca0a06fb92eaa3300ce900acb145521a.svg)](https://codeofpaper.com/paper/30151f7bca0a06fb92eaa3300ce900acb145521a)

Discussion