Promptomatix: An Automatic Prompt Optimization Framework for Large Language Models

Rithesh Murthy, Ming Zhu, Liangwei Yang, Jielin Qiu, Juntao Tan +4 more
7/17/2025
cs.CLcs.AI

No official code found. Best implementation: SalesforceAIResearch/promptomatix (972 stars, Apache-2.0, last commit 2025-08-01).

Abstract

Large Language Models (LLMs) perform best with well-crafted prompts, yet prompt engineering remains manual, inconsistent, and inaccessible to non-experts. We introduce Promptomatix, an automatic prompt optimization framework that transforms natural language task descriptions into high-quality prompts without requiring manual tuning or domain expertise. Promptomatix supports both a lightweight meta-prompt-based optimizer and a DSPy-powered compiler, with modular design enabling future extension to more advanced frameworks. The system analyzes user intent, generates synthetic training data, selects prompting strategies, and refines prompts using cost-aware objectives. Evaluated across 5 task categories, Promptomatix achieves competitive or superior performance compared to existing libraries, while reducing prompt length and computational overhead making prompt optimization scalable and efficient.

View on arXivView PDF

Code Implementations(1)

Apache-2.0

An Automatic Prompt Optimization Framework for Large Language Models

972104Shell, PythonJul 8, 20251 years agoApache-2.0

Similar Papers

Cite this paper

@article{murthy2025promptomatix,
  title  = {Promptomatix: An Automatic Prompt Optimization Framework for Large Language Models},
  author = {Rithesh Murthy and Ming Zhu and Liangwei Yang and Jielin Qiu and Juntao Tan and Shelby Heinecke and Caiming Xiong and Silvio Savarese and Huan Wang},
  year   = {2025},
  eprint = {2507.14241},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2507.14241v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2507.14241.svg)](https://codeofpaper.com/paper/2507.14241)

Discussion