Scaling Speech-Text Pre-training with Synthetic Interleaved Data

Aohan Zeng, Zhengxiao Du, Mingdao Liu, Lei Zhang, Shengmin Jiang +2 more
2/12/2026

No confident code implementation found for this paper. 2 possible matches can be shown below.

Semantic Scholar

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

PreLAR: World Model Pre-training with Learnable Action Representation

99% match1 repo1712026

Boosting 3D Single Object Tracking with 2D Matching Distillation and 3D Pre-training

95% match2026

POCA: Post-training Quantization with Temporal Alignment for Codec Avatars

95% match2026

Holographic Node Representations: Pre-training Task-Agnostic Node Embeddings

92% match1 repo42026

Train Once and Explain Everywhere: Pre-training Interpretable Graph Neural Networks

90% match2026

On Pre-training Language Model for Antibody

89% match2026

Cite this paper

@article{zeng2026scaling,
  title  = {Scaling Speech-Text Pre-training with Synthetic Interleaved Data},
  author = {Aohan Zeng and Zhengxiao Du and Mingdao Liu and Lei Zhang and Shengmin Jiang and Yuxiao Dong and Jie Tang},
  year   = {2026},
  url    = {https://api.semanticscholar.org/CorpusID:26d22b8ca757cf75c86329e89c8638b6ffc4155d},
  journal = {ICLR 2025 2025}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/26d22b8ca757cf75c86329e89c8638b6ffc4155d.svg)](https://codeofpaper.com/paper/26d22b8ca757cf75c86329e89c8638b6ffc4155d)

Discussion