Kotlin ML Pack: Technical Report

Sergey Titov, Mikhail Evtikhiev, Anton Shapkin, Oleg Smirnov, Sergei Boytsov +6 more
5/29/2024
cs.SEcs.AIcs.PL

No confident code implementation found for this paper.

Abstract

In this technical report, we present three novel datasets of Kotlin code: KStack, KStack-clean, and KExercises. We also describe the results of fine-tuning CodeLlama and DeepSeek models on this data. Additionally, we present a version of the HumanEval benchmark rewritten by human experts into Kotlin - both the solutions and the tests. Our results demonstrate that small, high-quality datasets (KStack-clean and KExercises) can significantly improve model performance on code generation tasks, achieving up to a 16-point increase in pass rate on the HumanEval benchmark. Lastly, we discuss potential future work in the field of improving language modeling for Kotlin, including the use of static analysis tools in the learning process and the introduction of more intricate and realistic benchmarks.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

MultiAIGCD: A Comprehensive dataset for AI Generated Code Detection Covering Multiple Languages, Models,Prompts, and Scenarios

86% match2025

API-guided Dataset Synthesis to Finetune Large Code Models

86% match2024

Instruction-Tuning Open-Weight Language Models for BPMN Model Generation

86% match2025

Beyond Code Pairs: Dialogue-Based Data Generation for LLM Code Translation

86% match2025

COMPASS: A Multi-Dimensional Benchmark for Evaluating Code Generation in Large Language Models

86% match2025

Examination of Code generated by Large Language Models

86% match2024

Cite this paper

@article{titov2024kotlin,
  title  = {Kotlin ML Pack: Technical Report},
  author = {Sergey Titov and Mikhail Evtikhiev and Anton Shapkin and Oleg Smirnov and Sergei Boytsov and Sergei Boytsov and Dariia Karaeva and Maksim Sheptyakov and Mikhail Arkhipov and Timofey Bryksin and Egor Bogomolov},
  year   = {2024},
  eprint = {2405.19250},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2405.19250v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2405.19250.svg)](https://codeofpaper.com/paper/2405.19250)

Discussion