AIGCodeSet: A New Annotated Dataset for AI Generated Code Detection

Basak Demirok, Mucahid Kutlu
12/21/2024
cs.SEcs.AI

No confident code implementation found for this paper. 3 possible matches can be shown below.

Abstract

While large language models provide significant convenience for software development, they can lead to ethical issues in job interviews and student assignments. Therefore, determining whether a piece of code is written by a human or generated by an artificial intelligence (AI) model is a critical issue. In this study, we present AIGCodeSet, which consists of 2.828 AI-generated and 4.755 human-written Python codes, created using CodeLlama 34B, Codestral 22B, and Gemini 1.5 Flash. In addition, we share the results of our experiments conducted with baseline detection methods. Our experiments show that a Bayesian classifier outperforms the other models.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 3 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

ChatGPT Code Detection: Techniques for Uncovering the Source of Code

90% match1 repo92024

MultiAIGCD: A Comprehensive dataset for AI Generated Code Detection Covering Multiple Languages, Models,Prompts, and Scenarios

87% match2025

Programming with AI: Evaluating ChatGPT, Gemini, AlphaCode, and GitHub Copilot for Programmers

86% match2024

User Centric Evaluation of Code Generation Tools

84% match2024

From Defects to Demands: A Unified, Iterative, and Heuristically Guided LLM-Based Framework for Automated Software Repair and Requirement Realization

84% match2024

Is Functional Correctness Enough to Evaluate Code Language Models? Exploring Diversity of Generated Codes

84% match1 repo12024

Cite this paper

@article{demirok2024aigcodeset,
  title  = {AIGCodeSet: A New Annotated Dataset for AI Generated Code Detection},
  author = {Basak Demirok and Mucahid Kutlu},
  year   = {2024},
  eprint = {2412.16594},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2412.16594v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2412.16594.svg)](https://codeofpaper.com/paper/2412.16594)

Discussion