Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Review

Man Fai Wong, Shangxin Guo, Ching Nam Hang, Siu Wai Ho, Chee Wei Tan
7/4/2023
cs.SEcs.AIcs.CL

No confident code implementation found for this paper.

Abstract

This paper provides a comprehensive review of the literature concerning the utilization of Natural Language Processing (NLP) techniques, with a particular focus on transformer-based large language models (LLMs) trained using Big Code, within the domain of AI-assisted programming tasks. LLMs, augmented with software naturalness, have played a crucial role in facilitating AI-assisted programming applications, including code generation, code completion, code translation, code refinement, code summarization, defect detection, and clone detection. Notable examples of such applications include the GitHub Copilot powered by OpenAI's Codex and DeepMind AlphaCode. This paper presents an overview of the major LLMs and their applications in downstream tasks related to AI-assisted programming. Furthermore, it explores the challenges and opportunities associated with incorporating NLP techniques with software naturalness in these applications, with a discussion on extending AI-assisted programming capabilities to Apple's Xcode for mobile software development. This paper also presents the challenges of and opportunities for incorporating NLP techniques with software naturalness, empowering developers with advanced coding assistance and streamlining the software development process.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Parameter-Efficient Fine-Tuning Methods for Pretrained Language Models: A Critical Review and Assessment

87% match2023

Automated Code generation for Information Technology Tasks in YAML through Large Language Models

86% match2023

Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Code

86% match1 repo3.4k2023

Promptly: Using Prompt Problems to Teach Learners How to Effectively Utilize AI Code Generators

86% match2023

Teaching Machines to Code: Smart Contract Translation with LLMs

86% match2024

Programming with AI: Evaluating ChatGPT, Gemini, AlphaCode, and GitHub Copilot for Programmers

86% match2024

Cite this paper

@article{wong2023natural,
  title  = {Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Review},
  author = {Man Fai Wong and Shangxin Guo and Ching Nam Hang and Siu Wai Ho and Chee Wei Tan},
  year   = {2023},
  eprint = {2307.02503},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2307.02503v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2307.02503.svg)](https://codeofpaper.com/paper/2307.02503)

Discussion