Unsafe Code Still a Hurdle Copilot Must Clear.

This paper investigates the security implications of code generated by large language models (LLMs) like GitHub Copilot, which is trained on public repositories to assist developers with code completion. A systematic analysis of 89 programming scenarios revealed that around 40% of Copilot's outputs...

Descripción completa

Detalles Bibliográficos
Publicado en:Communications of the ACM Vol. 68; no. 2; pp. 95 - 96
Autor principal: Holz, Thorsten
Formato: Artículo
Publicado: Association for Computing Machinery Feb2025
Materias:
Acceso en línea:Ver este registro en EBSCOhost
Descripción
Sumario:This paper investigates the security implications of code generated by large language models (LLMs) like GitHub Copilot, which is trained on public repositories to assist developers with code completion. A systematic analysis of 89 programming scenarios revealed that around 40% of Copilot's outputs contained vulnerabilities, often reflecting insecure coding practices present in its training data. The study highlights the need for prompt engineering, manual oversight, and secure coding standards to mitigate risks, emphasizing the importance of combining LLMs with traditional security practices for reliable and safe software development.