Stop Using Vulnerability Counts to Measure Software Security.

This article argues that counting fixed vulnerabilities is a misleading measure of software security, as it ignores the context, effort, and process improvements behind each fix. Vulnerabilities are discovered under varying conditions, influenced by factors such as tool advances, human diligence, an...

Descripción completa

Detalles Bibliográficos
Publicado en:Communications of the ACM Vol. 68; no. 9; pp. 34 - 37
Autores principales: Meneely, Andy, Keller, Brandon
Formato: Artículo
Publicado: Association for Computing Machinery Sep2025
Materias:
Acceso en línea:Ver este registro en EBSCOhost
Descripción
Sumario:This article argues that counting fixed vulnerabilities is a misleading measure of software security, as it ignores the context, effort, and process improvements behind each fix. Vulnerabilities are discovered under varying conditions, influenced by factors such as tool advances, human diligence, and changes in APIs, making raw counts insufficient to gauge security. Instead, the authors propose vulnerability recidivism metrics, which track repeated types, modules, or authors associated with vulnerabilities to better assess process effectiveness and ongoing risk. Emphasizing a culture where developers can safely admit mistakes, reflect on them, and improve practices is key to meaningful cybersecurity measurement and improvement.