Experts’ validation of the fundamental cybersecurity competency index (FCCI) using a commercial cyber range through human-generative artificial intelligence (GenAI) teaming

The increasing volume of cyber threats, combined with a critical shortage of skilled professionals and rising burnout among practitioners, highlights the urgent need for innovative solutions in cybersecurity operations. Generative Artificial Intelligence (GenAI) offers promising potential to augment human analysts in cybersecurity, but its integration requires rigorous validation of the fundamental competencies that enable effective collaboration of human-GenAI teams. This research study employed a mixed-methods research project designed to evaluate human-GenAI teams, emphasizing the role of expert consensus in shaping the experimental assessment of the Fundamental Cybersecurity Competency Index (FCCI) in a commercial cyber range. We engaged 20 Subject Matter Experts (SMEs) in a panel to validate the fundamental cybersecurity Knowledge, Skills, and Tasks (KSTs), which are the measures of competencies. The expert panel refined the cybersecurity scenarios and experimental procedures used in hands-on simulations, ensuring they align with current standards outlined in the United States (U.S.) Department of Defense (DoD) Cyber Workforce Framework (DCWF). Our findings indicated that 46 o