Concept development assessment game – suitable collecting framework in scientific military research

Authors

  • George-Ion TOROI

DOI:

https://doi.org/10.53477/2284-9378-24-56

Keywords:

CDAG;, military science, collection method;, scientific research

Abstract

Scientific research is crucial for progress across all areas of society, including the military sphere. However, as the security environment becomes increasingly dynamic, unpredictable, and complex, research methods in military sciences must address contemporary challenges by providing flexible frameworks for evaluating and testing new concepts necessary for the
adaptation of force structures. This article analyzes the Concept Development Assessment Game (CDAG), which offers a structured framework for collecting qualitative data in military-specific research. The game serves as a qualitative tool used for testing and refining concepts at an early stage of development, providing a controlled and flexible environment for collecting necessary data. Moreover, it ensures a mechanism for employing a wide range of data collection methods, such as observation, focus groups, or questionnaires, thereby enabling the triangulation of collected data and, consequently, the foundation for valuable
outcomes in the effort to transform military structures.

Author Biography

George-Ion TOROI

George-Ion Toroi is a lieutenant colonel in the Romanian Army, currently serving as a senior instructor for the Land Forces Department at the Defense and Staff Faculty of the Romanian "Carol I" National Defense University. Born on December 5, 1982, in Stefanesti, Arges, he has accumulated 18 years of military experience, holding various positions from platoon commander to company commander, and serving as a division-level STRATCOM staff officer and ADC to HQMND-SE COM.

George-Ion Toroi is a 2006 graduate of the Romanian Land Forces Academy "Nicolae Bălcescu". He holds two master’s degrees: one in International Relations and Security Studies from the Faculty of Political Science, International Relations, and European Studies at "Lucian Blaga" University of Sibiu (2008), and another in Land Forces Combined Arms Command from the Romanian National Defense University "Carol I" (2020). Additionally, he earned a Ph.D. in Military Studies from the "Carol I" National Defense University in 2024.

His expertise encompasses a wide range of military activities, including tactical and operational level operations planning, military training and exercises (TREX), and tactical level land operations. His research interests extend to information activities, particularly the employment of deception in military operations.

References

Brace, Ian, and Kate Bolton. 2022. Questionnaire Design: How to plan, structure and write survey material for effective market research. 5th. London: Kogan Page Limited.

Braun, Virginia, and Victoria Clarke. 2013. Successful qualitative research – a practical guide for beginners. London: Sage Publications.

Charmaz, Kathy. 2014. Constructing Grounded Theory. 2nd edition. London: Sage Publications.

Charmaz, Kathy, and Robert Thornberg. 2021. “The pursuit of quality in grounded theory.”

Qualitative research in psychology 18 (3).

Collins, Sue, and Marcel-Paul Hasberg. 2018. “Tabletop Assessment Games in Concept Development and Experimentation,.” In Advances in Defence Analysis, Concept Development and Experimentation: Innovation for the Future. Norfolk: NATO HQ

Supreme Allied Command Transformation.

Crabtree, Benjamin F., and William L. Miller. 2023. Doing Qualitative Research, 3rd. Los Angeles: Sage Publications.

Creswell, John C. 2013. Qualitative inquiry and research design: choosing among five approaches. Londra: Sage Publications.

Dawson, Catherine. 2019. Introduction to research methods: A practical guide for anyone undertaking a research project, ed. 5. Robinson.

Feckler, D. 2011. „ACT Employs Analytical War-Game.” The Transformer, Bi-Annual Publication of Allied Command Transformation, 2.

Hennink, Monique, Inge Hutter, and Ajay Bailey. 2020. Qualitative Research Methods.London: Sage Publications.

—. 2020. Qualitative Research Methods. London: Sage Publications.

Joint Doctrine Note 1-19. 2019. Competition Continuum. US Joint Chiefs of Staff. https://irp.fas.org/doddir/dod/jdn1_19.pdf.

Krueger, Richard A., and Mary Anne Casey. 2014. Focus Groups: A Practical Guide for Applied Research. 5th. Los Angeles: Sage Publications.

Leavy, Patricia. 2023. Research Design - Quantitative, Qualitative, Mixed Methods, Arts-Based, and Community-Based Participatory Research Approaches, Second edition. New York: The Guilford Press.

—. 2020. The Oxford Handbook of Qualitative Research. 2nd. Oxford: Oxford University Press.

Mazarr, Michael J., Jonathan S. Blake, Abigail Casey, Tim McDonald, Stephanie Pezard, and Michael Spirtas. 2018. Understanding the Emerging Era of International

Competition. Theoretical and Historical Perspectives. Santa Monica, California: RAND Corporation.

Mazarr, Michael J., Jonah Blank, Samuel Charap, Benjamin N. Harris, Timothy R. Heath,

Niklas Helwig, Jeffrey W. Hornung, Lyle J. Morris, Ashley L. Rhoades, Ariane M.

Tabatabai, Sean M. Zeigler. 2022. Understanding the Emerging Era of International Competition Through the Eyes of Others. Country Perspectives. Santa Monica,California: RAND Corporation.

MCDP 1-4. 2020. Competing. U.S. Marine Corps. https://www.marines.mil/News/ Publications/MCPEL/Electronic-Library-Display/Article/2449338/mcdp-1-4/.

Moser, Albine, and Irene Korstjens. 2018. “Series: Practical guidance to qualitative research.

Part 3: Sampling, data collection and analysis.” European Journal of General Practice24 (1).

NATO ACT. 2021. NATO Concept Development and Experimentation Handbook: A concept developer’s toolbox. Norfolk: NATO Allied Command Transformation.

—. 2014. NATO Concept Development Assessment Game “CDAG” Handbook. Norfolk: NATO Allied Command Transformation.

—. 2017. The NATO Alternative Analysis Handbook, second edition. Norfolk: NATO Allied Command Transformation.

—. 2011. Transformer. Norfolk: NATO Allied Command Transformation.

Nistorescu, Claudiu Valer. 2024. “Adaptarea organizației militare – O condiție esențială pentru obținerea succesului pe câmpul de luptă.” Gândirea Militară Românească (3):

Popa, Marian. 2019. Psihologie militară. Editia a doua. București: Editura Polirom.

Rassel, Gary, Suzanne Leland, Zachary Mohr, and Elizabeth Ann O’Sullivan. 2020.Research methods for public administrators. Routledge.

Ravitch, Sharon M., and Nicole Mittenfelner Carl. 2021. Qualitative Research. Bridging the Conceptual, Theoretical, and Methodological. 2nd. London: Sage Publications.

Salmons, Janet E. 2022. Doing Qualitative Research Online. London: Sage Publications.

Saunders, Mark N.K., Philip Lewis, and Adrian Thornhill. 2019. Research Methods for Business Students. 8th edition. Pearson Education.

Sharan B. Merriam, Robin S. Grenier. 2019. Qualitative Research in Practice. Examples for Discussion and Analysis. 2nd. San-Francisco: Jossey-Bass.

Stewart, David W., and Prem N. Shamdasani. 2015. Focus Groups: Theory and Practice. 3rd edition. Los Angeles: Sage Publications.

Theofanidis, Dimitrios, and Antigoni Fountouki. 2018. “Limitations and delimitations in the research process.” Perioperative Nursing-Quarterly scientific, Online Official Journal of GORNA 7 (3).

TRADOC G-2, Version 9.0. 2022. The Red Team Handbook. The Army’s guide to making better decisions. 9. US Army Training and Doctrine.

UK Ministry of Defence. 2021a. Defence Experimentation for Force Development Handbook. https://assets.publishing.service.gov.uk/media/6014030be90e07626914df 3c/20210121-DEFD_Handbook_Version_2-O.pdf.

__. 2021b. Red Teaming Handbook. 3rd. https://assets.publishing.service.gov.uk/media/61702155e90e07197867eb93/20210625-Red_Teaming_Handbook.pdf.

Saunders, Mark N.K., Philip Lewis, and Adrian Thornhill. 2019. Research Methods for Business Students. 8th edition. Pearson Education.

Sharan B. Merriam, Robin S. Grenier. 2019. Qualitative Research in Practice. Examples for Discussion and Analysis. 2nd. San-Francisco: Jossey-Bass.

Stewart, David W., and Prem N. Shamdasani. 2015. Focus Groups: Theory and Practice. 3rdedition. Los Angeles: Sage Publications.

Theofanidis, Dimitrios, and Antigoni Fountouki. 2018. “Limitations and delimitations in the research process.” Perioperative Nursing-Quarterly scientific, Online Official Journal of GORNA 7 (3).

TRADOC G-2, Version 9.0. 2022. The Red Team Handbook. The Army’s guide to making better decisions. 9. US Army Training and Doctrine.

UK Ministry of Defence. 2021a. Defence Experimentation for Force Development Handbook. https://assets.publishing.service.gov.uk/media/6014030be90e07626914df3c/20210121-DEFD_Handbook_Version_2-O.pdf.

__. 2021b. Red Teaming Handbook. 3rd. https://assets.publishing.service.gov.uk/media/61702155e90e07197867eb93/20210625-Red_Teaming_Handbook.pdf.

Downloads

Published

2025-01-21

How to Cite

TOROI, G.-I. . (2025). Concept development assessment game – suitable collecting framework in scientific military research. BULLETIN OF "CAROL I" NATIONAL DEFENCE UNIVERSITY, 13(4), 169–183. https://doi.org/10.53477/2284-9378-24-56

Issue

Vol. 13 No. 4 (2024)

Section

Articles

License

The published articles are subject to copyright law. All rights are reserved to the “Carol I” National Defense University, regardless of whether all or part of the material are considered, especially the rights to translation, reprinting, re-use of illustrations, quotations, broadcasting through the media, reproduction on microfilms or any other way and storage in data banks. Any replicas without the associated fees are authorized provided the source is acknowledged.