Kristin Giammarco, Ph.D. Associate Professor Department of Systems Engineering kmgiamma (at) nps (dot) edu Curriculum Vitae	Academic Associate Joint Executive Systems Engineering Management Program (Curriculum 721) Educational Consortium for Product Development Leadership in the 21st Century (SEM-PD21) Program Officer Systems Engineering PhD Program (Curriculum 582)

Teaching

• MN3108 Leadership in Product Development*

• SE3302 System Suitability

• SE4003 Systems Software Engineering

• SI4022 System Architecture*

• SE4150 System Architecture and Design

• SE4151 Systems Integration and Development*

• SE3650 Modeling and Analysis of Emergent System Behaviors*+

• SE4900 Advanced Studies in Systems Engineering

• SE4930 Model Based Systems Engineering

• SE4935 Formal Methods for System Architecting*+

• SI0810 Capstone Project 

*Course Coordinator   +Course Developer

Research

• Monterey Phoenix Homepage

Publications

• Giammarco, Kristin. 2023. “System Behavior Specification Verification and Validation (V&V),” In Systems Engineering for the Digital Age: Practitioner Perspectives, edited by Dinesh C. Verma. pp. 219-240. Hoboken, NJ: John Wiley & Sons. https://www.wiley.com/en-us/Systems+Engineering+for+the+Digital+Age%3A+Practitioner+Perspectives-p-9781394203284 Giammarco, Kristin. 2023.
  

• Giammarco, Kristin, Michael Collins, John James, and Michael (Misha) Novitzky. 2023. “Systems Thinking in Emergent Behavior Analysis Summer Internships.” Proceedings of the SySTEAM Mini-Conference, Online, July 27-28, 2023. https://www.incose.org/2023_redesign/communities/working-groups-initiatives/systeam-initiative

• Errico, Tyler, Kristin Giammarco, Pamela Dyer, Michael (Misha) Novitzky, John James, Rob Semmens, Michael Collins, and Stuart Harshbarger. 2023. “State Machine Execution Traces for Verifying and Validating Robot Behaviors,” Proceedings of the SPIE Defense + Commercial Sensing Conference, Orlando, FL April 30 – May 4, 2023.

• Sagos, Michael, Luke Mattson, Vishal Patel, Kristin Giammarco, Pamela Dyer, Michael (Misha) Novitzky, John James, Robert Semmens, Michael Collins, and Stuart Harshbarger. 2023. “Behavior Analysis of Search and Rescue Operations Employing Human-machine Teaming,” Proceedings of the SPIE Defense + Commercial Sensing Conference, Orlando, FL April 30 – May 4, 2023.

• Baker, Luke, Chandni Sharma, Shaurya Sen, Michael Novitzky, Kristin Giammarco, Pamela Dyer, John James, Robert Semmens, Michael Collins, and Stuart Harshbarger. 2023. “Creating an Interface between Behavior-modeling Software and a Robotic Simulation Environment,” Proceedings of the SPIE Defense + Commercial Sensing Conference, Orlando, FL April 30 – May 4, 2023.

• Giammarco, Kristin. 2023. "Exposing and Controlling Emergent Behaviors Using Models with Human Reasoning," In Emergent Behavior in System of Systems Engineering, edited by Larry Rainey and O. Thomas Holland. pp. 23-61. Boca Raton, FL: CRC Press Taylor & Francis Group.

• Herrington, Daniel, Paul Beery and Kristin Giammarco. 2022. “Assessing Design Repository Search Effectiveness.” Systems 10(5), 178; https://doi.org/10.3390/systems10050178

• Giammarco, Kristin and Pamela Dyer.  2022. “Acquisition Decision Support with Monterey Phoenix.” Technical Report NPS-SE-22-007. Monterey, CA, USA.

• Beery, Paul, Timothy Byram, Eric Gatley, Kristin Giammarco, Richard Williams, and Eugene Paulo. 2020. "An operational effectiveness analysis of legacy and future mine countermeasures systems using discrete event simulation." The Journal of Defense Modeling and Simulation 17, no. 2.  191-204.

• Wilhelm, Christopher, Erin Thompson, Kristin Giammarco, and Clifford Whitcomb. 2020.  "System architecture practices to facilitate Department of Defense technology transfer." The Journal of Technology Transfer 45: 705-717.

• Giammarco, K., Spencer Hunt, Clifford A. Whitcomb. 2018. "Using the Design Reference Mission for Framing Naval Ship Design Problems.” Naval Engineers Journal 180, no. 1:53—63.

• Giammarco, Kristin, and Len Troncale.  2018. "Modeling Isomorphic Systems Processes Using Monterey Phoenix." Systems 6, no. 2: 18.

• Giammarco, Kristin and Mikhail Auguston. 2018.  “Monterey Phoenix — Behavior Modeling Approach for the Early Verification and Validation of System of Systems Emergent Behaviors,” In Engineering Emergence: A Modeling and Simulation Approach, edited by Larry Rainey and Mo Jamshidi.  pp. 357-388.  Boca Raton, FL: CRC Press Taylor & Francis Group.

• Quartuccio, John and Kristin Giammarco. 2018.   “A Model-Based Approach to Investigate Emergent Behaviors in Systems of Systems,” In Engineering Emergence: A Modeling and Simulation Approach, edited by Larry Rainey and Mo Jamshidi.  pp. 389-458.  Boca Raton, FL: CRC Press Taylor & Francis Group.

• Giammarco, Kristin and Paul Shebalin. 2018. "An instructional design reference mission Tactical Disc Clearance System.” Technical Report NPS-SE-18-001. Monterey, CA, USA.

• Giammarco, Kristin and Bruce Allen. 2018. "Methodologies and patterns for model centric systems engineering.” Technical Report NPS-SE-18-002. Monterey, CA, USA.

• Giammarco, K., R. Carlson, M. Blackburn, M. Auguston, R. Gehris, M. Jones, J. Quartuccio, K. Giles, C. Wolfgeher, G. Parker. 2018. “Verification and Validation (V and V) of System Behavior Specifications.” No. SERC-2018-TR-116. Systems Engineering Research Center: Hoboken, NJ, USA.

• Giammarco, Kristin, and Len Troncale. 2017. “Using Monterey Phoenix to Model Isomorphic Systems Processes (ISPs) of the Systems Processes Theory (SPT): Test of Concept.” Proceedings of the 61^st Annual Meeting of the ISSS, Vienna, Austria, 9-14 July 2017.

• O'Halloran, Bryan, Nikolaos Papakonstantinou, Kristin Giammarco and Douglas Van Bossuyt. 2017.  “A Graph Theory Approach to Functional Failure Propagation in Early Complex Cyber-Physical Systems (CCPSs).” Proceedings of the 27^th Annual INCOSE International Symposium, Adelaide, Australia, July 15-20, 2017.

• Giammarco, Kristin. 2017. "Architecture modeling software analytics: Model quality and maturity assessment using automated tools." In System of Systems Engineering Conference (SoSE), 2017 12th, pp. 1-6. IEEE, 2017.

• Giammarco, Kristin. 2017. "Practical modeling concepts for engineering emergence in systems of systems." In System of Systems Engineering Conference (SoSE), 2017 12th, pp. 1-6. IEEE, 2017.

• Giammarco, Kristin, Kathleen Giles, and Clifford A. Whitcomb. 2017. "Comprehensive use case scenario generation: An approach for modeling system of systems behaviors." In System of Systems Engineering Conference (SoSE), 2017 12th, pp. 1-6. IEEE, 2017.

• Quartuccio, John, Kristin Giammarco, and Mikhail Auguston. 2017. "Identifying decision patterns using Monterey Phoenix." In System of Systems Engineering Conference (SoSE), 2017 12th, pp. 1-6. IEEE, 2017.

• Quartuccio, John, Kristin Giammarco, and Mikhail Auguston. 2017. "Deriving stochastic properties from behavior models defined by Monterey Phoenix." In System of Systems Engineering Conference (SoSE), 2017 12th, pp. 1-6. IEEE, 2017.

• Rambikur, Alex, Kristin Giammarco, and Bryan O'Halloran. 2017. "Systems architecture in failure analysis (Applications of architecture modeling to system failure analysis)." In System of Systems Engineering Conference (SoSE), 2017 12th, pp. 1-6. IEEE, 2017.

• Giammarco, Kristin and Kathleen Giles. 2017. “Verification and validation of behavior models using lightweight formal methods.” Proceedings of the 15^th Annual Conference on Systems Engineering Research.   Redondo Beach, CA. March 23-25, 2017.  Best paper award.

• Rambikur, S. Alex, Kristin Giammarco, and Bryan O’Halloran. 2017. "Increasing System Failure Analysis Effectiveness Through Architecture Modeling." Proceedings of the Complex Adaptive Systems Conference (CAS) October 30 – November 1, 2017, Chicago, Illinois. Procedia Computer Science 114: 4-13.

• Giles, Kathleen, and Kristin Giammarco. 2017.  "Mission-based Architecture for Swarm Composability (MASC)." Proceedings of the Complex Adaptive Systems Conference (CAS) October 30 – November 1, 2017, Chicago, Illinois. Procedia Computer Science 114 (2017): 57-64.

• Boehm, Barry, D. Jacques, J. Columbi, E. Ryan, T. Ender, R. Peak, V. Sitterle, M. Curry, D. Rhodes, A. Ross, R. Madachy, K. Giammarco, M. Yurkish, J.A. Lane, R. Alfayez, J. Alstad, C. Chen, K. Srisopha, K. Sullivan, X. Wang, G. Witus, W. Bryzik. 2017. “System Qualities Ontology, Tradespace and Affordability (SQOTA) Project: Phase 5.” No. SERC-2017-TR-105. Systems Engineering Research Center: Hoboken, NJ, USA.

• Boehm, Barry, D. Jacques, J. Columbi, E. Ryan, T. Ender, R. Peak, V. Sitterle, M. Curry, D. Rhodes, A. Ross, R. Madachy, K. Giammarco, M. Yurkish, J.A. Lane, R. Alfayez, J. Alstad, C. Chen, K. Srisopha, K. Sullivan, X. Wang, G. Witus, W. Bryzik. 2016. “System Qualities Ontology, Tradespace and Affordability (SQOTA) Project: Phase 4.” No. SERC-2016-TR-101. Systems Engineering Research Center: Hoboken, NJ, USA.

• Giammarco, Kristin. 2016. "Generation of Human Views with Monterey Phoenix.” NRP Technical Report NPS-T16-M008-A. Monterey, CA, USA.

• Farah-Stapleton, Monica, Mikhail Auguston, and Kristin Giammarco. 2016. “Executable Behavioral Modeling of System and Software Architecture Specifications to Inform Resourcing Decisions.”  Proceedings of the Complex Adaptive Systems Conference (CAS) November 2-4, 2016, Los Angeles, CA. Procedia Computer Science 95: 345-353.

• Whitcomb, Clifford A., Mikhail Auguston, and Kristin Giammarco.  2015. “Composition of Behavior Modeling for Systems Architecture.” In Modeling and Simulation Support for System of Systems Engineering Applications, edited by Larry Rainey and Andreas Tolk. pp. 361-391. Hoboken, NJ: John Wiley & Sons.

• Auguston, Mikhail, Kristin Giammarco, W. Clifton Baldwin, Ji’on Crump, and Monica Farah-Stapleton. 2015. "Modeling and verifying business processes with Monterey Phoenix." Proceedings of the Conference on Systems Engineering Research (CSER), March 17-19, 2015, Hoboken, NJ.  Procedia Computer Science 44: 48-57.

• Giammarco, Kristin, Spencer Hunt, and Clifford A. Whitcomb. 2015. "An instructional design reference mission for search and rescue operations.” Technical Report NPS-SE-15-002. Monterey, CA, USA.

• Millar, Richard C., and Kristin Giammarco. 2014. "Functional architecture framework for instrumentation systems." International Journal of Industrial and Systems Engineering 17, no. 4: 405-423.

• Millar, Richard C., and Kristin Giammarco. 2014. "Integrated Instrumentation and Sensor Systems Functional Model and Taxonomy." Journal of Aerospace Engineering 27, no. 1: 121-130.

• Giammarco, Kristin, Mikhail Auguston, W. Clifton Baldwin, Ji’on Crump, and Monica Farah-Stapleton. 2014. "Controlling Design Complexity with the Monterey Phoenix Approach." Proceedings of the Complex Adaptive Systems Conference (CAS), November 3-5, 2014. Philadelphia, PA.  Procedia Computer Science 36: 204-209.

• Giammarco, Kristin. "A formal method for assessing architecture model and design maturity using domain-independent patterns." 2014.  Proceedings of the Conference on Systems Engineering Research (CSER), March 20-22, 2014, Redondo Beach, CA.  Procedia Computer Science 28: 555-564.

• Pape, Louis, Siddhartha Agarwal, Kristin Giammarco, and Cihan Dagli. 2014. "Fuzzy Optimization of Acknowledged System of Systems Meta-architectures for Agent based Modeling of Development." Proceedings of the Conference on Systems Engineering Research (CSER), March 20-22, 2014, Redondo Beach, CA.  Procedia Computer Science 28: 404-411.

• Lew, Jaime C., and Kristin M. Giammarco. "Decomposition Relationship Visualization for Executable Architecture Diagrams." 2014. Proceedings of the Conference on Systems Engineering Research (CSER), March 20-22, 2014, Redondo Beach, CA.  Procedia Computer Science 28: 626-634.

• Giammarco, Kristin., & Auguston, Mikhail. 2013. “Well, you didn’t say not to! A formal systems engineering approach to teaching an unruly architecture good behavior.” Proceedings of the Complex Adaptive Systems Conference (CAS), November 13-15, 2013. Baltimore, MD.  Procedia Computer Science, 20, 277-282.

• Rodano, Matthew., & Giammarco, Kristin. 2013. “A Formal Method for Evaluation of a Modeled System Architecture.” Proceedings of the Complex Adaptive Systems Conference (CAS), November 13-15, 2013. Baltimore, MD.  Procedia Computer Science, 20, 210-215.

• Pape, L., K. Giammarco, J. Colombi, C. Dagli, N. Kilicay-Ergin, G. Reboviche. 2013. “A fuzzy evaluation method for system of systems meta-architectures.” Proceedings of the Conference on Systems Engineering Research (CSER), March 19-22, 2013, Atlanta, GA.  Procedia Computer Science, 16, 245-254.

• Dagli, Cihan, Nil Ergin, David Enke, Abhijit Gosavi, Ruwen Qin, John Colombi, George Rebovich et al. 2013. “An Advanced Computational Approach to System of Systems Analysis & Architecting Using Agent-Based Behavioral Model.” No. SERC-2013-TR-021-2. Systems Engineering Research Center: Hoboken, NJ, USA.

• Dagli, Cihan, Nil Ergin, David Enke, Abhijit Gosavi, Ruwen Qin, John Colombi, George Rebovich et al. 2012. “An Advanced Computational Approach to System of Systems Analysis & Architecting Using Agent-Based Behavioral Model.”SERC-2012-TR-021-1. Systems Engineering Research Center: Hoboken, NJ, USA.

• Giammarco, K., G. Xie, C.A. Whitcomb. 2011. “A Formal Method for Assessing Interoperability Using Architecture Model Elements and Relationships.” In Proceedings of the 9^th Annual Conference on Systems Engineering Research (CSER), Redondo Beach, CA, USA, April 14-16, 2011.

• Auguston, M.; Whitcomb, C.; Giammarco, K. 2010. “A New Approach to System and Software Architecture Specification Based on Behavior Models.” In Proceedings of the 3rd International Conference on Model-Based Systems Engineering (IC-MBSE 2010), Fairfax, VA, USA, 27–28 September 2010.

• Giammarco, Kristin. 2010. "Formal Methods for Architecture Model Assessment in Systems Engineering." In Proceedings of the 8^th Annual Conference on Systems Engineering Research (CSER), Hoboken, NJ, USA, March 17-19, 2010.

• Giammarco, Kristin and Deepinder Sidhu. 2008. "Building systems with predictable performance: A joint biometrics architecture emulation." In Proceedings of the Military Communications Conference, 2008 (MILCOM 2008). IEEE, pp. 1-8.  DOI: 10.1109/MILCOM.2008.4753135

• Giammarco, Kristin, Michael Carlomusto, and JD Lock. 2005. “Development and Analysis of Integrated C4ISR Architectures.” Defense Acquisition Research Journal 12, no. 3: 304-322.

• Giammarco, Kristin, M. Carlomusto and JD Lock. 2005. "Development and analysis of integrated C4ISR architectures." In Proceedings of the Military Communications Conference, 2005 (MILCOM 2005). IEEE, pp. 1-7. DOI: 10.1109/MILCOM.2005.1605965