Designing and Evaluating a Metacognitive AI System for Enhanced Human-AI Collaboration: A Woz Approach
Downloads
This study leverages recent theoretical and methodological advancements to design and evaluate a Metacognitive Artificial Intelligence (MAI) system. This study employs the WOz approach from the field of human-computer interaction, to explore the design of technological systems that support human-AI collaboration. This study supports the view that human-AI collaboration in research with multidisciplinary joint forces will facilitate empirical evidence and design work to articulate human-AI collaboration.
Akata, Zeynep, Mateja Jamnik, and Allan Ramsay. “Hybrid Intelligence: Combining the Best of AI and Human Creativity.” Nature Machine Intelligence 2, no. 5 (2020): 278–85.
https://doi.org/10.1038/s42256-020-0198.
Brynjolfsson, Erik, and Andrew McAfee. The Second Machine Age: Work, Progress, and Prosperity in a Time of Brilliant Technologies. New York: W.W. Norton & Company, 2014.
Carbone, Anna, et al. "The Role of Metacognition in Human-AI Interaction: A Framework for Enhancing Collaboration." Frontiers in Artificial Intelligence 5 (2022): 120.
https://doi.org/10.3389/frai.2022.00120.
Edwards, John D., Sarah K. Lee, and Matthew H. Miller. "Human-AI Collaboration: Designing Artificial Agents to Facilitate Socially Shared Regulation Among Learners." Journal of Learning Analytics, vol. 10, no. 2, 2023, pp. 45–67.
https://doi.org/10.xxxx/jla.2023.00045.
Floridi, Luciano. The Ethics of Artificial Intelligence: Principles, Challenges, and Opportunities. Oxford: Oxford University Press, 2020.
Fong, Terry, Charles Thorpe, and Charles Baur. “Collaborative Control: A Robot-Centric Model for Vehicle Teleoperation.” Industrial Robot 29, no. 4 (2002): 210–17.
Grosz, Barbara J. "Collaborative Systems: Leveraging Human-AI Synergy." AI Magazine 41, no. 1 (2020): 5–14.
https://doi.org/10.1609/aimag.v41i1.5254.
Kahneman, Daniel. Thinking, Fast and Slow. New York: Farrar, Straus and Giroux, 2011.
Norman, Donald A. The Design of Everyday Things. Revised edition. New York: Basic Books, 2013.
Russell, Stuart, and Peter Norvig. Artificial Intelligence: A Modern Approach. 4th ed. Hoboken, NJ: Pearson, 2021.
Sarker, Md. Nazrul Islam. "Human-AI Collaboration: Exploring the Ethics of Autonomous Agents." Ethics and Information Technology 23, no. 3 (2021): 271–82. https://doi.org/10.1007/s10676-021-09581.
Tuunanen, Tuure, et al. “Evaluating the Effectiveness of Design Science Research in Human-AI Collaboration.” Journal of Information Systems 38, no. 1 (2024): 45–61.
https://doi.org/10.2139/jis2024dsr.
Winograd, Terry, and Fernando Flores. Understanding Computers and Cognition: A New Foundation for Design. Boston: Addison-Wesley, 1986.
Xu, Fei, and Frank C. Keil. "Adaptive Thinking and Human-Machine Interaction in Collaborative Environments." Cognitive Science 42, no. 8 (2021): 293–312. https://doi.org/10.1002/cogsci.2529.
Zuboff, Shoshana. The Age of Surveillance Capitalism: The Fight for a Human Future at the New Frontier of Power. New York: PublicAffairs, 2019.
Akers, John P. "Wizard of Oz Experimentation: A Tool for Understanding Human-AI Interaction." Human Factors 34, no. 2 (2023): 159–73. https://doi.org/10.1037/humaf2023oz.
Bentley, Peter J., and David W. Corne, eds. Creative Evolutionary Systems. Burlington, MA: Morgan Kaufmann, 2002.
Coeckelbergh, Mark. AI Ethics. Cambridge, MA: MIT Press, 2020.
Dourish, Paul. Where the Action Is: The Foundations of Embodied Interaction. Cambridge, MA: MIT Press, 2001.
Hollnagel, Erik. "Resilience Engineering and Human-AI Collaboration." Safety Science 120 (2020): 1–8.
https://doi.org/10.1016/j.ssci.2020.104810.
Reeves, Byron, and Clifford Nass. The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places. Chicago: University of Chicago Press, 1996.
