Socio-affective artificial intelligence enables real-time human and agent interactions
Building Socio-Affective Artificial Intelligence for Interactive Multi-Agent Simulations
Artificial IntelligenceComputers and SocietyComputer Science and Game TheoryHuman-Computer InteractionMultiagent Systems
Summary
Interacting with multiple artificial agents in dynamic simulated worlds is challenging, especially when agents need to be aware of social cues and emotions. The authors present design principles and software called AGIMUD that allow humans and many AI agents to interact simultaneously in real time, using social and emotional reasoning. This system distributes AI processing across networks and supports multimodal human communication. It aims to build more natural and sustainable interactions between humans and AI in shared virtual environments.
What this means in practice
- •For virtual world developers: Create interactive multi-user virtual environments where humans and emotionally aware AI agents coexist and interact in real time.$Commercial implications: Enables development of advanced multiplayer virtual reality games and simulations with socially responsive AI characters, attracting users with immersive experiences.
- •For customer service platform teams: Integrate socially and emotionally aware AI agents that collaborate in complex, multi-agent conversational settings with human users.
Authors
David Berga
Abstract
The objective of this article is to provide design principles and a software architecture for enabling interaction between humans and multiple agents in simulated dynamic worlds. This connects the current era of general artificial intelligence (AI/AGI) with the proliferation of transformer-based conversational agents and the increased computational capabilities. Given an overview of current and previous multi-agent theories of mind (socially and affectively-aware agents), the existence of an integrative design of agent interactions with themselves and with humans must be crucial for understanding how to create sustainable and governance in future human-agent reasoning systems. In this work is presented a software "AGIMUD" that integrates: A. socially-aware reasoning and emotion in agent behavior and interaction, B. a design of human multimodal scheme for human users, artificial agents and simulated worlds, and C. distributing the AI processing through the network to enable multiple autonomous agents. These integrations allow the dynamic world recreation as multi-user dungeons (MUDs) where both agents and humans can interact simultaneously in real time. Find the code online in https://github.com/dberga/AGIMUD.