Ph.D. candidate in Ingegneria Informatica E Dei Sistemi , 39th cycle (2023-2026)
Department of Control and Computer Engineering (DAUIN)
Adjunct lecturer/Adjunct instructor
Department of Control and Computer Engineering (DAUIN)
Profile
PhD
Research topic
Fondamenti per la Credibilità degli Agenti Virtuali
Tutors
Keywords
Biography
My research focuses on Virtual Humans — artificial entities that looks and act like real human in XR and virtual 3D real-time applications. Virtual Humans are deployed across a wide range of domains including education, training, healthcare, and interactive entertainment. In many of these contexts, their effectiveness is tightly coupled with their believability: the degree to which users perceive them as coherent, responsive, and credible agents rather than scripted automatons.
The central theme of my research is believability as a systemic property of Virtual Humans — not reducible to any single expressive channel, but emerging from the coherent integration of emotional expressivity, cognitive behavior, and interaction capabilities. This framing has evolved over the course of the PhD: early work focused on individual expressive modalities, while subsequent developments — particularly the advent of Large Language Models and agentic AI architectures — have enabled a more integrated approach to agent design.
The research is structured around three interconnected objectives:
Objective 1 — Believable Emotional Expressivity. Studying and evaluating methods for the credible simulation of emotions in virtual agents, including facial expressions via the Facial Action Coding System (FACS) and body language through Text-To-Motion generation techniques. The perceived quality of these modalities is assessed through user studies measuring believability and authenticity.
Objective 2 — Integrated Framework for Believable Virtual Humans in XR. Designing and implementing an agent architecture (A.D.A.M.O.) that integrates multimodal perception, LLM/VLM-based reasoning, and affective-cognitive state modeling into a coherent decision loop. This reduces dependency on manual scripting and increases the agent's generalizability across situated interaction scenarios — both agent-user and agent-environment — in eXtended Reality contexts.
Objective 3 — Believability as an Evaluation Construct. Exploring believability as a multidimensional construct and developing evaluation protocols that combine UX questionnaires, behavioral interaction data (interaction frequency, user trajectories, eye-tracking), and task-based metrics.
The methodology alternates between development and empirical evaluation phases. On the development side, components targeting believability — including emotional expressivity and situated interaction capabilities — are designed and implemented. On the evaluation side, user studies are conducted in XR environments using presence scales, believability questionnaires, and behavioral data collected during interaction.
Teaching
Teachings
Master of Science
- Game Design and Gamification. A.A. 2024/25, INGEGNERIA DEL CINEMA E DEI MEZZI DI COMUNICAZIONE. Collaboratore del corso
Bachelor of Science
- Informatica. A.A. 2025/26, INGEGNERIA AEROSPAZIALE. Collaboratore del corso
- Informatica. A.A. 2024/25, INGEGNERIA AEROSPAZIALE. Collaboratore del corso
Research
Research groups
Publications
Latest publications View all publications in Porto@Iris
- Calzolari, Stefano; Montanha, Rubens; Schneider, Gabriel; Wide, Gustavo; Knob, Paulo; ... (In stampa)
LLM-Driven Personalities for Decision Making in Emergency Simulations. In: International Conference on Computer Animation, Social Agents, and Extended Reality CASAXR 26, Ginevra (CH), Giugno 1-3, 2026
Contributo in Atti di Convegno (Proceeding) - Pecora, Alessandro Emmanuel; Calzolari, Stefano; Strada, Francesco; Bottino, Andrea (In stampa)
A.D.A.M.O. (Agent for language-Driven Actions with Multimodal Observations): A Visual-Symbolic Framework for Virtual Humans. In: International Conference on Computer Animation, Social Agents, and Extended Reality (CASAXR26), Geneva (Switzerland), 1-3 June 2026. ISSN 0302-9743
Contributo in Atti di Convegno (Proceeding) - Calzolari, Stefano; Annicchiarico, Ciro; Strada, Francesco; Bottino, Andrea (2026)
From Words to Emotions : Evaluating Text-to-Motion Body Language for Believable Emotions in Virtual Humans. In: International Conference on eXtended Reality (XR Salento) 2025, Otranto, Italia, June 17–20, 2025, pp. 134-153. ISSN 0302-9743. ISBN: 978-3-031-97777-0
Contributo in Atti di Convegno (Proceeding) - Calzolari, Stefano; Strada, Francesco; Bottino, Andrea (2026)
Toward Believable Emotions: Evaluating FACS Coding for Virtual Human Expressions. In: IEEE CONSUMER ELECTRONICS MAGAZINE, vol. 15, pp. 22-32. ISSN 2162-2248
Contributo su Rivista - Calzolari, Stefano; Strada, Francesco; Bottino, Andrea (2024)
The quest for believability: exploring FACS adaptations for emotion facial expressions in virtual humans. In: IEEE Games Media Entertainment (GEM) 2024, Torino (ITA), 05-07 June 2024. ISBN: 979-8-3503-7453-7
Contributo in Atti di Convegno (Proceeding)