Publications
Search
81.
Lee, Jina; Marsella, Stacy C.
Modeling Side Participants and Bystanders: The Importance of Being a Laugh Track Proceedings Article
In: Proceedings of the 11th Conference on Intelligent Virtual Agents, Reykjavik, Iceland, 2011.
@inproceedings{lee_modeling_2011,
title = {Modeling Side Participants and Bystanders: The Importance of Being a Laugh Track},
author = {Jina Lee and Stacy C. Marsella},
url = {http://ict.usc.edu/pubs/Modeling%20Side%20Participants%20and%20Bystanders.pdf},
year = {2011},
date = {2011-09-01},
booktitle = {Proceedings of the 11th Conference on Intelligent Virtual Agents},
address = {Reykjavik, Iceland},
abstract = {Research in virtual agents has largely ignored the role and behavior of side participants and especially bystanders. Our view is that the behavior of these other participants is critical in multi-party interactions, especially in interactive drama. In this paper, we provide an analysis of nonverbal behaviors associated with these roles. We ⬚first review studies of interpersonal relationships and nonverbal behavior. From this review, we construct an analysis framework based on characters' interpersonal relationships, conversational roles, and communicative acts. We then assess this framework by analyzing improv sessions of an old west scenario involving 4 characters. Informed by this analysis, we implemented a general model for participant and bystander behavior.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Research in virtual agents has largely ignored the role and behavior of side participants and especially bystanders. Our view is that the behavior of these other participants is critical in multi-party interactions, especially in interactive drama. In this paper, we provide an analysis of nonverbal behaviors associated with these roles. We ⬚first review studies of interpersonal relationships and nonverbal behavior. From this review, we construct an analysis framework based on characters' interpersonal relationships, conversational roles, and communicative acts. We then assess this framework by analyzing improv sessions of an old west scenario involving 4 characters. Informed by this analysis, we implemented a general model for participant and bystander behavior.
82.
Wang, Zhiyang; Lee, Jina; Marsella, Stacy C.
Towards More Comprehensive Listening Behavior: Beyond the Bobble Head Proceedings Article
In: The 11th International Conference on Intelligent Virtual Agents (IVA 2011), ReykjavÃk, Iceland, 2011.
@inproceedings{wang_towards_2011,
title = {Towards More Comprehensive Listening Behavior: Beyond the Bobble Head},
author = {Zhiyang Wang and Jina Lee and Stacy C. Marsella},
url = {http://ict.usc.edu/pubs/Towards%20More%20Comprehensive%20Listening%20Behavior-%20Beyond%20the%20Bobble%20Head.pdf},
year = {2011},
date = {2011-09-01},
booktitle = {The 11th International Conference on Intelligent Virtual Agents (IVA 2011)},
address = {ReykjavÃk, Iceland},
abstract = {Realizing effective listening behavior in virtual humans has become a key area of research, especially as research has sought to realize more complex social scenarios involving multiple participants and bystanders. A human listener's nonverbal behavior is conditioned by a variety of factors, from current speaker's behavior to the listener's role and desire to participate in the conversation and unfolding comprehension of the speaker. Similarly, we seek to create virtual humans able to provide feedback based on their participatory goals and their partial understanding of, and reaction to, the relevance of what the speaker is saying as the speaker speaks. Based on a survey of existing psychological literature as well as recent technological advances in recognition and partial understanding of natural language, we describe a model of how to integrate these factors into a virtual human that behaves consistently with these goals.We then discuss how the model is implemented into a virtual human architecture and present an evaluation of behaviors used in the model.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Realizing effective listening behavior in virtual humans has become a key area of research, especially as research has sought to realize more complex social scenarios involving multiple participants and bystanders. A human listener's nonverbal behavior is conditioned by a variety of factors, from current speaker's behavior to the listener's role and desire to participate in the conversation and unfolding comprehension of the speaker. Similarly, we seek to create virtual humans able to provide feedback based on their participatory goals and their partial understanding of, and reaction to, the relevance of what the speaker is saying as the speaker speaks. Based on a survey of existing psychological literature as well as recent technological advances in recognition and partial understanding of natural language, we describe a model of how to integrate these factors into a virtual human that behaves consistently with these goals.We then discuss how the model is implemented into a virtual human architecture and present an evaluation of behaviors used in the model.
83.
Chiu, Chung-Cheng; Marsella, Stacy C.
How to train your avatar: A data driven approach to gesture generation Proceedings Article
In: The 11th International Conference on Intelligent Virtual Agents (IVA 2011), ReykjavÃk, Iceland, 2011.
@inproceedings{chiu_how_2011,
title = {How to train your avatar: A data driven approach to gesture generation},
author = {Chung-Cheng Chiu and Stacy C. Marsella},
url = {http://ict.usc.edu/pubs/How%20to%20train%20your%20avatar.pdf},
year = {2011},
date = {2011-09-01},
booktitle = {The 11th International Conference on Intelligent Virtual Agents (IVA 2011)},
address = {ReykjavÃk, Iceland},
abstract = {The ability to gesture is key to realizing virtual characters that can engage in face-to-face interaction with people. Many applications take an approach of predefining possible utterances of a virtual character and building all the gesture animations needed for those utterances. We can save effort on building a virtual human if we can construct a general gesture controller that will generate behavior for novel utterances. Because the dynamics of human gestures are related to the prosody of speech, in this work we propose a model to generate gestures based on prosody. We then assess the naturalness of the animations by comparing them against human gestures. The evaluation results were promising, human judgments show no significant difference between our generated gestures and human gestures and the generated gestures were judged as significantly better than real human gestures from a different utterance.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
The ability to gesture is key to realizing virtual characters that can engage in face-to-face interaction with people. Many applications take an approach of predefining possible utterances of a virtual character and building all the gesture animations needed for those utterances. We can save effort on building a virtual human if we can construct a general gesture controller that will generate behavior for novel utterances. Because the dynamics of human gestures are related to the prosody of speech, in this work we propose a model to generate gestures based on prosody. We then assess the naturalness of the animations by comparing them against human gestures. The evaluation results were promising, human judgments show no significant difference between our generated gestures and human gestures and the generated gestures were judged as significantly better than real human gestures from a different utterance.
84.
Ito, Jonathan Y.; Marsella, Stacy C.
Contextually-Based Utility: An Appraisal-Based Approach at Modeling Framing and Decisions Proceedings Article
In: The 25th Conference on Artificail Intelligence (AAAI-11), San Francisco, CA, 2011.
@inproceedings{ito_contextually-based_2011,
title = {Contextually-Based Utility: An Appraisal-Based Approach at Modeling Framing and Decisions},
author = {Jonathan Y. Ito and Stacy C. Marsella},
url = {http://ict.usc.edu/pubs/Contextually-Based%20Utility-%20An%20Appraisal-Based%20Approach%20at%20Modeling%20Framing%20and%20Decisions.pdf},
year = {2011},
date = {2011-08-01},
booktitle = {The 25th Conference on Artificail Intelligence (AAAI-11)},
address = {San Francisco, CA},
abstract = {Creating accurate computational models of human decision making is a vital step towards the realization of socially intelligent systems capable of both predicting and simulating human behavior. In modeling human decision making, a key factor is the psychological phenomenon known as "framing", in which the preferences of a decision maker change in response to contextual changes in decision problems. Existing approaches treat framing as a one-dimensional contextual influence based on the perception of outcomes as either gains or losses. However, empirical studies have shown that framing effects are much more multifaceted than one-dimensional views of framing suggest. To address this limitation, we propose an integrative approach to modeling framing which combines the psychological principles of cognitive appraisal theories and decision-theoretic notions of utility and probability. We show that this approach allows for both the identification and computation of the salient contextual factors in a decision as well as modeling how they ultimately affect the decision process. Furthermore, we show that our multidimensional, appraisal-based approach can account for framing effects identified in the empirical literature which cannot be addressed by one-dimensional theories, thereby promising more accurate models of human behavior.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Creating accurate computational models of human decision making is a vital step towards the realization of socially intelligent systems capable of both predicting and simulating human behavior. In modeling human decision making, a key factor is the psychological phenomenon known as "framing", in which the preferences of a decision maker change in response to contextual changes in decision problems. Existing approaches treat framing as a one-dimensional contextual influence based on the perception of outcomes as either gains or losses. However, empirical studies have shown that framing effects are much more multifaceted than one-dimensional views of framing suggest. To address this limitation, we propose an integrative approach to modeling framing which combines the psychological principles of cognitive appraisal theories and decision-theoretic notions of utility and probability. We show that this approach allows for both the identification and computation of the salient contextual factors in a decision as well as modeling how they ultimately affect the decision process. Furthermore, we show that our multidimensional, appraisal-based approach can account for framing effects identified in the empirical literature which cannot be addressed by one-dimensional theories, thereby promising more accurate models of human behavior.
85.
Melo, Celso M.; Gratch, Jonathan; Carnevale, Peter
Reverse Appraisal: Inferring from Emotion Displays who is the Cooperator and the Competitor in a Social Dilemma Proceedings Article
In: The 33rd Annual Meeting of the Cognitive Science Society (CogSci) 2011, Boston, MA, 2011.
@inproceedings{de_melo_reverse_2011,
title = {Reverse Appraisal: Inferring from Emotion Displays who is the Cooperator and the Competitor in a Social Dilemma},
author = {Celso M. Melo and Jonathan Gratch and Peter Carnevale},
url = {http://ict.usc.edu/pubs/Reverse%20Appraisal-%20Inferring%20from%20Emotion%20Displays%20who%20is%20the%20Cooperator%20and%20the%20Competitor%20in%20a%20Social%20Dilemma.pdf},
year = {2011},
date = {2011-07-01},
booktitle = {The 33rd Annual Meeting of the Cognitive Science Society (CogSci) 2011},
address = {Boston, MA},
abstract = {This paper explores whether and how facial displays of emotion can impact emergence of cooperation in a social dilemma. Three experiments are described where participants play the iterated prisoner's dilemma with (computer) players that display emotion. Experiment 1 compares a cooperative player, whose displays reflect a goal of mutual cooperation, with a control player that shows no emotion. Experiment 2 compares a competitive player, whose displays reflect a goal of getting more points than the participant, and the control player. Experiment 3 compares the cooperative and competitive players. Results show that people: cooperate more with the cooperative than the control player (Experiment 1); do not cooperate differently with the competitive and control players (Experiment 2); and, cooperate more with the cooperative than the competitive player, when they play the latter first (Experiment 3). In line with a social functions view of emotion, we argue people infer, from emotion displays, the other player's propensity to cooperate by reversing the emotion appraisal process. Post- game surveys show that people interpret the emotion displays according to appraisal variables (desirability, responsibility and controllability) in ways that are consistent with predictions from appraisal theories of emotion.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
This paper explores whether and how facial displays of emotion can impact emergence of cooperation in a social dilemma. Three experiments are described where participants play the iterated prisoner's dilemma with (computer) players that display emotion. Experiment 1 compares a cooperative player, whose displays reflect a goal of mutual cooperation, with a control player that shows no emotion. Experiment 2 compares a competitive player, whose displays reflect a goal of getting more points than the participant, and the control player. Experiment 3 compares the cooperative and competitive players. Results show that people: cooperate more with the cooperative than the control player (Experiment 1); do not cooperate differently with the competitive and control players (Experiment 2); and, cooperate more with the cooperative than the competitive player, when they play the latter first (Experiment 3). In line with a social functions view of emotion, we argue people infer, from emotion displays, the other player's propensity to cooperate by reversing the emotion appraisal process. Post- game surveys show that people interpret the emotion displays according to appraisal variables (desirability, responsibility and controllability) in ways that are consistent with predictions from appraisal theories of emotion.
86.
Chiu, Chung-Cheng; Marsella, Stacy C.
A style controller for generating virtual human behaviors Proceedings Article
In: The Tenth International Conference on Autonomous Agents and Multiagent Systems, Taipei, Taiwan, 2011.
@inproceedings{chiu_style_2011,
title = {A style controller for generating virtual human behaviors},
author = {Chung-Cheng Chiu and Stacy C. Marsella},
url = {http://ict.usc.edu/pubs/A%20style%20controller%20for%20generating%20virtual%20human%20behaviors.pdf},
year = {2011},
date = {2011-05-01},
booktitle = {The Tenth International Conference on Autonomous Agents and Multiagent Systems},
address = {Taipei, Taiwan},
abstract = {Creating a virtual character that exhibits realistic physical behaviors requires a rich set of animations. To mimic the variety as well as the subtlety of human behavior, we may need to animate not only a wide range of behaviors but also variations of the same type of behavior influenced by the environment and the state of the character, including the emotional and physiological state. A general approach to this challenge is to gather a set of animations produced by artists or motion capture. However, this approach can be extremely costly in time and effort. In this work, we propose a model that can learn styled motion generation and an algorithm that produce new styles of motions via style interpolation. The model takes a set of styled motions as training samples and creates new motions that are the generalization among the given styles. Our style interpolation algorithm can blend together motions with distinct styles, and improves on the performance of previous work. We verify our algorithm using walking motions of different styles, and the experimental results show that our method is signiï¬cantly better than previous work.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Creating a virtual character that exhibits realistic physical behaviors requires a rich set of animations. To mimic the variety as well as the subtlety of human behavior, we may need to animate not only a wide range of behaviors but also variations of the same type of behavior influenced by the environment and the state of the character, including the emotional and physiological state. A general approach to this challenge is to gather a set of animations produced by artists or motion capture. However, this approach can be extremely costly in time and effort. In this work, we propose a model that can learn styled motion generation and an algorithm that produce new styles of motions via style interpolation. The model takes a set of styled motions as training samples and creates new motions that are the generalization among the given styles. Our style interpolation algorithm can blend together motions with distinct styles, and improves on the performance of previous work. We verify our algorithm using walking motions of different styles, and the experimental results show that our method is signiï¬cantly better than previous work.
87.
Tsai, Jason; Fridman, Natalie; Bowring, Emma; Brown, Matthew; Epstein, Shira; Kaminka, Gal; Marsella, Stacy C.; Ogden, Andrew; Rika, Inbal; Sheel, Ankur; Taylor, Matthew; Wang, Xuezhi; Zilka, Avishay; Tambe, Milind
ESCAPES - Evacuation Simulation with Children, Authorities, Parents, Emotions, and Social comparison Proceedings Article
In: International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Taipei, Taiwan, 2011.
@inproceedings{tsai_escapes_2011,
title = {ESCAPES - Evacuation Simulation with Children, Authorities, Parents, Emotions, and Social comparison},
author = {Jason Tsai and Natalie Fridman and Emma Bowring and Matthew Brown and Shira Epstein and Gal Kaminka and Stacy C. Marsella and Andrew Ogden and Inbal Rika and Ankur Sheel and Matthew Taylor and Xuezhi Wang and Avishay Zilka and Milind Tambe},
url = {http://ict.usc.edu/pubs/ESCAPES%20-%20Evacuation%20Simulation%20with%20Children,%20Authorities,%20Parents,%20Emotions,%20and%20Social%20comparison.pdf},
year = {2011},
date = {2011-05-01},
booktitle = {International Conference on Autonomous Agents and Multiagent Systems (AAMAS)},
address = {Taipei, Taiwan},
abstract = {In creating an evacuation simulation for training and planning, realistic agents that reproduce known phenomenon are required. Evacuation simulation in the airport domain requires additional features beyond most simulations, including the unique behaviors of first time visitors who have incomplete knowledge of the area and families that do not necessarily adhere to often-assumed pedestrian behaviors. Evacuation simulations not customized for the airport domain do not incorporate the factors important to it, leading to inaccuracies when applied to it. In this paper, we describe ESCAPES, a multiagent evacuation simulation tool that incorporates four key features: (i) different agent types; (ii) emotional interactions; (iii) informational interactions; (iv) behavioral interactions. Our simulator reproduces phenomena observed in existing studies on evacuation scenarios and the features we incorporate substantially impact escape time. We use ESCAPES to model the International Terminal at Los Angeles International Airport (LAX) and receive high praise from security officials.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
In creating an evacuation simulation for training and planning, realistic agents that reproduce known phenomenon are required. Evacuation simulation in the airport domain requires additional features beyond most simulations, including the unique behaviors of first time visitors who have incomplete knowledge of the area and families that do not necessarily adhere to often-assumed pedestrian behaviors. Evacuation simulations not customized for the airport domain do not incorporate the factors important to it, leading to inaccuracies when applied to it. In this paper, we describe ESCAPES, a multiagent evacuation simulation tool that incorporates four key features: (i) different agent types; (ii) emotional interactions; (iii) informational interactions; (iv) behavioral interactions. Our simulator reproduces phenomena observed in existing studies on evacuation scenarios and the features we incorporate substantially impact escape time. We use ESCAPES to model the International Terminal at Los Angeles International Airport (LAX) and receive high praise from security officials.
88.
Pynadath, David V.; Si, Mei; Marsella, Stacy C.
Modeling Theory of Mind and Cognitive Appraisal with Decision-Theoretic Agents Book Section
In: Appraisal, pp. 1–30, 2011.
@incollection{pynadath_modeling_2011,
title = {Modeling Theory of Mind and Cognitive Appraisal with Decision-Theoretic Agents},
author = {David V. Pynadath and Mei Si and Stacy C. Marsella},
url = {http://ict.usc.edu/pubs/Modeling%20Theory%20of%20Mind%20and%20Cognitive%20Appraisal%20with%20Decision-Theoretic%20Agents.pdf},
year = {2011},
date = {2011-04-01},
booktitle = {Appraisal},
pages = {1–30},
abstract = {Agent-based simulation of human social behavior has become increasingly important as a basic research tool to further our understanding of social behavior, as well as to create virtual social worlds used to both entertain and educate. A key factor in human social interaction is our beliefs about others as intentional agents, a Theory of Mind. How we act depends not only on the immediate effect of our actions but also on how we believe others will react. In this paper, we discuss PsychSim, an implemented multiagent-based simulation tool for modeling social interaction and influence. While typical approaches to such modeling have used first-order logic, PsychSim agents have their own decision-theoretic models of the world, including beliefs about their environment and recursive models of other agents. Using these quantitative models of uncertainty and preferences, we have translated existing psychological theories into a decision-theoretic semantics that allow the agents to reason about degrees of believability in a novel way. We demonstrate the expressiveness of PsychSim’s decision-theoretic implementation of Theory of Mind by presenting its use as the foundation for a domain-independent model of appraisal theory, the leading psychological theory of emotion. The model of appraisal within PsychSim demonstrates the key role of a Theory of Mind capacity in appraisal and social emotions, as well as arguing for a uniform process for emotion and cognition.},
keywords = {},
pubstate = {published},
tppubtype = {incollection}
}
Agent-based simulation of human social behavior has become increasingly important as a basic research tool to further our understanding of social behavior, as well as to create virtual social worlds used to both entertain and educate. A key factor in human social interaction is our beliefs about others as intentional agents, a Theory of Mind. How we act depends not only on the immediate effect of our actions but also on how we believe others will react. In this paper, we discuss PsychSim, an implemented multiagent-based simulation tool for modeling social interaction and influence. While typical approaches to such modeling have used first-order logic, PsychSim agents have their own decision-theoretic models of the world, including beliefs about their environment and recursive models of other agents. Using these quantitative models of uncertainty and preferences, we have translated existing psychological theories into a decision-theoretic semantics that allow the agents to reason about degrees of believability in a novel way. We demonstrate the expressiveness of PsychSim’s decision-theoretic implementation of Theory of Mind by presenting its use as the foundation for a domain-independent model of appraisal theory, the leading psychological theory of emotion. The model of appraisal within PsychSim demonstrates the key role of a Theory of Mind capacity in appraisal and social emotions, as well as arguing for a uniform process for emotion and cognition.
89.
Miller, Lynn C.; Marsella, Stacy C.; Dey, Teresa; Appleby, Paul Robert; Christensen, John L.; Klatt, Jennifer; Read, Stephen J.
Socially Optimized Learning in Virtual Environments (SOLVE) Proceedings Article
In: 4th International Conference on Interactive Digital Storytelling, Vancouver, British Columbia, 2011.
@inproceedings{miller_socially_2011,
title = {Socially Optimized Learning in Virtual Environments (SOLVE)},
author = {Lynn C. Miller and Stacy C. Marsella and Teresa Dey and Paul Robert Appleby and John L. Christensen and Jennifer Klatt and Stephen J. Read},
url = {http://ict.usc.edu/pubs/Socially%20Optimized%20Learning%20in%20Virtual%20Environments%20(SOL%20VE).pdf},
year = {2011},
date = {2011-01-01},
booktitle = {4th International Conference on Interactive Digital Storytelling},
address = {Vancouver, British Columbia},
abstract = {Although young men who have sex with men (MSM) are at high risk for contracting HIV, few interventions address the affective/automatic factors (e.g., sexual arousal, shame/stigma) that may precipitate young MSM’s risk- taking. A National Institutes of Health (NIH)-funded DVD interactive video intervention that simulated a "virtual date" with guides/mentors reduced sexual risk over 3-months for Black, Latino and Caucasian young MSM. In the current work, limitations of the DVD format (e.g., number of different risk challenges MSM encounter; DVD quickly becomes dated) were addressed with 3-D animated intelligent agents/interactive digital storytelling using a Unity Game platform. The development (e.g., design, art, social science formative research, etc.) of this NIH funded game for changing risky behavior is described as well as the ongoing national randomized "on-line" evaluation over 6 months.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Although young men who have sex with men (MSM) are at high risk for contracting HIV, few interventions address the affective/automatic factors (e.g., sexual arousal, shame/stigma) that may precipitate young MSM’s risk- taking. A National Institutes of Health (NIH)-funded DVD interactive video intervention that simulated a "virtual date" with guides/mentors reduced sexual risk over 3-months for Black, Latino and Caucasian young MSM. In the current work, limitations of the DVD format (e.g., number of different risk challenges MSM encounter; DVD quickly becomes dated) were addressed with 3-D animated intelligent agents/interactive digital storytelling using a Unity Game platform. The development (e.g., design, art, social science formative research, etc.) of this NIH funded game for changing risky behavior is described as well as the ongoing national randomized "on-line" evaluation over 6 months.
90.
Si, Mei; Marsella, Stacy C.; Pynadath, David V.
Importance of Well-Motivated Characters in Interactive Narratives: An Empirical Evaluation Proceedings Article
In: 2010 International Conference on Interactive Digital Storytelling, Edinburgh, UK, 2010.
@inproceedings{si_importance_2010,
title = {Importance of Well-Motivated Characters in Interactive Narratives: An Empirical Evaluation},
author = {Mei Si and Stacy C. Marsella and David V. Pynadath},
url = {http://ict.usc.edu/pubs/Importance%20of%20Well-Motivated%20Characters%20in%20Interactive%20Narratives.pdf},
year = {2010},
date = {2010-11-01},
booktitle = {2010 International Conference on Interactive Digital Storytelling},
address = {Edinburgh, UK},
abstract = {http://ict.usc.edu/pubs/Importance%20of%20Well-Motivated%20Characters%20in%20Interactive%20Narratives.pdf},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
http://ict.usc.edu/pubs/Importance%20of%20Well-Motivated%20Characters%20in%20Interactive%20Narratives.pdf
91.
Lance, Brent; Marsella, Stacy C.
The Expressive Gaze Model: Using Gaze to Express Emotion Journal Article
In: Computer Graphics and Applications, IEEE, vol. 30, no. 4, pp. 62–73, 2010.
@article{lance_expressive_2010,
title = {The Expressive Gaze Model: Using Gaze to Express Emotion},
author = {Brent Lance and Stacy C. Marsella},
url = {http://ict.usc.edu/pubs/The_Expressive_Gaze_Model.pdf},
year = {2010},
date = {2010-08-01},
journal = {Computer Graphics and Applications, IEEE},
volume = {30},
number = {4},
pages = {62–73},
abstract = {The Expressive Gaze Model is a hierarchical framework for composing simple behaviors into emotionally expressive gaze shifts for virtual characters. Its primary components are the Gaze Warping Transformation, which generates emotionally expressive head and torso movement in a gaze shift, and an eye movement model.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
The Expressive Gaze Model is a hierarchical framework for composing simple behaviors into emotionally expressive gaze shifts for virtual characters. Its primary components are the Gaze Warping Transformation, which generates emotionally expressive head and torso movement in a gaze shift, and an eye movement model.
92.
Ito, Jonathan Y.; Pynadath, David V.; Marsella, Stacy C.
Modeling self-deception within a decision-theoretic framework Journal Article
In: Autonomous Agent Multi-Agent Systems, vol. 20, pp. 3–13, 2010.
@article{ito_modeling_2010,
title = {Modeling self-deception within a decision-theoretic framework},
author = {Jonathan Y. Ito and David V. Pynadath and Stacy C. Marsella},
url = {http://ict.usc.edu/pubs/Modeling%20self-deception%20within%20a%20decision-theoretic%20framework.pdf},
doi = {10.1007/s10458-009-9096-7},
year = {2010},
date = {2010-05-01},
journal = {Autonomous Agent Multi-Agent Systems},
volume = {20},
pages = {3–13},
abstract = {Computational modeling of human belief maintenance and decision-making processes has become increasingly important for a wide range of applications. In this paper, we present a framework for modeling the human capacity for self-deception from a decision-theoretic perspective in which we describe an integrated process of wishful thinking which includes the determination of a desired belief state, the biasing of internal beliefs towards or away from this desired belief state, and the final decision-making process. Finally, we show that in certain situations self-deception can be beneficial.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Computational modeling of human belief maintenance and decision-making processes has become increasingly important for a wide range of applications. In this paper, we present a framework for modeling the human capacity for self-deception from a decision-theoretic perspective in which we describe an integrated process of wishful thinking which includes the determination of a desired belief state, the biasing of internal beliefs towards or away from this desired belief state, and the final decision-making process. Finally, we show that in certain situations self-deception can be beneficial.
93.
Ito, Jonathan Y.; Pynadath, David V.; Sonenberg, Liz; Marsella, Stacy C.
Wishful Thinking in Effective Decision Making (Extended Abstract) Proceedings Article
In: Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems, Toronto, Ontario, 2010.
@inproceedings{ito_wishful_2010,
title = {Wishful Thinking in Effective Decision Making (Extended Abstract)},
author = {Jonathan Y. Ito and David V. Pynadath and Liz Sonenberg and Stacy C. Marsella},
url = {http://ict.usc.edu/pubs/Wishful_thinking_extended_abstract.pdf},
year = {2010},
date = {2010-05-01},
booktitle = {Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems},
volume = {1},
address = {Toronto, Ontario},
abstract = {Creating agents that act reasonably in uncertain environments is a primary goal of agent-based research. In this work we explore the theory that wishful thinking can be an effective strategy in uncertain and competitive decision scenarios. Specifically, we present the constraints necessary for wishful thinking to outperform Expected Utility Maximization and take instances of popular games from Game-Theoretic literature showing how they relate to our constraints and whether they can benefit from wishful-thinking.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Creating agents that act reasonably in uncertain environments is a primary goal of agent-based research. In this work we explore the theory that wishful thinking can be an effective strategy in uncertain and competitive decision scenarios. Specifically, we present the constraints necessary for wishful thinking to outperform Expected Utility Maximization and take instances of popular games from Game-Theoretic literature showing how they relate to our constraints and whether they can benefit from wishful-thinking.
94.
Si, Mei; Marsella, Stacy C.; Pynadath, David V.
Evaluating Directorial Control in a Character-Centric Interactive Narrative Framework Proceedings Article
In: International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Toronto, Canada, 2010.
@inproceedings{si_evaluating_2010,
title = {Evaluating Directorial Control in a Character-Centric Interactive Narrative Framework},
author = {Mei Si and Stacy C. Marsella and David V. Pynadath},
url = {http://ict.usc.edu/pubs/Evaluating%20Directorial%20Control%20in%20a%20Character-Centric%20Interactive%20Narrative%20Framework.pdf},
year = {2010},
date = {2010-05-01},
booktitle = {International Conference on Autonomous Agents and Multiagent Systems (AAMAS)},
address = {Toronto, Canada},
abstract = {Interactive narrative allows the user to play a role in a story and interact with other characters controlled by the system. Directorial control is a procedure for dynamically tuning the interaction towards the author's desired effects. Most existing approaches for directorial control are built within plot-centric frameworks for interactive narrative and do not have a systematic way to ensure that the characters are always well-motivated during the interaction. Thespian is a character-centric framework for interactive narrative. In our previous work on Thespian, we presented an approach for applying directorial control while not affecting the consistency of characters' motivations. This work evaluates the effectiveness of our directorial control approach. Given the priority of generating only well-motivated characters' behaviors, we empirically evaluate how often the author's desired effects are achieved. We also discuss how the directorial control procedure can save the author effort in configuring the characters.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Interactive narrative allows the user to play a role in a story and interact with other characters controlled by the system. Directorial control is a procedure for dynamically tuning the interaction towards the author's desired effects. Most existing approaches for directorial control are built within plot-centric frameworks for interactive narrative and do not have a systematic way to ensure that the characters are always well-motivated during the interaction. Thespian is a character-centric framework for interactive narrative. In our previous work on Thespian, we presented an approach for applying directorial control while not affecting the consistency of characters' motivations. This work evaluates the effectiveness of our directorial control approach. Given the priority of generating only well-motivated characters' behaviors, we empirically evaluate how often the author's desired effects are achieved. We also discuss how the directorial control procedure can save the author effort in configuring the characters.
95.
Si, Mei; Marsella, Stacy C.
Modeling Rich Characters in Interactive Narrative Games Proceedings Article
In: GAMEON-ASIA 2010, pp. 14–31, Shanghai, China, 2010.
@inproceedings{si_modeling_2010,
title = {Modeling Rich Characters in Interactive Narrative Games},
author = {Mei Si and Stacy C. Marsella},
url = {http://ict.usc.edu/pubs/Modeling%20Rich%20Characters%20in%20Interactive%20Narrative%20Games.pdf},
year = {2010},
date = {2010-03-01},
booktitle = {GAMEON-ASIA 2010},
volume = {20(1)},
pages = {14–31},
address = {Shanghai, China},
abstract = {Computing technologies have advanced rapidly over the past decade. Faster machines, better graphics, and more advanced algorithms become available every year. Moreover, the evolution of internet technology and the increasing accessibility of computing resources and mobile devices allow computing technologies to go beyond business and scientific computing, and become an important means for providing entertainment and facilitating communication. These advances have helped to enable a new form of media – interactive narrative games. Interactive narrative games allow a user to play a role in a story and interact with other characters driven by AI agents. The user's choices affect the unfolding of the story. Because of the support of user interactivity and the use of computer simulated virtual environments, interactive narrative games are closely related to video games. In fact, the rapid growth of interest in interactive narrative games is in part motivated by the explosion of computer-based games in recent years. Compared to more traditional forms of video games, such as arcade games, action games, and even role playing games, interactive narrative games emphasize more of the social and narrative aspects of the experi- ence. Story, of course, is a central part of the human experience both as entertainment and as a powerful tool for providing pedagogy. We watch movies, read novels and tell stories. Interactive narrative games provide an experience that integrates user agency with the engaging power of narrative. Interactive narrative games have been recognized as a promising tool for providing both pedagogy and entertainment. They have been proposed for a range of training applications, e.g. [13, 20, 26, 35, 22] as well as entertainment applications, e.g. [10, 23, 3, 12, 11, 36]. In this paper, we discuss the design desiderata for interactive narrative games, and in particular for creating the virtual characters in interactive narrative games. We argue that a rich model of characters that are well-motivated, socially aware and have a "Theory of Mind" is needed. We discuss the state of the art work on modeling virtual characters. In particular, we present the approaches taken in Thes- pian [27, 26, 28, 29, 31, 30] – a decision-theoretic multi-agent framework for interactive narratives.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Computing technologies have advanced rapidly over the past decade. Faster machines, better graphics, and more advanced algorithms become available every year. Moreover, the evolution of internet technology and the increasing accessibility of computing resources and mobile devices allow computing technologies to go beyond business and scientific computing, and become an important means for providing entertainment and facilitating communication. These advances have helped to enable a new form of media – interactive narrative games. Interactive narrative games allow a user to play a role in a story and interact with other characters driven by AI agents. The user's choices affect the unfolding of the story. Because of the support of user interactivity and the use of computer simulated virtual environments, interactive narrative games are closely related to video games. In fact, the rapid growth of interest in interactive narrative games is in part motivated by the explosion of computer-based games in recent years. Compared to more traditional forms of video games, such as arcade games, action games, and even role playing games, interactive narrative games emphasize more of the social and narrative aspects of the experi- ence. Story, of course, is a central part of the human experience both as entertainment and as a powerful tool for providing pedagogy. We watch movies, read novels and tell stories. Interactive narrative games provide an experience that integrates user agency with the engaging power of narrative. Interactive narrative games have been recognized as a promising tool for providing both pedagogy and entertainment. They have been proposed for a range of training applications, e.g. [13, 20, 26, 35, 22] as well as entertainment applications, e.g. [10, 23, 3, 12, 11, 36]. In this paper, we discuss the design desiderata for interactive narrative games, and in particular for creating the virtual characters in interactive narrative games. We argue that a rich model of characters that are well-motivated, socially aware and have a "Theory of Mind" is needed. We discuss the state of the art work on modeling virtual characters. In particular, we present the approaches taken in Thes- pian [27, 26, 28, 29, 31, 30] – a decision-theoretic multi-agent framework for interactive narratives.
96.
Si, Mei; Marsella, Stacy C.; Pynadath, David V.
Modeling appraisal in theory of mind reasoning Proceedings Article
In: Journal of Autonomous Agents and Multi-Agent Systems; Proceedings of the 8th International Conference on Intelligent Virtual Agents, pp. 14–31, Tokyo, Japan, 2010.
@inproceedings{si_modeling_2010-1,
title = {Modeling appraisal in theory of mind reasoning},
author = {Mei Si and Stacy C. Marsella and David V. Pynadath},
url = {http://ict.usc.edu/pubs/Modeling%20appraisal%20in%20theory%20of%20mind%20reasoning.pdf},
year = {2010},
date = {2010-01-01},
booktitle = {Journal of Autonomous Agents and Multi-Agent Systems; Proceedings of the 8th International Conference on Intelligent Virtual Agents},
volume = {20(1)},
pages = {14–31},
address = {Tokyo, Japan},
abstract = {Cognitive appraisal theories, which link human emotional experience to their interpretations of events happening in the environment, are leading approaches to model emotions. Cognitive appraisal theories have often been used both for simulating "real emotions" in virtual characters and for predicting the human user's emotional experience to facilitate human-computer interaction. In this work, we investigate the computational modeling of appraisal in a multi-agent decision-theoretic framework using Partially Observable Markov Decision Process-based (POMDP) agents. Domain-independent approaches are developed for five key appraisal dimensions (motivational relevance, motivation congruence, accountability, control and novelty). We also discuss how the modeling of theory of mind (recursive beliefs about self and others) is realized in the agents and is critical for simulating social emotions. Our model of appraisal is applied to three different scenarios to illustrate its usages. This work not only provides a solution for computationally modeling emotion in POMDPbased agents, but also illustrates the tight relationship between emotion and cognition – the appraisal dimensions are derived from the processes and information required for the agent's decision-making and beliefmaintenance processes, which suggests a uniform cognitive structure for emotion and cognition.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Cognitive appraisal theories, which link human emotional experience to their interpretations of events happening in the environment, are leading approaches to model emotions. Cognitive appraisal theories have often been used both for simulating "real emotions" in virtual characters and for predicting the human user's emotional experience to facilitate human-computer interaction. In this work, we investigate the computational modeling of appraisal in a multi-agent decision-theoretic framework using Partially Observable Markov Decision Process-based (POMDP) agents. Domain-independent approaches are developed for five key appraisal dimensions (motivational relevance, motivation congruence, accountability, control and novelty). We also discuss how the modeling of theory of mind (recursive beliefs about self and others) is realized in the agents and is critical for simulating social emotions. Our model of appraisal is applied to three different scenarios to illustrate its usages. This work not only provides a solution for computationally modeling emotion in POMDPbased agents, but also illustrates the tight relationship between emotion and cognition – the appraisal dimensions are derived from the processes and information required for the agent's decision-making and beliefmaintenance processes, which suggests a uniform cognitive structure for emotion and cognition.
97.
Lee, Jina; Wang, Zhiyang; Marsella, Stacy C.
Evaluating Models of Speaker Head Nods for Virtual Agents Proceedings Article
In: International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Toronto, Canada, 2010.
@inproceedings{lee_evaluating_2010,
title = {Evaluating Models of Speaker Head Nods for Virtual Agents},
author = {Jina Lee and Zhiyang Wang and Stacy C. Marsella},
url = {http://ict.usc.edu/pubs/Evaluating%20Models%20of%20Speaker%20Head%20Nods%20for%20Virtual%20Agents.pdf},
year = {2010},
date = {2010-01-01},
booktitle = {International Conference on Autonomous Agents and Multiagent Systems (AAMAS)},
address = {Toronto, Canada},
abstract = {Virtual human research has often modeled nonverbal behaviors based on the findings of psychological research. In recent years, however, there have been growing efforts to use automated, data-driven approaches to find patterns of nonverbal behaviors in video corpora and even thereby discover new factors that have not been previously documented. However, there have been few studies that compare how the behaviors generated by different approaches are interpreted by people. In this paper, we present an evaluation study to compare the perception of nonverbal behaviors, more specifically head nods, generated by different approaches. Studies have shown that head nods serve a variety of communicative functions and that the head is in constant motion during speaking turns. To evaluate the different approaches of head nod generation, we asked human subjects to evaluate videos of a virtual agent displaying nods generated by a human, by a machine learning data-driven approach, or by a handcrafted rule-based approach. Results show that there is a significant effect on the perception of head nods in terms of appropriate nod occurrence, especially between the data driven approach and the rule-based approach.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Virtual human research has often modeled nonverbal behaviors based on the findings of psychological research. In recent years, however, there have been growing efforts to use automated, data-driven approaches to find patterns of nonverbal behaviors in video corpora and even thereby discover new factors that have not been previously documented. However, there have been few studies that compare how the behaviors generated by different approaches are interpreted by people. In this paper, we present an evaluation study to compare the perception of nonverbal behaviors, more specifically head nods, generated by different approaches. Studies have shown that head nods serve a variety of communicative functions and that the head is in constant motion during speaking turns. To evaluate the different approaches of head nod generation, we asked human subjects to evaluate videos of a virtual agent displaying nods generated by a human, by a machine learning data-driven approach, or by a handcrafted rule-based approach. Results show that there is a significant effect on the perception of head nods in terms of appropriate nod occurrence, especially between the data driven approach and the rule-based approach.
98.
Marsella, Stacy C.; Gratch, Jonathan; Petta, Paola
Computational Models of Emotion Book Section
In: Scherer, K. R.; Bänziger, T.; Roesch, (Ed.): A blueprint for an affectively competent agent: Cross-fertilization between Emotion Psychology, Affective Neuroscience, and Affective Computing, Oxford University Press, Oxford, 2010.
@incollection{marsella_computational_2010,
title = {Computational Models of Emotion},
author = {Stacy C. Marsella and Jonathan Gratch and Paola Petta},
editor = {K. R. Scherer and T. Bänziger and Roesch},
url = {http://ict.usc.edu/pubs/Computational%20Models%20of%20Emotion.pdf},
year = {2010},
date = {2010-01-01},
booktitle = {A blueprint for an affectively competent agent: Cross-fertilization between Emotion Psychology, Affective Neuroscience, and Affective Computing},
publisher = {Oxford University Press},
address = {Oxford},
abstract = {Recent years have seen a significant expansion in research on computational models of human emotional processes, driven both by their potential for basic research on emotion and cognition as well as their promise for an ever increasing range of applications. This has led to a truly interdisciplinary, mutually beneficial partnership between emotion research in psychology and computational science, of which this volume is an exemplar. To understand this partnership and its potential for transforming existing practices in emotion research across disciplines and for disclosing important novel areas of research, we explore in this chapter the history of work in computational models of emotion including the various uses to which they have been put, the theoretical traditions that have shaped their development, and how these uses and traditions are reflected in their underlying architectures.},
keywords = {},
pubstate = {published},
tppubtype = {incollection}
}
Recent years have seen a significant expansion in research on computational models of human emotional processes, driven both by their potential for basic research on emotion and cognition as well as their promise for an ever increasing range of applications. This has led to a truly interdisciplinary, mutually beneficial partnership between emotion research in psychology and computational science, of which this volume is an exemplar. To understand this partnership and its potential for transforming existing practices in emotion research across disciplines and for disclosing important novel areas of research, we explore in this chapter the history of work in computational models of emotion including the various uses to which they have been put, the theoretical traditions that have shaped their development, and how these uses and traditions are reflected in their underlying architectures.
99.
Lance, Brent; Marsella, Stacy C.
Glances, Glares, and Glowering: How Should a Virtual Human Express Emotion Through Gaze? Journal Article
In: Journal Autonomous Agents and Multi-Agent Systems, vol. 20, no. 1, 2010.
@article{lance_glances_2010,
title = {Glances, Glares, and Glowering: How Should a Virtual Human Express Emotion Through Gaze?},
author = {Brent Lance and Stacy C. Marsella},
url = {http://ict.usc.edu/pubs/Glances,%20Glares,%20and%20Glowering-%20How%20Should%20a%20Virtual%20Human%20Express%20Emotion%20Through%20Gaze.pdf},
year = {2010},
date = {2010-01-01},
journal = {Journal Autonomous Agents and Multi-Agent Systems},
volume = {20},
number = {1},
abstract = {Gaze is an extremely powerful expressive signal that is used for many purposes, from expressing emotion to regulating human interaction. The use of gaze as a signal has been exploited to strong effect in hand-animated characters, greatly enhancing the believability of the character's simulated life. However, virtual humans animated in real-time have been less successful at using expressive gaze. One reason for this is that a gaze shift towards any speci?c target can be performed in many different ways, using many different expressive manners of gaze, each of which can potentially imply a different emotional or cognitive internal state. However, there is currently no mapping that describes how a user will attribute these internal states to a virtual character performing a gaze shift in a particular manner. In this paper, we begin to address this by providing the results of an empirical study that explores the mapping between an observer's attribution of emotional state to gaze. The purpose of this mapping is to allow for an interactive virtual human to generate believable gaze shifts that a user will attribute a desired emotional state to. We have generated a set of animations by composing low-level gaze attributes culled from the nonverbal behavior literature. Then, subjects judged the animations displaying these attributes. While the results do not provide a complete mapping between gaze and emotion, they do provide a basis for a generative model of expressive gaze.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Gaze is an extremely powerful expressive signal that is used for many purposes, from expressing emotion to regulating human interaction. The use of gaze as a signal has been exploited to strong effect in hand-animated characters, greatly enhancing the believability of the character's simulated life. However, virtual humans animated in real-time have been less successful at using expressive gaze. One reason for this is that a gaze shift towards any speci?c target can be performed in many different ways, using many different expressive manners of gaze, each of which can potentially imply a different emotional or cognitive internal state. However, there is currently no mapping that describes how a user will attribute these internal states to a virtual character performing a gaze shift in a particular manner. In this paper, we begin to address this by providing the results of an empirical study that explores the mapping between an observer's attribution of emotional state to gaze. The purpose of this mapping is to allow for an interactive virtual human to generate believable gaze shifts that a user will attribute a desired emotional state to. We have generated a set of animations by composing low-level gaze attributes culled from the nonverbal behavior literature. Then, subjects judged the animations displaying these attributes. While the results do not provide a complete mapping between gaze and emotion, they do provide a basis for a generative model of expressive gaze.
100.
Putten, Astrid M.; Kramer, Nicole C.; Gratch, Jonathan
How Our Personality Shapes Our Interactions with Virtual Characters - Implications for Research and Development Proceedings Article
In: 10th International Conference on Intelligent Virtual Agents, Philadelphia, PA, 2010.
@inproceedings{von_der_putten_how_2010,
title = {How Our Personality Shapes Our Interactions with Virtual Characters - Implications for Research and Development},
author = {Astrid M. Putten and Nicole C. Kramer and Jonathan Gratch},
url = {http://ict.usc.edu/pubs/How%20Our%20Personality%20Shapes%20Our%20Interactions%20with%20Virtual%20Characters%20-%20Implications%20for%20Research%20and%20Development.pdf},
year = {2010},
date = {2010-01-01},
booktitle = {10th International Conference on Intelligent Virtual Agents},
address = {Philadelphia, PA},
abstract = {here is a general lack of awareness for the influence of users' personality traits on human-agent-interaction (HAI). Numerous studies do not even consider explanatory variables like age and gender although they are easily accessible. The present study focuses on explaining the occurrence of social effects in HAI. Apart from the original manipulation of the study we assessed the users' traits. Results show that participants' personality traits those traits which relate to persistent behavioral patterns in social contact (agreeableness, extraversion, approach avoidance, self-efficacy in monitoring others, shyness, public self-consciousness) were found to be predictive, whereas other personality traits and gender and age did not affect the evaluation. Results suggest that personality traits are better predictors for the evaluation outcome than the actual behavior of the agent as it has been manipulated in the experiment. Implications for the research on and development of virtual agents are discussed.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
here is a general lack of awareness for the influence of users' personality traits on human-agent-interaction (HAI). Numerous studies do not even consider explanatory variables like age and gender although they are easily accessible. The present study focuses on explaining the occurrence of social effects in HAI. Apart from the original manipulation of the study we assessed the users' traits. Results show that participants' personality traits those traits which relate to persistent behavioral patterns in social contact (agreeableness, extraversion, approach avoidance, self-efficacy in monitoring others, shyness, public self-consciousness) were found to be predictive, whereas other personality traits and gender and age did not affect the evaluation. Results suggest that personality traits are better predictors for the evaluation outcome than the actual behavior of the agent as it has been manipulated in the experiment. Implications for the research on and development of virtual agents are discussed.
Filter
Sorry, no publications matched your criteria.