PRIMER: An Emotionally Aware Virtual Agent (bibtex)
by Carla Gordon, Anton Leuski, Grace Benn, Eric Klassen, Edward Fast, Matt Liewer, Arno Hartholt, David Traum
Abstract:
PRIMER is a proof-of-concept system designed to show the potential of immersive dialogue agents and virtual environments that adapt and respond to both direct verbal input and indirect emotional input. The system has two novel interfaces: (1) for the user, an immersive VR environment and an animated virtual agent both of which adapt and react to the user’s direct input as well as the user’s perceived emotional state, and (2) for an observer, an interface that helps track the perceived emotional state of the user, with visualizations to provide insight into the system’s decision making process. While the basic system architecture can be adapted for many potential real world applications, the initial version of this system was designed to assist clinical social workers in helping children cope with bullying. The virtual agent produces verbal and non-verbal behaviors guided by a plan for the counseling session, based on in-depth discussions with experienced counselors, but is also reactive to both initiatives that the user takes, e.g. asking their own questions, and the user’s perceived emotional state.
Reference:
PRIMER: An Emotionally Aware Virtual Agent (Carla Gordon, Anton Leuski, Grace Benn, Eric Klassen, Edward Fast, Matt Liewer, Arno Hartholt, David Traum), In Proceedings of the 24th International Conference on Intelligent User Interfaces, ACM, 2019.
Bibtex Entry:
@inproceedings{gordon_primer:_2019,
	address = {Los Angeles, CA},
	title = {{PRIMER}: {An} {Emotionally} {Aware} {Virtual} {Agent}},
	url = {https://www.research.ibm.com/haifa/Workshops/user2agent2019/},
	abstract = {PRIMER is a proof-of-concept system designed to show the potential of immersive dialogue agents and virtual environments that adapt and respond to both direct verbal input and indirect emotional input. The system has two novel interfaces: (1) for the user, an immersive VR environment and an animated virtual agent both of which adapt and react to the user’s direct input as well as the user’s perceived emotional state, and (2) for an observer, an interface that helps track the perceived emotional state of the user, with visualizations to provide insight into the system’s decision making process. While the basic system architecture can be adapted for many potential real world applications, the initial version of this system was designed to assist clinical social workers in helping children cope with bullying. The virtual agent produces verbal and non-verbal behaviors guided by a plan for the counseling session, based on in-depth discussions with experienced counselors, but is also reactive to both initiatives that the user takes, e.g. asking their own questions, and the user’s perceived emotional state.},
	booktitle = {Proceedings of the 24th {International} {Conference} on {Intelligent} {User} {Interfaces}},
	publisher = {ACM},
	author = {Gordon, Carla and Leuski, Anton and Benn, Grace and Klassen, Eric and Fast, Edward and Liewer, Matt and Hartholt, Arno and Traum, David},
	month = mar,
	year = {2019},
	keywords = {Virtual Humans, UARC},
	pages = {10}
}
Powered by bibtexbrowser