Unsupervised Text Classification for Natural Language Interactive Narratives (bibtex)
by Jenna Bellassai, Andrew S. Gordon, Melissa Roemmele, Margaret Cychosz, Obiageli Odimegwu, Olivia Connolly
Abstract:
Natural language interactive narratives are a variant of traditional branching storylines where player actions are expressed in natural language rather than by selecting among choices. Previous efforts have handled the richness of natural language input using machine learning technologies for text classification, bootstrapping supervised machine learning approaches with human-in-the-loop data acquisition or by using expected player input as fake training data. This paper explores a third alternative, where unsupervised text classifiers are used to automatically route player input to the most appropriate storyline branch.We describe the Data-driven Interactive Narrative Engine (DINE), a web-based tool for authoring and deploying natural language interactive narratives. To compare the performance of different algorithms for unsupervised text classification, we collected thousands of user inputs from hundreds of crowdsourced participants playing 25 different scenarios, and hand-annotated them to create a goldstandard test set. Through comparative evaluations, we identified an unsupervised algorithm for narrative text classification that approaches the performance of supervised text classification algorithms. We discuss how this technology supports authors in the rapid creation and deployment of interactive narrative experiences, with authorial burdens similar to that of traditional branching storylines.
Reference:
Unsupervised Text Classification for Natural Language Interactive Narratives (Jenna Bellassai, Andrew S. Gordon, Melissa Roemmele, Margaret Cychosz, Obiageli Odimegwu, Olivia Connolly), In Proceedings of the 10th International Workshop on Intelligent Narrative Technologies (INT10), AAAI, 2017.
Bibtex Entry:
@inproceedings{bellassai_unsupervised_2017,
	address = {Snowbird, Utah},
	title = {Unsupervised {Text} {Classification} for {Natural} {Language} {Interactive} {Narratives}},
	url = {http://people.ict.usc.edu/~gordon/publications/INT17A},
	abstract = {Natural language interactive narratives are a variant of traditional branching storylines where player actions are expressed in natural language rather than by selecting among choices. Previous efforts have handled the richness of natural language input using machine learning technologies for text classification, bootstrapping supervised machine learning approaches with human-in-the-loop data acquisition or by using expected player input as fake training data. This paper explores a third alternative, where unsupervised text classifiers are used to automatically route player input to the most appropriate storyline branch.We describe the Data-driven Interactive Narrative Engine (DINE), a web-based tool for authoring and deploying natural language interactive narratives. To compare the performance of different algorithms for unsupervised text classification, we collected thousands of user inputs from hundreds of crowdsourced participants playing 25 different scenarios, and hand-annotated them to create a goldstandard test set. Through comparative evaluations, we identified an unsupervised algorithm for narrative text classification that approaches the performance of supervised text classification algorithms. We discuss how this technology supports authors in the rapid creation and deployment of interactive narrative experiences, with authorial burdens similar to that of traditional branching storylines.},
	booktitle = {Proceedings of the 10th {International} {Workshop} on {Intelligent} {Narrative} {Technologies} ({INT}10)},
	publisher = {AAAI},
	author = {Bellassai, Jenna and Gordon, Andrew S. and Roemmele, Melissa and Cychosz, Margaret and Odimegwu, Obiageli and Connolly, Olivia},
	month = oct,
	year = {2017},
	keywords = {Narrative, UARC}
}
Powered by bibtexbrowser