Publications
Search
1801.
Kim, Youngjun; Velson, Martin; Hill, Randall W.
Modeling Dynamic Perceptual Attention in Complex Virtual Environments Proceedings Article
In: Conference on Behavior Representation in Modeling and Simulation (BRIMS), Universal City, CA, 2005.
@inproceedings{kim_modeling_2005,
title = {Modeling Dynamic Perceptual Attention in Complex Virtual Environments},
author = {Youngjun Kim and Martin Velson and Randall W. Hill},
url = {http://ict.usc.edu/pubs/Modeling%20Dynamic%20Perceptual%20Attention%20in%20Complex%20Virtual%20Environments.pdf},
year = {2005},
date = {2005-05-01},
booktitle = {Conference on Behavior Representation in Modeling and Simulation (BRIMS)},
address = {Universal City, CA},
abstract = {An important characteristic of a virtual human is the ability to direct its perceptual attention to entities and areas in a virtual environment in a manner that appears believable and serves a functional purpose. In this paper, we describe a perceptual attention model that integrates perceptual attention that mediates top-down and bottom-up attention processes of virtual humans within complex virtual environments.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
An important characteristic of a virtual human is the ability to direct its perceptual attention to entities and areas in a virtual environment in a manner that appears believable and serves a functional purpose. In this paper, we describe a perceptual attention model that integrates perceptual attention that mediates top-down and bottom-up attention processes of virtual humans within complex virtual environments.
1802.
Hobbs, Jerry R.; Gordon, Andrew S.
Encoding Knowledge of Commonsense Psychology Proceedings Article
In: 7th International Symposium on Logical Formalizations of Commonsense Reasoning, Corfu, Greece, 2005.
@inproceedings{hobbs_encoding_2005,
title = {Encoding Knowledge of Commonsense Psychology},
author = {Jerry R. Hobbs and Andrew S. Gordon},
url = {http://ict.usc.edu/pubs/Encoding%20Knowledge%20of%20Commonsense%20Psychology.pdf},
year = {2005},
date = {2005-05-01},
booktitle = {7th International Symposium on Logical Formalizations of Commonsense Reasoning},
address = {Corfu, Greece},
abstract = {Introduction: In previous papers (Gordon and Hobbs, 2003, 2004) we have described a methodology for determining what knowledge should be included in the knowledge base for an intelligent agent, capable of constructing and executing plans to achieve its goals. An intelligent agent is at least a planning mechanism, so Gordon (2004) asked what concepts are necessary for the common strategies that people use in achieving their goals. He investigated ten different domains, including politics, personal relationships, artistic performance, and warfare, and collected 372 strategies. He authored representations of these strategies in order to identify a controlled vocabulary involving of concepts. These concepts were categorized into 48 different representational areas, such as sets, space, and time. Thirty of the representational areas, involving 635 concepts, were concerned with commonsense psychology; among these are memory, knowledge management, planning, and so on. This result by itself demonstrates the very great importance of commonsense psychology in the construction of intelligent agents. Gordon et al. (2003) then, to deï¬ne further each of the representational areas, augmented the list of concepts by investigating the English language expressions for concepts in each area. The result was a list of 528 concepts, a set that identiï¬es the target coverage of a formal theory of commonsense psychology. The authors began the development of formal theories that would encompass this list of concepts. In our earlier work (Gordon and Hobbs, 2003), we described the ï¬rst theory we constructed, memory, as an illustration of the method. We have now completed 14 of the 30 theories, and this paper provides an overview of this work as we close in on the halfway mark.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Introduction: In previous papers (Gordon and Hobbs, 2003, 2004) we have described a methodology for determining what knowledge should be included in the knowledge base for an intelligent agent, capable of constructing and executing plans to achieve its goals. An intelligent agent is at least a planning mechanism, so Gordon (2004) asked what concepts are necessary for the common strategies that people use in achieving their goals. He investigated ten different domains, including politics, personal relationships, artistic performance, and warfare, and collected 372 strategies. He authored representations of these strategies in order to identify a controlled vocabulary involving of concepts. These concepts were categorized into 48 different representational areas, such as sets, space, and time. Thirty of the representational areas, involving 635 concepts, were concerned with commonsense psychology; among these are memory, knowledge management, planning, and so on. This result by itself demonstrates the very great importance of commonsense psychology in the construction of intelligent agents. Gordon et al. (2003) then, to deï¬ne further each of the representational areas, augmented the list of concepts by investigating the English language expressions for concepts in each area. The result was a list of 528 concepts, a set that identiï¬es the target coverage of a formal theory of commonsense psychology. The authors began the development of formal theories that would encompass this list of concepts. In our earlier work (Gordon and Hobbs, 2003), we described the ï¬rst theory we constructed, memory, as an illustration of the method. We have now completed 14 of the 30 theories, and this paper provides an overview of this work as we close in on the halfway mark.
1803.
Kim, Youngjun; Hill, Randall W.; Traum, David
A Computational Model of Dynamic Perceptual Attention for Virtual Humans Proceedings Article
In: Proceedings of the 14th Conference on Behavior Representation in Modeling and Simulation, Universal City, CA, 2005.
@inproceedings{kim_computational_2005,
title = {A Computational Model of Dynamic Perceptual Attention for Virtual Humans},
author = {Youngjun Kim and Randall W. Hill and David Traum},
url = {http://ict.usc.edu/pubs/A%20Computational%20Model%20of%20Dynamic%20Perceptual%20Attention%20for%20Virtual%20Humans.pdf},
year = {2005},
date = {2005-05-01},
booktitle = {Proceedings of the 14th Conference on Behavior Representation in Modeling and Simulation},
address = {Universal City, CA},
abstract = {An important characteristic of a virtual human is the ability to direct its perceptual attention to objects and locations in a virtual environment in a manner that looks believable and serves a functional purpose. We have developed a computational model of perceptual attention that mediates top-down and bottom-up attention processes of virtual humans in virtual environments. In this paper, we propose a perceptual attention model that will integrate perceptual attention toward objects and locations in the environment with the need to look at other parties in a social context.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
An important characteristic of a virtual human is the ability to direct its perceptual attention to objects and locations in a virtual environment in a manner that looks believable and serves a functional purpose. We have developed a computational model of perceptual attention that mediates top-down and bottom-up attention processes of virtual humans in virtual environments. In this paper, we propose a perceptual attention model that will integrate perceptual attention toward objects and locations in the environment with the need to look at other parties in a social context.
1804.
Gomboc, Dave; Solomon, Steve; Core, Mark; Lane, H. Chad; Lent, Michael
Design Recommendations to Support Automated Explanation and Tutoring Proceedings Article
In: Conference on Behavior Representation in Modeling and Simulation (BRIMS), Universal City, CA, 2005.
@inproceedings{gomboc_design_2005,
title = {Design Recommendations to Support Automated Explanation and Tutoring},
author = {Dave Gomboc and Steve Solomon and Mark Core and H. Chad Lane and Michael Lent},
url = {http://ict.usc.edu/pubs/Design%20Recommendations%20to%20Support%20Automated%20Explanation%20and%20Tutoring.pdf},
year = {2005},
date = {2005-05-01},
booktitle = {Conference on Behavior Representation in Modeling and Simulation (BRIMS)},
address = {Universal City, CA},
abstract = {The after-action review is an essential component of military training exercises. The use of constructive simulations for training poses a challenge when conducting such reviews, because behavior models are typically designed to simulate satisfactorially, without explicit concern for the interrogation of synthetic entities afterward. Ideally, users could obtain knowledge about not only the choices made by a simulatorEs behavior models, but also the rationale for those choices. This requires a rich representation of behavioral knowledge within the software system. We have integrated our explainable AI system with behavior models and log information from two simulation systems. Selecting examples from these simulators, we identify areas for improvement to facilitate the automation of explanation and tutoring.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
The after-action review is an essential component of military training exercises. The use of constructive simulations for training poses a challenge when conducting such reviews, because behavior models are typically designed to simulate satisfactorially, without explicit concern for the interrogation of synthetic entities afterward. Ideally, users could obtain knowledge about not only the choices made by a simulatorEs behavior models, but also the rationale for those choices. This requires a rich representation of behavioral knowledge within the software system. We have integrated our explainable AI system with behavior models and log information from two simulation systems. Selecting examples from these simulators, we identify areas for improvement to facilitate the automation of explanation and tutoring.
1805.
Feng, Donghui; Hovy, Eduard
MRE: A Study on Evolutionary Language Understanding Proceedings Article
In: Second International Workshop on Natural Language Understanding and Cognitive Science (NLUCS), Miami, Florida, 2005.
@inproceedings{feng_mre_2005,
title = {MRE: A Study on Evolutionary Language Understanding},
author = {Donghui Feng and Eduard Hovy},
url = {http://ict.usc.edu/pubs/MRE-%20A%20Study%20on%20Evolutionary%20Language%20Understanding.pdf},
year = {2005},
date = {2005-05-01},
booktitle = {Second International Workshop on Natural Language Understanding and Cognitive Science (NLUCS)},
address = {Miami, Florida},
abstract = {The lack of well-annotated data is always one of the biggest problems for most training-based dialogue systems. Without enough training data, it's almost impossible for a trainable system to work. In this paper, we explore the evolutionary language understanding approach to build a natural language understanding machine in a virtual human training project. We build the initial training data with a finite state machine. The language understanding system is trained based on the automated data first and is improved as more and more real data come in, which is proved by the experimental results.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
The lack of well-annotated data is always one of the biggest problems for most training-based dialogue systems. Without enough training data, it's almost impossible for a trainable system to work. In this paper, we explore the evolutionary language understanding approach to build a natural language understanding machine in a virtual human training project. We build the initial training data with a finite state machine. The language understanding system is trained based on the automated data first and is improved as more and more real data come in, which is proved by the experimental results.
1806.
Nijholt, Anton; Traum, David
The Virtuality Continuum Revisited Proceedings Article
In: CHI 2005 Workshop on the Virtuality Continuum Revisited, Portland, OR, 2005.
@inproceedings{nijholt_virtuality_2005,
title = {The Virtuality Continuum Revisited},
author = {Anton Nijholt and David Traum},
url = {http://ict.usc.edu/pubs/The%20Virtuality%20Continuum%20Revisited.pdf},
year = {2005},
date = {2005-04-01},
booktitle = {CHI 2005 Workshop on the Virtuality Continuum Revisited},
address = {Portland, OR},
abstract = {We survey the themes and the aims of a workshop devoted to the state-of-the-art virtuality continuum. In this continuum, ranging from fully virtual to real physical environments, allowing for mixed, augmented and desktop virtual reality, several perspectives can be taken. Originally, the emphasis was on display technologies. Here we take the perspective of the inhabited environment, that is, environments positioned somewhere on this continuum that are inhabited by virtual (embodied) agents, that interact with each other and with their human partners. Hence, we look at it from the multi-party interaction perspective. In this workshop we will investigate the current state of the art, its shortcomings and a future research agenda.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
We survey the themes and the aims of a workshop devoted to the state-of-the-art virtuality continuum. In this continuum, ranging from fully virtual to real physical environments, allowing for mixed, augmented and desktop virtual reality, several perspectives can be taken. Originally, the emphasis was on display technologies. Here we take the perspective of the inhabited environment, that is, environments positioned somewhere on this continuum that are inhabited by virtual (embodied) agents, that interact with each other and with their human partners. Hence, we look at it from the multi-party interaction perspective. In this workshop we will investigate the current state of the art, its shortcomings and a future research agenda.
1807.
Peterson, Michael J.; Kyriakakis, Chris
Choosing Candidate Locations for Source Localization Proceedings Article
In: International Workshop on Hands Free Communication and Microphone Arrays, Rutgers, NY, 2005.
@inproceedings{peterson_choosing_2005,
title = {Choosing Candidate Locations for Source Localization},
author = {Michael J. Peterson and Chris Kyriakakis},
url = {http://ict.usc.edu/pubs/CHOOSING%20CANDIDATE%20LOCATIONS%20FOR%20SOURCE%20LOCALIZATION.pdf},
year = {2005},
date = {2005-03-01},
booktitle = {International Workshop on Hands Free Communication and Microphone Arrays},
address = {Rutgers, NY},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
1808.
Swanson, Reid; Gordon, Andrew S.
Automated Commonsense Reasoning About Human Memory Proceedings Article
In: AAAI Spring Symposium on Metacognitive Computing, Stanford, CA, 2005.
@inproceedings{swanson_automated_2005,
title = {Automated Commonsense Reasoning About Human Memory},
author = {Reid Swanson and Andrew S. Gordon},
url = {http://ict.usc.edu/pubs/Automated%20Commonsense%20Reasoning%20About%20Human%20Memory.pdf},
year = {2005},
date = {2005-03-01},
booktitle = {AAAI Spring Symposium on Metacognitive Computing},
address = {Stanford, CA},
abstract = {Metacognitive reasoning in computational systems will be enabled by the development of formal theories that have broad coverage over mental states and processes as well as inferential competency. In this paper we evaluate the inferential competency of an existing formal theory of commonsense human memory by attempting to use it to validate the appropriateness of a commonsense memory strategy. We formulate a particular memory strategy (to create an associated obstacle) as a theorem in first-order predicate calculus. We then attempt to validate this strategy by showing that it is entailed by the axioms of the theory we evaluated. These axioms were encoded into the syntax of an automated reasoning system, which was used to automatically generate inferences and search for formal proofs.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Metacognitive reasoning in computational systems will be enabled by the development of formal theories that have broad coverage over mental states and processes as well as inferential competency. In this paper we evaluate the inferential competency of an existing formal theory of commonsense human memory by attempting to use it to validate the appropriateness of a commonsense memory strategy. We formulate a particular memory strategy (to create an associated obstacle) as a theorem in first-order predicate calculus. We then attempt to validate this strategy by showing that it is entailed by the axioms of the theory we evaluated. These axioms were encoded into the syntax of an automated reasoning system, which was used to automatically generate inferences and search for formal proofs.
1809.
Busso, Carlos; Hernanz, Sergi; Chu, Chi-Wei; Kwon, Soon-il; Lee, Sung; Georgiou, Panayiotis G.; Cohen, Isaac; Narayanan, Shrikanth
Smart Room: Participant and Speaker Localization and Identification Proceedings Article
In: Proceedings of the IEEE Conference on Acoustics, Speech and Signal Processing, Philadelphia, PA, 2005.
@inproceedings{busso_smart_2005,
title = {Smart Room: Participant and Speaker Localization and Identification},
author = {Carlos Busso and Sergi Hernanz and Chi-Wei Chu and Soon-il Kwon and Sung Lee and Panayiotis G. Georgiou and Isaac Cohen and Shrikanth Narayanan},
url = {http://ict.usc.edu/pubs/SMART%20ROOM-%20PARTICIPANT%20AND%20SPEAKER%20LOCALIZATION%20AND%20IDENTIFICATION.pdf},
year = {2005},
date = {2005-03-01},
booktitle = {Proceedings of the IEEE Conference on Acoustics, Speech and Signal Processing},
address = {Philadelphia, PA},
abstract = {Our long-term objective is to create Smart Room Technologies that are aware of the users presence and their behavior and can become an active, but not an intrusive, part of the interaction. In this work, we present a multimodal approach for estimating and tracking the location and identity of the participants including the active speaker. Our smart room design contains three user-monitoring systems: four CCD cameras, an omnidirectional camera and a 16 channel microphone array. The various sensory modalities are processed both individually and jointly and it is shown that the multimodal approach results in signiï¬cantly improved performance in spatial localization, identiï¬cation and speech activity detection of the participants.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Our long-term objective is to create Smart Room Technologies that are aware of the users presence and their behavior and can become an active, but not an intrusive, part of the interaction. In this work, we present a multimodal approach for estimating and tracking the location and identity of the participants including the active speaker. Our smart room design contains three user-monitoring systems: four CCD cameras, an omnidirectional camera and a 16 channel microphone array. The various sensory modalities are processed both individually and jointly and it is shown that the multimodal approach results in signiï¬cantly improved performance in spatial localization, identiï¬cation and speech activity detection of the participants.
1810.
Pair, Jarrell; Treskunov, Anton; Piepol, Diane
Leveraging Hollywood Set Design Techniques to Enhance Ad Hoc Immersive Display Systems Proceedings Article
In: IEEE VR Emerging Displays Workshop, Bonn, Germany, 2005.
@inproceedings{pair_leveraging_2005,
title = {Leveraging Hollywood Set Design Techniques to Enhance Ad Hoc Immersive Display Systems},
author = {Jarrell Pair and Anton Treskunov and Diane Piepol},
url = {http://ict.usc.edu/pubs/Leveraging%20Hollywood%20Set%20Design%20Techniques%20to%20Enhance%20Ad%20Hoc%20Immersive%20Display%20Systems.pdf},
year = {2005},
date = {2005-03-01},
booktitle = {IEEE VR Emerging Displays Workshop},
address = {Bonn, Germany},
abstract = {Over the past four years, the FlatWorld project [1] at the University of Southern California Institute for Creative Technologies has exploited ad hoc immersive display techniques to prototype virtual reality education and training applications. While our approach is related to traditional immersive projection systems such as the CAVE [2], our work draws extensively upon techniques widely used in Hollywood sets and theme parks. Our first display system, initially prototyped in 2001, enables wide area virtual environments in which participants can maneuver through simulated rooms, buildings, or streets. In 2004, we expanded our work by experimenting with transparent projection screens. To date, we have used this display technique for presenting life size interactive characters with a pseudo-holographic appearance.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Over the past four years, the FlatWorld project [1] at the University of Southern California Institute for Creative Technologies has exploited ad hoc immersive display techniques to prototype virtual reality education and training applications. While our approach is related to traditional immersive projection systems such as the CAVE [2], our work draws extensively upon techniques widely used in Hollywood sets and theme parks. Our first display system, initially prototyped in 2001, enables wide area virtual environments in which participants can maneuver through simulated rooms, buildings, or streets. In 2004, we expanded our work by experimenting with transparent projection screens. To date, we have used this display technique for presenting life size interactive characters with a pseudo-holographic appearance.
1811.
Wang, Dagen; Narayanan, Shrikanth
Speech Rate Estimation Via Temporal Correlation and Selected Sub-band Correlation Proceedings Article
In: Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp. 413–416, Philadelphia, PA, 2005.
@inproceedings{wang_speech_2005,
title = {Speech Rate Estimation Via Temporal Correlation and Selected Sub-band Correlation},
author = {Dagen Wang and Shrikanth Narayanan},
url = {http://ict.usc.edu/pubs/SPEECH%20RATE%20ESTIMATION%20VIA%20TEMPORAL%20CORRELATION%20AND%20SELECTED%20SUB-BAND%20CORRELATION.pdf},
year = {2005},
date = {2005-03-01},
booktitle = {Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP)},
pages = {413–416},
address = {Philadelphia, PA},
abstract = {In this paper, we propose a novel method for speech rate estimation without requiring automatic speech recognition. It extends the methods of spectral subband correlation by including temporal correlation and the use of selecting prominent spectral subbands for correlation. Further more, to address some of the practical issues in previously published methods, we introduce some novel components into the algorithm such as the use of pitch confidence, magnifying window, relative peak measure and relative threshold. By selecting the parameters and thresholds from realistic development sets, this method achieves a 0.972 correlation coefficient on syllable number estimation and a 0.706 correlation on speech rate estimation. This result is about 6.9% improvement than current best single estimator and 3.5% improvement than current multi-estimator evaluated on the same switchboard database.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
In this paper, we propose a novel method for speech rate estimation without requiring automatic speech recognition. It extends the methods of spectral subband correlation by including temporal correlation and the use of selecting prominent spectral subbands for correlation. Further more, to address some of the practical issues in previously published methods, we introduce some novel components into the algorithm such as the use of pitch confidence, magnifying window, relative peak measure and relative threshold. By selecting the parameters and thresholds from realistic development sets, this method achieves a 0.972 correlation coefficient on syllable number estimation and a 0.706 correlation on speech rate estimation. This result is about 6.9% improvement than current best single estimator and 3.5% improvement than current multi-estimator evaluated on the same switchboard database.
1812.
Peterson, Michael J.; Kyriakakis, Chris
Hybrid Algorithm for Robust, Real-time Source Localization in the Reverberant Environments Proceedings Article
In: International Conference on Acoustics, Speech and Signal Processing, Philadelphia, PA, 2005.
@inproceedings{peterson_hybrid_2005,
title = {Hybrid Algorithm for Robust, Real-time Source Localization in the Reverberant Environments},
author = {Michael J. Peterson and Chris Kyriakakis},
url = {http://ict.usc.edu/pubs/HYBRID%20ALGORITHM%20FOR%20ROBUST,%20REAL-TIME%20SOURCE%20LOCALIZATION%20IN%20REVERBERANT%20ENVIRONMENTS.pdf},
year = {2005},
date = {2005-03-01},
booktitle = {International Conference on Acoustics, Speech and Signal Processing},
address = {Philadelphia, PA},
abstract = {The location of an acoustical source can be found robustly using the Steered Response Pattern - Phase Transform (SRP-PHAT) algorithm. However SRP-PHAT can be computationally expensive, requiring a search of a large number of candidate locations. The required spacing between these locations is dependent on sampling rate, microphone array geometry, and source location. In this work, a novel method will be presented that calculates a smaller number of test points using an efï¬cient closed-form localization algorithm. This method signiï¬cantly reduces the number of calculations, while still remaining robust in acoustical environments.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
The location of an acoustical source can be found robustly using the Steered Response Pattern - Phase Transform (SRP-PHAT) algorithm. However SRP-PHAT can be computationally expensive, requiring a search of a large number of candidate locations. The required spacing between these locations is dependent on sampling rate, microphone array geometry, and source location. In this work, a novel method will be presented that calculates a smaller number of test points using an efï¬cient closed-form localization algorithm. This method signiï¬cantly reduces the number of calculations, while still remaining robust in acoustical environments.
1813.
Lee, C. M.; Narayanan, Shrikanth
Toward Detecting Emotions in Spoken Dialogs Proceedings Article
In: IEEE Transactions on Speech and Audio Processing, pp. 293–303, 2005.
@inproceedings{lee_toward_2005,
title = {Toward Detecting Emotions in Spoken Dialogs},
author = {C. M. Lee and Shrikanth Narayanan},
url = {http://ict.usc.edu/pubs/Toward%20Detecting%20Emotions%20in%20Spoken%20Dialogs.pdf},
year = {2005},
date = {2005-03-01},
booktitle = {IEEE Transactions on Speech and Audio Processing},
volume = {12},
pages = {293–303},
abstract = {The importance of automatically recognizing emotions from human speech has grown with the increasing role of spoken language interfaces in human-computer interaction applications. This paper explores the detection of domain-specific emotions using language and discourse information in conjunction with acoustic correlates of emotion in speech signals. The specific focus is on a case study of detecting negative and non-negative emotions using spoken language data obtained from a call center application. Most previous studies in emotion recognition have used only the acoustic information contained in speech. In this paper, a combination of three sources of information-acoustic, lexical, and discourse-is used for emotion recognition. To capture emotion information at the language level, an information-theoretic notion of emotional salience is introduced. Optimization of the acoustic correlates of emotion with respect to classification error was accomplished by investigating different feature sets obtained from feature selection, followed by principal component analysis. Experimental results on our call center data show that the best results are obtained when acoustic and language information are combined. Results show that combining all the information, rather than using only acoustic information, improves emotion classification by 40.7% for males and 36.4% for females (linear discriminant classifier used for acoustic information).},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
The importance of automatically recognizing emotions from human speech has grown with the increasing role of spoken language interfaces in human-computer interaction applications. This paper explores the detection of domain-specific emotions using language and discourse information in conjunction with acoustic correlates of emotion in speech signals. The specific focus is on a case study of detecting negative and non-negative emotions using spoken language data obtained from a call center application. Most previous studies in emotion recognition have used only the acoustic information contained in speech. In this paper, a combination of three sources of information-acoustic, lexical, and discourse-is used for emotion recognition. To capture emotion information at the language level, an information-theoretic notion of emotional salience is introduced. Optimization of the acoustic correlates of emotion with respect to classification error was accomplished by investigating different feature sets obtained from feature selection, followed by principal component analysis. Experimental results on our call center data show that the best results are obtained when acoustic and language information are combined. Results show that combining all the information, rather than using only acoustic information, improves emotion classification by 40.7% for males and 36.4% for females (linear discriminant classifier used for acoustic information).
1814.
Ananthakrishnan, S.; Narayanan, Shrikanth
An Automatic Prosody Recognizer Using a Coupled Multi-stream Acoustic Model and a Syntactic-Prosodic Language Model Proceedings Article
In: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, Philadelphia, PA, 2005.
@inproceedings{ananthakrishnan_automatic_2005,
title = {An Automatic Prosody Recognizer Using a Coupled Multi-stream Acoustic Model and a Syntactic-Prosodic Language Model},
author = {S. Ananthakrishnan and Shrikanth Narayanan},
url = {http://ict.usc.edu/pubs/AN%20AUTOMATIC%20PROSODY%20RECOGNIZER%20USING%20A%20COUPLED%20MULTI-STREAM%20ACOUSTIC%20MODEL%20AND%20A%20SYNTACTIC-PROSODIC%20LANGUAGE%20MODEL.pdf},
year = {2005},
date = {2005-03-01},
booktitle = {Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing},
address = {Philadelphia, PA},
abstract = {Automatic detection and labeling of prosodic events in speech has received much attention from speech technologists and linguists ever since the introduction of annotation standards such as ToBI. Since prosody is intricately bound to the semantics of the utterance, recognition of prosodic events is important for spoken language applications such as automatic understanding and translation of speech. Moreover, corpora labeled with prosodic markers are essential for building speech synthesizers that use data-driven approaches to generate natural speech. In this paper, we build a prosody recognition system that detects stress and prosodic boundaries at the word and syllable level in American English using a coupled Hidden Markov Model (CHMM) to model multiple, asynchronous acoustic feature streams and a syntactic-prosodic model that captures the relationship between the syntax of the utterance and its prosodic structure. Experiments show that the recognizer achieves about 75% agreement on stress labeling and 88% agreement on boundary labeling at the syllable level.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Automatic detection and labeling of prosodic events in speech has received much attention from speech technologists and linguists ever since the introduction of annotation standards such as ToBI. Since prosody is intricately bound to the semantics of the utterance, recognition of prosodic events is important for spoken language applications such as automatic understanding and translation of speech. Moreover, corpora labeled with prosodic markers are essential for building speech synthesizers that use data-driven approaches to generate natural speech. In this paper, we build a prosody recognition system that detects stress and prosodic boundaries at the word and syllable level in American English using a coupled Hidden Markov Model (CHMM) to model multiple, asynchronous acoustic feature streams and a syntactic-prosodic model that captures the relationship between the syntax of the utterance and its prosodic structure. Experiments show that the recognizer achieves about 75% agreement on stress labeling and 88% agreement on boundary labeling at the syllable level.
1815.
Hobbs, Jerry R.; Gordon, Andrew S.
Toward a Large-scale Formal Theory of Commonsense Psychology for Metacognition Proceedings Article
In: American Association of Artificial Intelligence Spring Symposium on Metacognitive Computing, Stanford, CA, 2005.
@inproceedings{hobbs_toward_2005,
title = {Toward a Large-scale Formal Theory of Commonsense Psychology for Metacognition},
author = {Jerry R. Hobbs and Andrew S. Gordon},
url = {http://ict.usc.edu/pubs/Toward%20a%20Large-scale%20Formal%20Theory%20of%20Commonsense%20Psychology%20for%20Metacognition.pdf},
year = {2005},
date = {2005-03-01},
booktitle = {American Association of Artificial Intelligence Spring Symposium on Metacognitive Computing},
address = {Stanford, CA},
abstract = {Robust intelligent systems will require a capacity for metacognitive reasoning, where intelligent systems monitor and reflect on their own reasoning processes. A large-scale study of human strategic reasoning indicates that rich representational models of commonsense psychology are available to enable human metacognition. In this paper, we argue that large-scale formalizations of commonsense psychology enable metacognitive reasoning in intelligent systems. We describe our progress toward developing 30 integrated axiomatic theories of commonsense psychology, and discuss the central representational challenges that have arisen in this work to date.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Robust intelligent systems will require a capacity for metacognitive reasoning, where intelligent systems monitor and reflect on their own reasoning processes. A large-scale study of human strategic reasoning indicates that rich representational models of commonsense psychology are available to enable human metacognition. In this paper, we argue that large-scale formalizations of commonsense psychology enable metacognitive reasoning in intelligent systems. We describe our progress toward developing 30 integrated axiomatic theories of commonsense psychology, and discuss the central representational challenges that have arisen in this work to date.
1816.
Grote, Christopher L.; Parsons, Thomas D.
Threats to the Livelihood of the Forensic Neuropsychological Practice: Avoiding Ethical Misconduct Journal Article
In: Journal of Forensic Neuropsychology, vol. 4, no. 3, pp. 79–93, 2005.
@article{grote_threats_2005,
title = {Threats to the Livelihood of the Forensic Neuropsychological Practice: Avoiding Ethical Misconduct},
author = {Christopher L. Grote and Thomas D. Parsons},
url = {http://ict.usc.edu/pubs/Threats%20to%20the%20Livelihood%20of%20the%20Forensic%20Neuropsychological%20Practice-%20Avoiding%20Ethical%20Misconduct.pdf},
doi = {10.1300/J151v04n03_06},
year = {2005},
date = {2005-01-01},
journal = {Journal of Forensic Neuropsychology},
volume = {4},
number = {3},
pages = {79–93},
abstract = {We review six diverse issues that have the potential of devaluing our profession, in that ethical missteps could lead to the perception or reality that the work of forensic neuropsychologists is "for sale." By resisting temptations or overtures to engage in inappropriate conduct, such as attacking colleagues or failing to recognize how our own biases might influence our behavior or opinions, neuropsychologists strive to create a work product that enhances the reputation of our profession and makes a positive contribution to the public-at-large.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
We review six diverse issues that have the potential of devaluing our profession, in that ethical missteps could lead to the perception or reality that the work of forensic neuropsychologists is "for sale." By resisting temptations or overtures to engage in inappropriate conduct, such as attacking colleagues or failing to recognize how our own biases might influence our behavior or opinions, neuropsychologists strive to create a work product that enhances the reputation of our profession and makes a positive contribution to the public-at-large.
1817.
Martinovski, Bilyana; Traum, David; Marsella, Stacy C.
Rejection of empathy and its linguistic manifestations Proceedings Article
In: Proceedings of Conference on Formal and Informal Negotiation (FINEXIN), Ottowa, Canada, 2005.
@inproceedings{martinovski_rejection_2005,
title = {Rejection of empathy and its linguistic manifestations},
author = {Bilyana Martinovski and David Traum and Stacy C. Marsella},
url = {http://ict.usc.edu/pubs/Rejection%20of%20empathy%20and%20its%20linguistic%20manifestations.pdf},
year = {2005},
date = {2005-01-01},
booktitle = {Proceedings of Conference on Formal and Informal Negotiation (FINEXIN)},
address = {Ottowa, Canada},
abstract = {Trust is a crucial quality in the development of individuals and societies and empathy plays a key role in the formation of trust. Trust and empathy have growing importance in studies of negotiation. However, empathy can be rejected which complicates its role in negotiation. This paper presents a linguistic analysis of empathy by focusing on rejection of empathy in negotiation. Some of the rejections are due to failed recognition of the rejector's needs and desires whereas others have mainly strategic functions gaining momentum in the negotiation. In both cases, rejection of empathy is a phase in the negotiation not a breakdown.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Trust is a crucial quality in the development of individuals and societies and empathy plays a key role in the formation of trust. Trust and empathy have growing importance in studies of negotiation. However, empathy can be rejected which complicates its role in negotiation. This paper presents a linguistic analysis of empathy by focusing on rejection of empathy in negotiation. Some of the rejections are due to failed recognition of the rejector's needs and desires whereas others have mainly strategic functions gaining momentum in the negotiation. In both cases, rejection of empathy is a phase in the negotiation not a breakdown.
1818.
Parsons, Thomas D.; Rizzo, Albert; Zaag, Cheryl; McGee, Jocelyn; Buckwalter, John Galen
Gender Differences and Cognition Among Older Adults Journal Article
In: Aging, Neuropsychology, and Cognition, vol. 12, pp. 78–88, 2005.
@article{parsons_gender_2005,
title = {Gender Differences and Cognition Among Older Adults},
author = {Thomas D. Parsons and Albert Rizzo and Cheryl Zaag and Jocelyn McGee and John Galen Buckwalter},
url = {http://ict.usc.edu/pubs/Gender%20Differences%20and%20Cognition%20Among%20Older%20Adults.pdf},
year = {2005},
date = {2005-01-01},
journal = {Aging, Neuropsychology, and Cognition},
volume = {12},
pages = {78–88},
abstract = {The more replicated findings about gender difference in cognitive performance suggest female superiority on visuomotor speed and language ability and male superiority on mechanical and visuospatial tasks. Generally, group strengths found in the early school years become more established at adolescence and remain stable through adulthood. The current study tested whether the patterns established in the early years remained among 30 adult subjects. We also utilized a series of exploratory analyses to determine if observed gender differences were impacted by the covariance present between all cognitive tests. Results suggest that although the patterns established in the early years remain stable through time for males, the established patterns for females are altered with age. Our findings are compelling in supporting a male advantage on visuospatial tasks among older adults. These findings are discussed in terms of common variance between test instruments as a possible source of difference. Our finding that the gender effect tended to increase when common variance was controlled argues that this methodology may enhance the ability to detect domain specific effects.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
The more replicated findings about gender difference in cognitive performance suggest female superiority on visuomotor speed and language ability and male superiority on mechanical and visuospatial tasks. Generally, group strengths found in the early school years become more established at adolescence and remain stable through adulthood. The current study tested whether the patterns established in the early years remained among 30 adult subjects. We also utilized a series of exploratory analyses to determine if observed gender differences were impacted by the covariance present between all cognitive tests. Results suggest that although the patterns established in the early years remain stable through time for males, the established patterns for females are altered with age. Our findings are compelling in supporting a male advantage on visuospatial tasks among older adults. These findings are discussed in terms of common variance between test instruments as a possible source of difference. Our finding that the gender effect tended to increase when common variance was controlled argues that this methodology may enhance the ability to detect domain specific effects.
1819.
Robertson, R. Kevin; Mielke, Jens; Appiah, Kuku; Hall, Colin D.; Price, Richard W.; Kumwenda, Johnstone; Kanyama, Cecelia; Amod, Farida; Marra, Christina; Taylor, Terrie; Lalloo, Umesh; Jelsma, Jennifer; Holding, Penny; Boivin, Michael; Birbeck, Gretchen; Nakasujja, Noeline; Sanne, Ian; Parsons, Thomas D.; Parente, Amanda; Tucker, Karen A.
Assessment of neuroAIDS in Africa Journal Article
In: Journal of NeuroVirology, vol. 11, no. S1, pp. 7–16, 2005.
@article{robertson_assessment_2005,
title = {Assessment of neuroAIDS in Africa},
author = {R. Kevin Robertson and Jens Mielke and Kuku Appiah and Colin D. Hall and Richard W. Price and Johnstone Kumwenda and Cecelia Kanyama and Farida Amod and Christina Marra and Terrie Taylor and Umesh Lalloo and Jennifer Jelsma and Penny Holding and Michael Boivin and Gretchen Birbeck and Noeline Nakasujja and Ian Sanne and Thomas D. Parsons and Amanda Parente and Karen A. Tucker},
url = {http://ict.usc.edu/pubs/Assessment%20of%20neuroAIDS%20in%20Africa.pdf},
year = {2005},
date = {2005-01-01},
journal = {Journal of NeuroVirology},
volume = {11},
number = {S1},
pages = {7–16},
abstract = {In June of 2004, the Center for AIDS Mental Health Research, National Institute of Mental Health sponsored a conference on the Assessment of NeuroAIDS in Africa, which was held in Blantrye, Malawai. The conference presentations summarized here highlight the need for research on NeuroAIDS in Africa and methods for assessing HIV-related neurological diseases (Robertson, 2004).},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
In June of 2004, the Center for AIDS Mental Health Research, National Institute of Mental Health sponsored a conference on the Assessment of NeuroAIDS in Africa, which was held in Blantrye, Malawai. The conference presentations summarized here highlight the need for research on NeuroAIDS in Africa and methods for assessing HIV-related neurological diseases (Robertson, 2004).
1820.
Gratch, Jonathan; Marsella, Stacy C.
Lessons from Emotion Psychology for the Design of Lifelike Characters Journal Article
In: Applied Artificial Intelligence Journal, vol. 19, pp. 215–233, 2005.
@article{gratch_lessons_2005,
title = {Lessons from Emotion Psychology for the Design of Lifelike Characters},
author = {Jonathan Gratch and Stacy C. Marsella},
url = {http://ict.usc.edu/pubs/Lessons%20from%20Emotion%20Psychology%20for%20the%20Design%20of%20Lifelike%20Characters.pdf},
year = {2005},
date = {2005-01-01},
journal = {Applied Artificial Intelligence Journal},
volume = {19},
pages = {215–233},
abstract = {This special issue describes a number of applications that utilize lifelike characters that teach indirectly, by playing some role in a social interaction with a user. The design of such systems reflects a compromise between competing, sometimes unarticulated de- mands: they must realistically exhibit the behaviors and characteristics of their role, they must facilitate the desired learning, and they must work within the limitations of current technology, and there is little theoretical or empirical guidance on the impact of these compromises on learning. Our perspective on this problem is shaped by our interest in the role of emotion and emotional behaviors in such forms of learning. In recent years, there has been an explosion of interest in the role of emotion in the design of virtual hu- mans. The techniques and motivations underlying these various efforts can seem, from an outsider's perspective, as bewildering and multifaceted as the concept of emotion itself is generally accused of being. Drawing on insights from emotion psychology, this article attempts to clarify for the designers of educational agents the various theoretical perspec- tives on the concept of emotion with the aim of giving guidance to designers of educa- tional agents.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
This special issue describes a number of applications that utilize lifelike characters that teach indirectly, by playing some role in a social interaction with a user. The design of such systems reflects a compromise between competing, sometimes unarticulated de- mands: they must realistically exhibit the behaviors and characteristics of their role, they must facilitate the desired learning, and they must work within the limitations of current technology, and there is little theoretical or empirical guidance on the impact of these compromises on learning. Our perspective on this problem is shaped by our interest in the role of emotion and emotional behaviors in such forms of learning. In recent years, there has been an explosion of interest in the role of emotion in the design of virtual hu- mans. The techniques and motivations underlying these various efforts can seem, from an outsider's perspective, as bewildering and multifaceted as the concept of emotion itself is generally accused of being. Drawing on insights from emotion psychology, this article attempts to clarify for the designers of educational agents the various theoretical perspec- tives on the concept of emotion with the aim of giving guidance to designers of educa- tional agents.
Filter
Sorry, no publications matched your criteria.