REU

Overview

The Institute for Creative Technologies (ICT) offers a 10-week summer research program for undergraduates in interactive virtual experiences. A multidisciplinary research institute affiliated with the University of Southern California, the ICT was established in 1999 to combine leading academic researchers in computing with the creative talents of Hollywood and the video game industry. Having grown to encompass over 130 faculty, staff, and students in a diverse array of fields, the ICT represents a unique interdisciplinary community brought together with a core unifying mission: advancing the state-of-the-art for creating virtual experiences so compelling that people will react as if they were real.

Reflecting the interdisciplinary nature of ICT research, we welcome applications from students in computer science, as well as many other fields, such as psychology, art/animation, interactive media, linguistics, and communications. Undergraduates will join a team of students, research staff, and faculty in one of several labs focusing on different aspects of interactive virtual experiences. In addition to participating in seminars and social events, students will also prepare a final written report and present their projects to the rest of the institute at the end of the summer.

This Research Experiences for Undergraduates (REU) site is supported by a grant from the National Science Foundation.

For questions or additional information, please contact reu@ict.usc.edu.

Research Projects

When you apply, we will ask you to rank your top three interests from the research projects listed below. We encourage applicants to explore each mentor’s website to learn more about the individual research activities of each lab.

Mixed Reality Techniques and Technologies

Mentor: Evan Suma Rosenberg, David M. Krum, and Sin-Hwa Kang
The ICT MxR Lab investigates techniques and technologies to advance the state-of-the-art for immersive virtual, mixed, and augmented reality experiences.  Students working in the lab will help to design, create, and evaluate technological prototypes and/or conduct experiments in human-computer interaction. The specific project will be determined based on interviews with potential candidates, and selected REU interns will be matched to the projects that best align with their interests and skillset. For summer 2018, particular projects of interest include immersive interaction techniques, brain activity (EEG) data for virtual reality, and collaboration between multiple users in mixed reality environments.

Voice-controlled Interactive Audio Narrative for Training (VIANT)

Mentor: Andrew Gordon
The VIANT project is developing interactive storytelling systems where the user experience is entirely through audio, using produced audio recordings and speech input from players. VIANT training scenarios are designed to develop cognitive skills by immersing players in fictional scenarios, giving them targeted feedback and coaching to learn how to best navigate complex, real-world situations. The REU student intern on this project will author one or more new training scenarios during the summer, to include script development, interaction design, audio production, and evaluations of training effectiveness.

Natural Language Dialogue Processing for Virtual Humans

Mentor: David Traum and Ron Artstein
The Natural Language Dialogue Group at ICT is developing artificial intelligence and language technology to allow machines to participate in human-like natural dialogues with people. Systems have a variety of “embodiments”, including virtual humans (pictured above), robots, recorded video of real people, and voice or chat systems. An REU student will work on creating, extending or evaluating one or more of these systems, analyzing conversational data from these systems, or collecting new data. Specific projects can be chosen or defined by the REU student; examples include technology to allow an agent or robot to understand the context of a conversation, take initiative in conversation, or sustain interaction over multiple encounters. Previous REU students in the group have been lead authors and had their REU projects published in the proceedings of international scientific conferences.

Impact of AI on Users’ Psychology

Mentor: Jonathan Gratch and Gale Lucas
Irresistible pressures are driving the adoption of AI. What impact will this have on us? Will using AI or operating through an autonomous robot, for example, undermine trust, increase risk-taking, reduce vigilance to threats and increase dehumanization of others? This project will examine the psychological impact of such advances. REU mentee will assist by helping to finalize development of agents that vary in level of autonomy (e.g., full AI vs assisted). The mentee will help to run an experiment where the impact of autonomy on users’ psychological factors is tested, as well as analyze the results of this study.

 

AI and Machine Learning for Intelligent Tutoring Systems

Mentor: Benjamin Nye
AI and Machine Learning for Intelligent Tutoring SystemsThis project will explore applications of Artificial Intelligence and Machine Learning to support personalized tutoring and dialog systems such as the Personal Assistant for Life-Long Learning (PAL3). PAL3 is a system for delivering engaging and accessible education via mobile devices. It is designed to provide on-the- job training and support lifelong learning and ongoing assessment. PAL3 helps learners navigate learning resources through an embodied pedagogical agent that acts as a guide and persistent learning record to track what students have done, their level of mastery, and what they need to achieve. The goal of the REU internship will be to expand the repertoire of the system to further enhance learning and engagement. The specific tasks will be determined collaboratively based on research goals and student research interests. Possible topics include work with: (1) models driving the dialog systems for PAL3 to support goal-setting, teamwork, or fun/rapport-building; (2) modifying the intelligent tutoring system and how it supports the learner, and (3) statistical analysis, and/or data mining to identify patterns of interactions between human subjects and the intelligent tutoring system.

 

Virtual Reality Game-Based Rehabilitation

Mentors: Albert “Skip” Rizzo and Chien-Yen (Kevin) Chang
The Medical Virtual Reality (MedVR) group at ICT is devoted to the study and advancement of uses of virtual reality (VR) simulation technology for clinical purposes. The MedVR Lab’s Game-Based Rehab group develops low-cost and home-based VR toolkits for physical therapy. REU interns will work on our Mystic Isle project which allows patients to do rehabilitation by playing a motion game that tracks their movements using a Kinect sensor. Interns will interface with therapists and engineers to convert Mystic Isle into a virtual reality application and help support user-centered trials at the Keck School of Medicine.

 

Real-Time Rendering for Virtual Humans

Mentors: Hao Li and Kalle Bladin
The Vision and Graphics lab at ICT pursues research and works in production to perform high quality facial scans for Army training and simulations, as well as for VFX studios and game development companies. Research in how machine learning can be used to aid the creation of such datasets using single images is one of the most recent focuses in the lab. We are currently working on a software to aid both in visualization during the production pipeline as well as for producing images as training data for learning algorithms. REU students will work with lab researchers to develop features in the rendering and data processing pipeline. The internship can also include designing tools for automation of the production capture and data processing pipeline which consists of building high quality virtual human faces for the machine learning database, which may include graphical user interfaces and python scripting.

 

Location and Housing

The ICT facility is located in the Playa Vista community of West Los Angeles, about 10 miles west of the main USC campus, and includes a 150-seat theater, game room, and gym. There are numerous restaurants and stores within walking distance, including the Westfield Culver City mall, and the beach is only a 10 minute drive away. The university also provides free shuttle service between the institute and the downtown USC campus.

Since ICT is located in its own separate facility, summer students typically live in apartments near the institute rather than on-campus dorms. We will direct accepted students to a number of resources for locating nearby housing and provide a stipend to support the cost of living.

Benefits

  • Participate in a unique multidisciplinary community that combines academic research with the creative talents of Hollywood and the video game industry.
  • Work with some of the leading researchers in human-computer interaction, virtual reality, computer graphics, and virtual humans.
  • Receive a total of $5,000 over the ten week program.
  • Receive an additional $3,450 stipend for housing and living expenses.
  • Travel will be reimbursed up to $600 for students living 95 miles or more outside of the Los Angeles area.

Eligibility

  • S. citizenship or permanent residency is required.
  • Students must be currently enrolled in an undergraduate program.
  • Students must not have completed an undergraduate degree prior to the summer program.

Important Dates

  • Application deadline: February 11, 2018
  • Notification of acceptance begins: February 19, 2018
  • Notification of declined applicants: March 31, 2018
  • Start Date: May 29, 2018
  • End Date: August 3, 2018

How to Apply

Step 1: Application Form

Fill out the online application.  To complete this form, you will need the following:

  • The most recent unofficial transcript from your undergraduate institution (PDF).
  • A one page personal statement (PDF). This may include your research interests and how you came to be interested in them, your previous research experiences, your reasons for wanting to participate in the research at the ICT, and how this participating in this experience might better prepare you to meet your future goals.
  • A ranking of your top three project choices from the list above.
  • The name and email address for a faculty member that will provide your letter of recommendation. A letter request with a customized submission link will be sent automatically when you submit your application form.

Step 2: Recommendation Letter Confirmation

Your application is not complete until we receive a recommendation letter.  We strongly recommend that you follow up directly with your recommender to make sure that the letter is submitted by the application deadline.  You will receive another confirmation automatically when the letter is submitted.  Please note that due to the large number of applicants, we cannot respond directly to email requests for status updates.