Engineering and Autism: a National Workshop
Computational Approaches to Social Communication and Interaction Development in Autism
University of Southern California, Los Angeles, CA
September 28, 2012
The Engineering and Autism Workshop was workshop at USC that brought together engineering researchers, especially in the broad domain of social/affective and communicative behavioral computing, with leading Autism researchers and clinicians as well as the broader community of stakeholders including families. It aimed to highlight and explore the opportunities and possibilities of engineering and computing advances in supporting research and translation in Autism by creating synergies and partnerships by initiating a multidisciplinary dialog.
Agenda
Welcome Remarks
Shrikanth S. (Shri) Narayanan
Professor of Electrical Engineering & Computer Science - University of Southern California
Computational behavioral sciences: From behavioral signal processing to behavioral 
informatics
Jim Rehg
 Professor of Interactive Computing - Georgia Institute of Technology
David Forsyth
 Professor of Computer Science - University of Illinois-Urbana Champaign 
Shri Narayanan
 Professor of Electrical Engineering & Computer Science - University of Southern California
Early detection of autism: Challenges and approaches
Wendy Stone
 Ph.D., Susan and Richard Fade Endowed Chair and Director
University of Washington Autism Center
Abstract  Early detection of autism is the key to specialized services that can lead to 
significant gains in children’s social, language, and behavioral functioning. Yet early 
identification efforts are often hampered by great variability in behavioral expression, 
limited knowledge about underlying mechanisms, and inconsistent community screening 
practices. This presentation will describe the early behavioral features of autism, the 
challenges of early identification, and potential strategies for facilitating detection and 
improving outcomes in these children.
Three technology highlights (engineering PhD students)
Daniel Bone - University of Southern California
  
Yin Li - Georgia Institute of Technology
Javier Hernandez Rivera - Massachusetts Institute of Technology
Engaging autism: Developmental implications for intervention
Connie Kasari
 Professor of Psychological Studies in Education & Psychiatry - UCLA
Abstract Autism is a serious, neurodevelopmental disorder that changes with 
development. Developmentally appropriate and behaviorally based interventions have 
yielded impressive outcomes for children’s social, communication and language 
development. In this talk, developmental change in core deficits of children with autism 
will be described and results presented for a series of targeted interventions for core 
deficits. Particular focus will be on underserved, under-represented and under-resourced 
children with autism and their families as well as randomized controlled trials 
implemented in natural environments of homes and schools.
Human-centered approaches to technologies for autism
Gillian Hayes
Assistant Professor in Informatics in the School of Information and Computer Sciences - UC Irvine
Abstract Interactive technologies have the potential to support both children and adults 
with ASD as well as friends, family, teachers, therapists, and researchers. However, 
appropriate design of these technologies requires considering the concerns of a wide 
variety of people impacted by them, the environments in which they will be used, and the 
potential to gather data about their efficacy. Human-centered approaches to design and 
development of novel interactive technologies can bridge the divides between 
engineering research and family and clinical practices. In this talk, I will describe a variety of research projects focused on interactive technologies for autism and outline some 
considerations for a human-centered approach for autism technology research.
Three technology highlights (engineering PhD students)
Rahul Gupta - University of Southern California
Denis Lantsman - Georgia Institute of Technology
Gabriela Marcu, Carnegie Mellon University
Strategies for tackling the challenges of autism heterogeneity
Pat Levitt
Provost Professor of Neuroscience, Pharmacy, Psychiatry, Pediatrics and 
Psychology - University of Southern California
Abstract A significant challenge in improving the clinical manifestations of autism 
spectrum disorder (ASD) has been to determine the underlying mechanisms that drive 
disorder heterogeneity.  Heterogeneity in children can be defined on many different 
levels, including the core ASD symptoms, genetic and other biomarkers, and co-occurring 
conditions that impact mental and physical health. Two different approaches to 
examining the underlying features of ASD that may help stratify populations functionally 
will be presented.  First, using neuroimaging and genetics methods, studies will be 
described that demonstrate a way forward in characterizing individuals with ASD who 
have similar functional and structural brain patterns that stratify with a genetic marker in 
the ASD risk gene MET. Second, co-occurring medical conditions often occur in children 
with ASD.  Using hierarchical statistical clustering, subsets of more homogeneous groups 
of children can be identified with common patterns of medical symptoms. We have found 
that a certain subgroup, those with ASD and gastrointestinal disturbances, are also 
enriched in children with minimal verbal abilities compared to ASD alone. Our goal of 
stratification based on rich clinical and neurobiological characterization also is 
amendable to further investigation using signal processing methods of audio-visual data 
from child-clinician interactions. When applied to a sufficiently large cohort, the 
application of this engineering methodology may be able to detect subtle, yet consistent 
patterns of communication and social interaction that may be important for developing 
predictive models of best practices in treating children with ASD. 
Automated monitoring of vocal development and early detection of autism
D. Kimbrough (Kim) Oller
 Professor and Plough Chair of Excellence - University of Memphis
Abstract It has recently been demonstrated (Oller et al. 2010) that audio recordings of 
infants and young children in their natural environments can be analyzed with automated 
methods to determine the child’s stage of development. Using a model based on research 
in infant vocal development, we assessed 12 acoustic parameters with no human 
intervention and determined that we could predict infant age from 2-48 months with a 
high degree of accuracy (predicted age and real age correlated at about 0.8). Further we 
showed that children with autism or language delay could be differentiated from typically 
developing children with high accuracy. The research was a collaboration with the LENA 
Research Foundation, and much subsequent work is underway utilizing modifications on
the same approach. The presentation for the conference will bring this line of research up 
to date by reviewing the new lines of effort extending the published findings. 
Oller, D. K., Niyogi, P., S. Gray, J. A. Richards, J. Gilkerson, D. Xu, U. Yapanel, S. F. Warren 
(2010). Automated Vocal Analysis of Naturalistic Recordings from Children with Autism, 
Language Delay and Typical Development. Proceedings of the National Academy of 
Sciences, 107, 30, 13354-13359.
Proposed application of automated computational analysis to the early detection of 
autism spectrum disorders
Ted Hutman
Assistant Professor of Psychiatry & Biobehavioral Science
David Geffen School of Medicine - UCLA
Abstract Because Autism Spectrum Disorders (ASDs) are generally not diagnosed until 
the fourth year, relatively little is known about their overt manifestations during infancy 
or the neural mechanisms that underlie them. In my lab, we are conducting longitudinal 
evaluations of infant siblings of children with ASD because these infants are roughly 
twenty times more likely to be diagnosed with ASD than low-risk controls. We are tracking 
the infants’ social, cognitive, motor, and physical development from 6 weeks to three 
years of age, at which time clinical diagnoses are considered stable. Studies in our lab and 
elsewhere find few behavioral signs of ASD at 6 months, but several robust markers by 12 
months. Most of the atypical behaviors associated with ASD at 12 months are social in 
nature. These include imitation, orienting to faces, initiating and responding to attentiondirecting behaviors, and responding to distress. After I review the findings of this research 
program, I will describe the methodology and our conceptual approach to studying highrisk infants. I will propose that diagnostic groups can be differentiated earlier, group 
differences can be magnified, and more children can be screened by applying automated 
computational analysis to video footage of a wide range of infant behavior. Behavioral 
targets of interest include vocalization, gesture, gross motor activity, affective displays, 
and social orienting.
Discussion & wrap up
    Panelists
    Gregory Abowd - Georgia Institute of Technology
Portia Iversen - The Descartes Institute
    Clara LaJonchere - Autism Speaks
 Olga Solomon - University of Southern California
Facilitators
Matthew Goodwin - Northeastern University
Agata Rozga - Georgia Institute of Technology
Organized by:
Shri Narayanan University of Southern California
Matthew Goodwin Northeastern University
Gregory Abowd Georgia Institute of Technology
Agata Rozga Georgia Institute of Technology
Danielle Hamra University of Southern California