Now the 10-year-old San Jose boy is getting help from “autism glass” – an experimental device that records and analyzes faces in real time and alerts him to the emotions they’re expressing.
The facial recognition software was developed at Stanford University and runs on Google Glass, a computerized headset with a front-facing camera and a tiny display just above the right eye.
Julian is one of about 100 autistic children participating in a Stanford study to see if “autism glass” therapy can improve their ability to interpret facial expressions.
“There’s not a machine that can read your mind, but this helps with the emotions, you know, recognizing them,” Julian said.
Julian wears the device each day for three 20-minute sessions when he interacts with family members face-to-face – talking, playing games, eating meals. The program runs on a smartphone, which records the sessions.
When the device’s camera detects an emotion such as happiness or sadness, Julian sees the word “happy” or “sad” – or a corresponding “emoji” – flash on the glass display. The device also tests his ability to read facial expressions.
“The autism glass program is meant to teach children with autism how to understand what a face is telling them. And we believe that when that happens they will become more socially engaged,” said Dennis Wall, who directs the Stanford School of Medicine’s Wall Lab, which is running the study.
Stanford student Catalin Voss and researcher Nick Haber developed the technology to track faces and detect emotions in a wide range of people and settings.
“We had the idea of basically creating a behavioral aide that would recognize the expressions and faces for you and then give you social cues according to those,” said Voss, who was partly inspired by a cousin who has autism.
Google provided about 35 Google Glass devices to Stanford, but otherwise hasn’t been involved in the project. The Silicon Valley tech giant stopped producing the headset last year after it failed to gain traction, but the device found new life among medical researchers.
Brain Power, a Cambridge, Mass.-based startup, is also developing Google Glass-based applications to help children with autism improve their face-reading abilities and social skills.
Autism advocates are excited that researchers are developing technologies to help the estimated one in 68 American children diagnosed with autism spectrum disorder.
“Glass and wearable technology are the future. They’re going to play a pivotal role in how we understand, manage and diagnose disorders like autism,” said Robert Ring, chief science officer at Autism Speaks.
Currently, many autistic children learn to read facial expressions by working with therapists who use flashcards with faces expressing different emotions. The Stanford team hopes autism glass can provide a convenient, affordable therapy that families can do at home.
“Kids with autism are not getting enough of the care that they need for as long as they need it, and we need to fix the problem,” Wall said.
If the study shows positive results, the technology could become commercially available within a couple years, Wall said.
“Anything that can help this population is very welcome and very important, but even the best technology will never be enough because we are dealing with a population with often very, very profound needs,” said Jill Escher, president of Autism Society San Francisco Bay Area.
The study is still in its early stages, but Wall said participating children have shown gains in their face-reading abilities and family feedback has been encouraging.
“It has helped our son who’s using the Google Glasses connect with the family more,” said Kristen Brown, Julian’s mother. “I think the glasses are a positive way to encourage a kid to look someone else in the face.”
Julian also gives the device positive reviews: “I really think it would help autistic people a lot.”
