A common test for autism is less reliable than previously assumed, researchers report.
The standardized test, known as the Autism Diagnostic Observation Schedule (ADOS), assesses communication skills, social interaction, and play for children who may have autism or other developmental disorders.
To digitize the test, researchers attached wearable technology, like an Apple Watch, to two clinicians and 52 children who came in four times and took two different versions of the test.
When researchers looked at the scores of the entire cohort, they found they did not distribute normally—which could mean a chance of false positives inflating the prevalence of autism, among other implications.
The results showed that switching ADOS-certified clinicians may change a child’s scores and consequently influences the diagnosis. The researchers found similar results when they analyzed open-access data of 1,324 people ages 5 to 65, says Elizabeth Torres, associate professor of psychology at Rutgers University and director of the New Jersey Autism Center of Excellence.
“The ADOS test informs and steers much of the science of autism, and it has done great work thus far,” says Torres. “However, social interactions are much too complex and fast to be captured by the naked eye, particularly when the grader is biased to look for specific signs and to expect specific behaviors.”
“Reliance on observational tests that do not tackle the neurological conditions of the child from an early age could be dangerous.”
The researchers suggest combining clinical observations with data from wearable biosensors, such as smartwatches, smartphones, and other off-the-shelf technology.
By doing so, they argue, researchers may make data collection less invasive, lower the rate of false positives by using empirically derived statistics rather than assumed models, shorten the time to diagnosis, and make diagnoses more reliable and more objective for all clinicians.
Autism researchers should aim for tests that capture the accelerated rate of change of neurodevelopment to help develop treatments that slow down the aging of the nervous system, Torres says.
“Autism affects one out of 34 children in New Jersey,” she says. “Reliance on observational tests that do not tackle the neurological conditions of the child from an early age could be dangerous.
“Clinical tests score a child based on expected aspects of behaviors. These data are useful, but subtle, spontaneous aspects of natural behaviors, which are more variable and less predictable, remain hidden. These hidden aspects of behavior may hold important keys for personalized treatments, like protecting nerve cells against damage, or impairment, which could delay or altogether stop progression.”
The study appears in Neural Computation. Additional coauthors are from Rutgers, the University of Utah Medical School, and Montclair State University.
Source: Rutgers University
