Sensors for athletes fail concussion test

"If these devices over-predicted consistently, say, they were always 50 percent over, then it's probably not a huge issue," says Lyndia Wu. "But the problem is that they don't correlate with skull motion, which makes it difficult to interpret their measurements, and in turn makes it difficult to interpret injury risk predictions." (Credit: TownePost Network/Flickr)

Many commercially available sensors worn by athletes to measure head impacts may be overestimating concussion risk. Where a sensor is mounted appears to make a big difference in the results, recent tests show.

Researchers, led by David Camarillo, an assistant professor of bioengineering and mechanical engineering at Stanford University, looked at three of the leading methods for measuring head impacts: a sensor that adheres to the skin just below the ear, a sensor worn inside a skullcap, and sensors embedded in a mouthguard.

A test subject wore the sensors while heading a soccer ball traveling at speeds roughly equivalent to those observed in youth soccer. The researchers used high-speed cameras to record how the subject’s head moved during impact, and compared that camera data to measurements produced by the sensors. (The subject also wore a sensor deep in his ear canal that provided a reference for skull movement.)

Off by 500%

The mouthguard—which is used by Stanford’s football team—displaced less than 1 millimeter compared to the video measurement, within the estimated error. The skin patch and skull cap sensors, however, fared significantly worse, moving 4 mm and 13 mm, respectively.

The additional movement caused these two devices to overpredict the acceleration of impact by up to 500 percent, an error that could make it difficult to study the cause of injury.

[How young is too young for football?]

“If these devices over-predicted consistently, say, they were always 50 percent over, then it’s probably not a huge issue,” says Lyndia Wu, a graduate student in Camarillo’s lab and the lead author on the new study published in the journal Annals of Biomedical Engineering.

“But the problem is that they don’t correlate with skull motion, which makes it difficult to interpret their measurements, and in turn makes it difficult to interpret injury risk predictions.”

High sensor accelerations measured from the skin/apparel motion might trigger false positive warnings, when in fact no concussion occurred, Camarillo says.

“Across the country, all states have passed some version of concussion legislation that requires medical professionals to evaluate and sign off on child athletes suspected of a concussion,” Camarillo says. “You can see how this would cause a problem if there are too many false positives and kids being pulled out of play. A clinical tool to aid in diagnosis needs to be validated for some degree of sensitivity and specificity, but at this stage we need to do the research first.”

Skull caps slide

The researchers found a simple reason for the discrepancies: Skin is flexible, and the momentum of the impact moved the sensor past the point of the actual skull movement. Similarly, the skull cap didn’t fit tightly and slid during impact.

These two sensors also inaccurately registered the direction of the force, which Camarillo’s group has previously found to be an important factor in predicting injury.

[Concussions and depression look alike in brain scans]

The experiment was relatively simple and the impacts were mild compared to actual sports, the researchers acknowledged, but the results should give a general sense of how well the devices perform during blunt head impact scenarios.

Although the study looked at only three sensor types, Camarillo says he would expect that any sensor that that isn’t securely fitted would provide similarly skewed results.

The researchers expect that the errors associated to soft tissue motion would likely be observed in other sports and at higher speeds, though the magnitude of that error is difficult to predict.

They are designing a broader range of tests with human subjects performing a larger range of motions—mounting evidence suggests that measurements made using dummies might not be sufficient—but expect devices attached to teeth or inside the ear canal to perform better than those mounted to tissue or gear.

“My personal opinion is that it would take major effort to mitigate patch/cap issues, since tissue properties may change from person to person and from impact scenario to impact scenario,” Wu says. “It is probably an easier route to go with a different mounting location.”

Source: Stanford University