truth_lies_1

Impartial experts not so impartial

U. VIRGINIA (US) — Researchers find that many “impartial” expert witnesses lose sight of objectivity and tend to come to conclusions that align with those who pay for their services.

Forensic psychologists and psychiatrists are ethically bound to be impartial, to look only at the evidence before them, when performing evaluations or providing expert opinions in court. But new research suggests that the paycheck some courtroom experts receive influences their evaluations.


“It’s disappointing, because we’re not seeing clinicians demonstrate the objectivity we’re all aspiring to,” Daniel Murrie says of the study findings. “But it’s also alarming because bias has such implications for justice. We really do want our justice system to have objective, reliable data, but at times the adversarial process that’s supposed to bring us closer to the truth is actually distorting the truth.” (Credit: mattappleby/Flickr)

In a real-world experiment, experts who believed they were working for prosecutors tended to conclude that sexually violent offenders were at greater risk of re-offending than did experts who thought they were working for the defense, the researchers found.

“The findings were fairly alarming,” researcher Daniel Murrie says. The findings will be published in the journal Psychological Science. “We suspected to find some of what we call the ‘allegiance effect’—some difference between the sides—but the difference was more than we were expecting.”

Murrie, director of psychology at University of Virginia’s Institute of Law, Psychiatry and Public Policy and an associate professor of psychiatry and neurobehavioral sciences at the School of Medicine, has long been interested in the impartiality of forensic psychiatrists and psychologists. He both conducts forensic psychological evaluations and trains others to do so.

“For years I would have says, ‘We really are unbiased, because we’re required to be,’” he says. “But over the years I realized we really didn’t have any genuine data on this important question, and that the field just took it on faith that evaluators could do their work objectively.”

So he and his colleagues set out to find some hard numbers. After several observational studies in the field—where it is impossible to rule out other explanations for “adversarial allegiance”—they designed the most rigorous experiment they could.

The experiment

The researchers recruited experienced forensic psychiatrists and psychologists from several states by offering a free continuing education workshop on the psychological tests used to evaluate sexually violent predators. A total of 118 attended, receiving real training over two days. In exchange, they agreed to provide paid consultation to a state agency that was reviewing a large number of sexually violent offender files. Or so they were told.

When the participants returned weeks later to provide paid consultation on what they thought was a large cohort of offender files, researchers actually gave all the participants the same four files to review. When participants met with a real lawyer, half were led to believe they were working with the defense, while the other half thought they were working with the prosecution.

The results were significantly different—and broke down along employment lines. The experts scored the offenders on two scales widely used in court proceedings. The experts who thought they were working for the prosecution tended to assign higher risk scores; the defense experts tended to assign lower risk scores.

The differences were striking because in other contexts, different experts usually provide very similar scores on these tests, and scores rarely differ by more than a few points. But in this study, the scores often differed more than the typical error rate, and they differed systematically depending on the side.

Not every expert demonstrated biased scoring, of course. But analyses suggested that most opposing pairs of evaluators had score differences greater than could be attributable to chance alone.

Is objectivity obtainable?

“It’s disappointing, because we’re not seeing clinicians demonstrate the objectivity we’re all aspiring to,” Murrie says of the study findings. “But it’s also alarming because bias has such implications for justice. We really do want our justice system to have objective, reliable data, but at times the adversarial process that’s supposed to bring us closer to the truth is actually distorting the truth.”

Their findings were similar to recent evidence of bias in other forensic sciences, such as DNA and fingerprint analysis. Murrie hopes that the study will prompt experts in his field to take a hard look at how evaluators are trained and how they practice.

“Most people in this line of work really do try to be objective and pride themselves on being objective,” Murrie says. “But our hope is that these results prompt us to better consider how these adversarial arrangements can affect our work, and to build some better safeguards.”

Source: University of Virginia

chat5 Comments

You are free to share this article under the Creative Commons Attribution-NoDerivs 3.0 Unported license.

5 Comments

  1. Roy Niles

    Intelligence, as a probability determining function, is clearly affected by the purposes for which it’s to be used. If we pay for it, it seems to feel an honest duty to tell us what we probably want to hear.

  2. Monica

    Hence trials becoming battles of the supposedly objective expert witnesses. Troubling for the legal system. The challenge is how to set up the system so that the experts are being paid in some way by the Court itself – the presumption of the truly neutral body – rather than by either the prosecution or the defense. A real thorny issue no doubt.

  3. Roy Niles

    In the Inquisitorial systems, the court does have the right to call experts for testimony, but we are stuck with the adversarial system where one side can always find an expert to call the expert on the other side a liar.

  4. Malman

    It’s troubling to know that experts are not the unbiased evaluators we expect them to be. Speaking from a psychological perspective, it is somewhat predictable, though that the role of the expert (prosecutor vs. defense) has an impact on their judgments.

    The expert’s prior knowledge and/or experience most likely also impacts their professional opinion enough that the prosecution or defense can further sway the jury with further rhetoric surrounding the expert statements.

    Moreover, as Roy mentioned, in today’s world of high profile cases and media hypes, it is not too difficult to find someone to work on your side and provide the desired, supporting testimony, especially if there is a substantial compensation involved.

  5. Diana Bloom

    When coming into my first class of forensic psychology in Chicago immediately that we are ethically bound to be impartial. As the class drew on, being impartial also means dropping what you may or may not think to be moral and right. It’s interesting but difficult I must say!

We respect your privacy.