Archives

Play Video

3D imaging enhances checks for aggressive prostate cancer

"We show for the first time that compared to traditional pathology—where a small fraction of each biopsy is examined in 2D on microscope slides—the ability to examine 100% of a biopsy in 3D is more informative and accurate," says Jonathan Liu. (Credit: Eliot Phillips/Flickr)

A new 3D imaging method may help doctors more accurately determine the aggressiveness of a person’s prostate cancer.

Prostate cancer is the most common cancer for men and, for men in the United States, it’s the second leading cause of death.

Some prostate cancers might be slow-growing and can be monitored over time whereas others need to be treated right away. To determine how aggressive someone’s cancer is, doctors look for abnormalities in slices of biopsied tissue on a slide. But this 2D method makes it hard to properly diagnose borderline cases.

The new non-destructive method images entire 3D biopsies instead of just a slice. In a proof-of-principle experiment, researchers imaged 300 3D biopsies taken from 50 patients—six biopsies per patient—and had a computer use 3D and 2D results to predict the likelihood that a patient had aggressive cancer. The 3D features made it easier for the computer to identify cases more likely to recur within five years.

Both samples appear mostly yellow, but the benign sample is much less compact and shows more red
A screenshot of a volume rendering of glands in two 3D biopsy samples from prostates (yellow: the outer walls of the gland; red: the fluid-filled space inside the gland). The cancer sample (top) shows smaller and more densely packed glands compared to the benign tissue sample (bottom). (Credit: Xie et al./Cancer Research)

“We show for the first time that compared to traditional pathology—where a small fraction of each biopsy is examined in 2D on microscope slides—the ability to examine 100% of a biopsy in 3D is more informative and accurate,” says senior author Jonathan Liu, professor of mechanical engineering and of bioengineering at the University of Washington.

“This is exciting because it is the first of hopefully many clinical studies that will demonstrate the value of non-destructive 3D pathology for clinical decision-making, such as determining which patients require aggressive treatments or which subsets of patients would respond best to certain drugs.”

For the study, which appears in the journal Cancer Research, researchers used prostate specimens from patients who underwent surgery more than 10 years ago, so the team knew each patient’s outcome and could use that information to train a computer to predict those outcomes. In this study, half of the samples contained a more aggressive cancer.

To create 3D samples, the researchers extracted “biopsy cores”—cylindrically shaped plugs of tissue—from surgically removed prostates and then stained the biopsy cores to mimic the typical staining used in the 2D method. Then the team imaged each entire biopsy core using an open-top light-sheet microscope, which uses a sheet of light to optically “slice” through and image a tissue sample without destroying it.

The 3D images provided more information than a 2D image—specifically, details about the complex tree-like structure of the glands throughout the tissue. These additional features increased the likelihood that the computer would correctly predict a cancer’s aggressiveness.

The researchers used new AI methods, including deep-learning image transformation techniques, to help manage and interpret the large datasets this project generated.

“Over the past decade or so, our lab has focused primarily on building optical imaging devices, including microscopes, for various clinical applications. However, we started to encounter the next big challenge toward clinical adoption: how to manage and interpret the massive datasets that we were acquiring from patient specimens,” Liu says.

“This paper represents the first study in our lab to develop a novel computational pipeline to analyze our feature-rich datasets. As we continue to refine our imaging technologies and computational analysis methods, and as we perform larger clinical studies, we hope we can help transform the field of pathology to benefit many types of patients.”

Weisi Xie, a mechanical engineering doctoral student, is the paper’s lead author. Additional coauthors are from Case Western Reserve University, the Canary Foundation, and the University of Washington.

The US Department of Defense Prostate Cancer Research Program, the National Cancer Institute; the National Heart, Lung and Blood Institute, the National Institute of Biomedical Imaging and Bioengineering, the National Institute of Mental Health, the VA Merit Review Award; the National Science Foundation, the Nancy and Buster Alvord Endowment, and the Prostate Cancer Foundation Young Investigator Award funded the work.

Jonathan Liu and University of Washington researchers Nicholas Reder, Adam Glaser, and Lawrence True are co-founders and shareholders of the spinout Lightspeed Microscopy Inc. This company has licensed the technology used in this paper.

Source: University of Washington

Play Video

Doctors to ‘step inside’ biopsy samples with VR

Researchers are pairing a nanoscale imaging technique with virtual reality technology to offer a way for researchers to “step inside” biological data.

By combining the technique, called expansion microscopy, with virtual reality (VR), scientists will be able to enlarge, explore, and analyze cell structures far beyond the capabilities of traditional light microscopy.

The development of these technologies will accelerate researchers’ understanding of infectious and autoimmune diseases and enhance their ability to develop disease diagnostics and prevention and treatment methods.

Magnifying samples in virtual reality

Yongxin (Leon) Zhao, an assistant professor of biological sciences at the Mellon College of Science at Carnegie Mellon University, has been developing the expansion microscopy technique to physically magnify a biopsy, allowing researchers to see fine details in biological samples using standard microscopes.

Zhao makes biopsy samples grow in size by chemically transforming them into water-soluble hydrogels. He then applies a treatment that loosens the tissues and allows them to expand more than 100 times in volume. The tissues and molecules within the sample can then be labeled, imaged, and compiled into a complex set of data, to be used to study interactions among cells and their structures.

However, a limitation of the technology is that it extracts two to three orders of magnitudes more data than current techniques are able to interpret. To help solve that problem, the researchers paired expansion microscopy with a virtual reality technique developed at the Benaroya Research Institute at Virginia Mason (BRI).

Through VR technology developed specifically for the purpose, researchers will be able to see and manipulate the originally 2D expansion microscopy images in 3D, giving them a 360 degree view of tissue and protein organizations and interactions.

“At BRI, we’ll prepare the live infectious and autoimmune disease samples,” says Caroline Stefani, senior postdoctoral research associate. “We’ll send those to Carnegie Mellon, where they will enlarge the samples and send images back to BRI to be viewed in VR.”

Data immersion

“This is the future of how scientists can handle complex data,” Zhao says. “It’s an immersive experience, just like you are sitting inside your data. You have the freedom to explore your data from every angle and every spot.”

Tom Skillman, BRI’s former director of research technology, developed the virtual reality technology and has since founded a VR company, Immersive Science.

“My role in this grant is to develop a software tool that will allow scientists studying disease a way to understand large amounts of data through a computational technique called ‘immersive science,'” Skillman says.

“Bringing all that data into VR not only allows the scientist to see their 2D microscope images in full 3D, but to interact with the data, selecting channels, adjusting the views, colors, and contrast, and grabbing and rotating the images to quickly identify key aspects of the image that are coupled back to the disease under study.”

The eventual goal is for the researchers to share the VR tool, called ExMicroVR, on open platforms with other researchers along with expansion microscopy so that they too can view new details of disease processes and understand larger, more complex sets of data.

The system to convert expansion microscopy data into VR 3D images will be affordable and easily accessible to researchers and physicians in developing countries. It will also allow for up to six people to collaborate and view the same sample remotely at the same time.

Funding for the research came through Grand Challenges, an initiative of the Bill & Melinda Gates Foundation.

Source: Carnegie Mellon University

  • Hyperspectral camera gathers data in an instant