Penn Medicine introduces iStar, an AI application for precision oncology

TL;DR:

  • Penn Medicine’s Perelman School of Medicine introduces iStar, an AI tool for precision oncology.
  • iStar offers detailed insights into gene activities in medical images, aiding in cancer diagnosis.
  • The AI tool assesses safe margins after cancer surgeries and annotates microscopic images.
  • Developed from NIH-funded research, iStar can detect anti-tumor immune formations.
  • iStar’s development is rooted in spatial transcriptomics, utilizing machine learning for near-single-cell resolution predictions.
  • The technology enables the detection of hard-to-identify cancers, supporting clinicians.
  • AI is driving advancements in personalized healthcare and oncology treatments.

Main AI News:

In a groundbreaking development, Penn Medicine’s Perelman School of Medicine researchers have introduced iStar, an innovative artificial intelligence application designed to revolutionize the field of precision oncology. iStar, which stands for Inferring Super-Resolution Tissue Architecture, promises to provide clinicians with unprecedented insights into gene activities within medical images, potentially leading to the diagnosis of previously undetected cancers.

This remarkable technology has the potential to reshape the landscape of cancer diagnosis and treatment. By leveraging its computational power, iStar offers detailed views of individual cells in medical images, allowing oncologists and researchers to identify cancer cells that might have otherwise gone unnoticed. As outlined in a recent Nature paper, iStar can also assess the achievement of safe margins after cancer surgeries and provide automatic annotations for microscopic images, ushering in new possibilities for molecular disease diagnosis.

The origins of iStar trace back to National Institutes of Health-funded research led by Mingyao Li, a distinguished professor of biostatistics and digital pathology at the Perelman School, and Penn Medicine research associate David Zhang. The application boasts the ability to automatically detect critical anti-tumor immune formations known as tertiary lymphoid structures. The presence of these formations has been linked to a patient’s potential for survival and favorable responses to immunotherapy, underscoring the potential impact of iStar in tailoring specific immunotherapy interventions.

Penn Medicine emphasizes that iStar’s development is rooted in the emerging field of spatial transcriptomics, which maps gene activities within tissue spaces. Using a machine learning tool called the Hierarchical Vision Transformer, Li and her team trained iStar on standard tissue images. The process begins by segmenting images into various stages, starting with fine details and progressively zooming out to capture broader tissue patterns. iStar then incorporates this data with other clinical information to predict gene activities, often at near-single-cell resolution.

Li and her team rigorously tested iStar on different types of cancer tissue alongside healthy tissues. In these trials, the technology demonstrated its ability to automatically detect tumor and cancer cells that were challenging to identify visually. This breakthrough holds the promise of empowering clinicians to diagnose previously elusive or hard-to-identify cancers, with iStar serving as an invaluable layer of support.

The broader trend in the healthcare industry underscores the transformative potential of artificial intelligence, which is driving advancements in personalized and patient-focused care. As innovative policies and more powerful computers continue to pave the way for precision medicine, genomic programs, and other AI-enabled oncology treatments, iStar emerges as a powerful tool poised to shape the future of cancer diagnosis and treatment.

Mingyao Li, in a statement, highlighted the unique capabilities of iStar, comparing its techniques to those of a pathologist examining a tissue sample. Just as a pathologist starts by identifying broader regions and then zooms in on detailed cellular structures, iStar can capture both the overarching tissue structures and the minutiae in a tissue image. Additionally, iStar’s speed is a significant advantage, making it suitable for large-scale biomedical studies and extensions into 3D and biobank sample prediction. In a 3D context, where tissue blocks may involve hundreds to thousands of serially cut tissue slices, iStar’s rapid data processing enables the reconstruction of vast spatial data in a short period, further enhancing its value in advancing medical research and patient care.

Conclusion:

Penn Medicine’s iStar AI application signifies a significant leap in precision oncology. Its ability to enhance cancer diagnosis, assess surgical outcomes, and aid in research positions it at the forefront of healthcare innovation. As AI continues to shape personalized healthcare and oncology treatments, iStar’s introduction signals promising developments in the medical market, offering new avenues for more accurate cancer diagnosis and treatment.

Source