Cancer from the Inside Out: Using Virtual Reality to Create Certainty in Clinical Decisions using Complex Genomics

Authors

  • Dan Catchpoole Tumour Bank, Children’s Cancer Research Unit, Kids Research, The Children’s Hospital at Westmead, Westmead, NSW, Australia.
  • Chng Wei Lau School of Computer, Data & Mathematical Sciences, Western Sydney University, Parramatta, NSW, Australia"
  • Jolin Qu School of Computer, Data & Mathematical Sciences, Western Sydney University, Parramatta, NSW, Australia"
  • Andrew Johnston Animal Logic Academy, The University of Technology Sydney, Ultimo, NSW Australia.
  • Ali Braytee School of Computer Science, Faculty of Engineering and IT, The University of Technology Sydney, Ultimo, NSW, Australia
  • Daniel Draper Samurai Punk, Melbourne, Victoria, Australia.
  • Paul Kennedy School of Computer Science, Faculty of Engineering and IT, The University of Technology Sydney, Ultimo, NSW, Australia
  • Quang Vinh Nguyen School of Computer, Data & Mathematical Sciences, Western Sydney University, Parramatta, NSW, Australia

Abstract

Background: The human genome is complex. It is within this complex data that information will be found that identify patients as individuals, the very basis of ‘precision medicine’. Functionally, this complex genome underpins the biological mechanisms of an individual patient's cancer. 

Aim: To build a framework for personalised treatment of disease, where the complexity of the genome is negotiated in meaningful and actionable ways. 

Methods: Machine learning analysis of complex genomic data embed the high dimensional features into low dimensional (3D) space to visualise the interrelationships between patients (eg PCA, tSNE, UMAP). Here we present VROOM (Virtual Reality to Observe Oncology Models), a novel VR prototype that allows the complete immersion of the user within the data 3D model for a cohort of patients which allows for comparative data analysis, visualisation and clinical interpretation of individual patients.

Results: VROOM is built on strong design principles and practical needs that allow analysts to move into the 3D environment to explore within the cohort for individual patients of interest. Tested on models involving gene expression data derived from 400 acute myeloid leukaemia patients, users can select individuals to compare within the 3D virtual genomic world. The system allows for the extraction of patient specific gene expression values which are then transferred to a virtual 2D working board that displays patient-specific information as well as different graphical representations, teasing out all user-defined data comparisons for the individuals in question. Stakeholder usability studies highlight ease of use and the unique merits of the application.

Published

2022-07-27

Issue

Vol. 1 No. 1 (2022)

Section

ePosters