Abstract
Radiomics is an emerging approach to analyze clinical images with the purpose of revealing quantitative features that are unvisible to the naked eye. Radiomic features can be further combined with clinical data and genomic information to formulate prediction models using machine learning algorithms or manual statistical analysis. While radiomics has been classically applied to tumor analysis, there is promising research in its application to spine surgery, including spinal deformity, oncology, and osteoporosis detection. This article reviews the fundamental principles of radiomic analysis, the current literature relating to the spine, and the limitations of this approach.
Introduction
Radiomics is a technique in which diagnostic images can be processed and analyzed to extract quantitative and ideally reproducible information that is not perceptible to the human eye.1,2 The foundational principle is that qualitative and quantitative information found within clinical images reflect underlying pathophysiology, for example, genetic mutations within tumors.3,4 Although radiomics was primarily rooted in basic science research, it has recently gained the interest of clinical researchers as the clinical potentials are being increasingly recognized.5 For instance, a clinical radiographer can utilize a radiomics approach to classify whether a lesion on a computed tomography (CT) image could be malignant or benign.
In the era of personalized medicine, radiomics presents an exciting potential opportunity, as machine learning (ML) algorithms can be subsequently applied to predict outcomes such as survival or adverse effects. This enables radiomics to be a potentially powerful clinical tool to assist clinicians in decision-making and forming clinical decision support systems.6 The novel approach to convert clinical images into a large quantifiable data source for clinical decision algorithms contrasts with the traditional view that clinical images are intended purely for visual interpretation.
While a great proportion of radiomics research has stemmed from oncology, research is growing in the spine domain.7 This article summarizes the multistep process involved in radiomics, how radiomics can be applied to spine surgery, and the potential for future development.
What is Radiomics?
The term “radiomics” was first coined in 2012 by Phillippe Lambin when describing the automated extraction of large quantities of image features from radiographical images.8 In 2014, radiomics was applied to the field of oncology, where CT images of lungs were analyzed to predict outcomes in lung cancer. Since that time, there has been rapid growth in the range of its applications.7 Radiomics can be utilized across the breadth of imaging modalities, including radiography, magnetic resonance imaging (MRI), CT, and positron emission tomography.9
The radiomics process is illustrated in Figure 1.10 When an image is acquired, the region of interest (ROI) must be identified for image segmentation.11 This is the area of the clinical image (by location of pixels/voxels), which contains the prognostic value and where radiomic features will be extracted.10 This is a complex step in radiomics because the segmentation process varies across studies. Segmentation can be a manual process, but developments in deep learning algorithms have enabled automatic processing, which can be advantageous as it limits inter- and intraobserver variations.12 For larger datasets, automated processes are often needed because manual techniques are more time-consuming and less reproducible.
The radiomics process and sequential steps, including image acquisition, segmentation of region of interest, extraction of radiomic features, and predictive modeling and subsequent validation.10 2D, 2-dimensional; 3D, 3-dimensional; CT, computed tomography; MRI, magnetic resonance imaging; PET, positron emission tomography. Source: Reprinted from van Timmeren JE, Cester D, Tanadini-Lang S, Alkadhi H, Baessler B. Radiomics in medical imaging—”how-to” guide and critical reflection. Insights Imaging. 2020;11:91. https://doi.org/10.1186/s13244-020-00887-2.10
The second step is image processing to standardize the images for subsequent feature extraction. Durand et al demonstrated how data preprocessing is an important step in the artificial intelligence clustering of adult spinal deformity morphology using lateral long-cassette spinal radiographs.13 The femoral heads and distance from the femoral head to the sacral endplate were standardized to a set location to ensure consistent feature extraction of the spine shape and size (Figure 2). Image processing allowed for subsequent vertebral landmark identification and mapping of the spinal morphology to a cluster with similar patients. It is important to note the importance of designing preprocessing with the algorithm’s ultimate outcome in mind—this approach was appropriate specifically given the goal of clustering overall spine “shape” with an emphasis on thoracolumbar deformity.
The importance of image processing. Durand et al used an artificial intelligence approach to cluster patients with adult spinal deformity according to their spine morphology. Reprinted with permission from Durand et al. Artificial intelligence clustering of adult spinal deformity sagittal plane morphology predicts surgical characteristics, alignment, and outcomes. European Spine Journal. 2021.13
The purpose of image segmentation and processing is to enable an accurate extraction of radiomic features from clinical images obtained. These are numerous but can include intensity, size, texture, shape, and location or relationship to adjacent tissues.14 There are 2 overall types of features that can be extracted using radiomic approaches: “semantic” and “agnostic” features.5 Semantic features are common language terms used to describe an ROI—for example, size, shape, and vascularity. However, agnostic features are mathematically calculated quantitative signifiers that may reflect relationships between spatially unrelated image features.
The cross-sectional area (CSA) of the psoas muscle is a good example of a radiomic feature that is identifiable on MRI imaging and may have utility in predicting outcomes of spine surgery. Prior studies investigated how the CSA of the paraspinal muscles and psoas muscle relates to lean body mass, muscle strength, and short-term outcomes of minimally invasive thoracolumbar interbody fusion.15–17 Banno et al found that the CSA of the multifidus muscle was lower in patients with adult spinal deformity and may correlate with severity of sagittal deformity.18 Additionally, another study found that the CSA of the multifidus muscle was reduced by lumbar disc herniation.19 Through a radiomic approach, future studies can improve upon the predictive value of the CSA in spine surgery outcomes.
With such complexity of radiomic features, feature selection is an essential step in the process. If all possible features were included in a model, there would be overfitting of the model, which limits its wider applicability.9 Therefore, reducing the number of features to build into algorithmic models is critical for generating generalizable results. Although there is no definitive rule for defining feature selection, certain principles are helpful to consider. If a feature has a high inter- or intraobserver variability, depending on how the image was segmented, this is unlikely to be useful in building a model.20
Radiomic modeling, for prognostic analysis and clinical prediction making, involves 3 key elements: feature selection, modeling methodology, and validation.9 The most comprehensive models should include sources of data beyond radiomic features, which may include genetic information, patient-reported outcome measures, health-related quality of life measures, patient health data, and other details relating to the patient’s clinical course. By combining data from radiomic analysis with clinical and molecular data, there is a greater ability to form more accurate clinical predictions. Multiple ML models should then be applied to the data to identify the most effective algorithm at creating a clinical decision support system, which is stable and clinically relevant. Finally, models should be validated to assess their performance, ideally with both internal and external prospective validation, to demonstrate generalizability on independent datasets.
When considering the strength of radiomic analysis, “repeatability” and “reproducibility” are 2 key concepts.21 Repeatability refers to radiomic features that remain consistent when imaged multiple times in the same subject using the same image acquisition method. Reproducibility refers to radiomic features that remain constant when different equipment (such as CT scanners), different software, and different parameters are applied.
Radiomics in Spine Surgery
In spinal pathologies, ML algorithms have been previously applied to identify subtle abnormalities on plain radiographs. For example, ossification of the posterior longitudinal ligament can have elusive findings on plain radiographs, but it is a critical pathology to identify due to the possibility of adverse outcomes both with nonoperative treatment as well as choosing the type of operative intervention. An ML model applied to plain radiographs was able to detect ossification of the posterior longitudinal ligament with 90% accuracy, outperforming the accuracy of spine surgeons (75%).22 Radiomic modeling is another approach used to identify pathology from clinical images of the spine and can be combined with ML algorithms.
Detecting Pathology
Radiomics has been previously applied in the orthopedic domain to identify pathology, such as osteoarthritis. Hirvasniemi et al developed a model to predict knee osteoarthritis using MRI-based radiomic features from tibial bone.23 Xue et al then furthered this by analyzing radiomic features in tibial and femoral subchondral bone to predict osteoarthritis.24 Osteoporosis is an important condition that spine surgeons consider when planning potential surgical intervention and preoperative optimization. Although this condition is traditionally diagnosed using dual-energy x-ray absorptiometry, most spine patients have their pathology evaluated by MRI. He et al applied a radiomics model to 109 patients who underwent both dual-energy x-ray absorptiometry and MRI with 396 features extracted.25 The area under the curve (AUC) was calculated to evaluate the discriminative ability of these models. The AUC for the optimal classification of normal vs osteopenia was 0.810, normal vs osteoporosis was 0.797, and osteopenia vs osteoporosis was 0.769. This suggests good discriminative ability between these bone densities and the potential utility in the diagnosis of osteoporosis without the need for additional testing.
Spinal Oncology
Radiomics has been frequently applied in oncologic research.26,27 In the orthopedic literature, Gitto et al have utilized radiomics and ML to classify cartilaginous bone tumors and differentiate between atypical cartilaginous tumors and grade II chondrosarcoma of long bones.28,29 Naturally, this has given interest in the role of radiomics specifically in spinal oncology. One of the challenges in this field is how MRI can differentiate between lesion types. This is an important clinical question because the spine is the most common site of bone metastasis, and management largely depends on the characteristics of the lesion.30 Chianca et al performed a radiomics study using 146 patients who underwent MRI for a single vertebral lesion.31 They found that a radiomics and ML approach was helpful in differentiating metastatic lesions from both malignant and benign primary bone tumors. A recent study by Gitto et al performed a similar investigation to differentiate malignant spinal bone tumors using diffusion and T2-weighted MRI. A total of 1702 radiomic features were extracted in this study, with 76.4% of these considered stable to variations in the ROI.32 The ML algorithm achieved 76% accuracy in differentiating between benign and malignant lesions when tested using the extracted radiomic features with a sensitivity of 78%, specificity of 68%, and AUC of 0.78.
Treatment Prediction
Once a patient is diagnosed with a condition, it is also helpful to predict how their treatment will alter their long-term prognosis. Patients with spinal metastasis may undergo stereotactic body radiation therapy to alleviate pain and control tumor progression. However, an undesirable sequela of this therapy is radiation-induced vertebral compression fracture (VCF). Gui et al were able to build an ML algorithm that could predict the risk of VCF after stereotactic body radiation therapy using the radiomic features from pretreatment imaging.33 In addition to extracting radiomic features from CT images and T1-weighted MRIs, clinical features, such as patient demographics and treatment characteristics, were also incorporated into the algorithm. The best performing model was able to predict VCF at 1 year, with a sensitivity of 84.4% and specificity of 80.0%.
Radiomic approaches may also be used to predict survival of patients with tumors, especially if used in conjunction with clinical data points. For example, Wang et al formulated a nomogram to predict 1- and 2-year survival for a wild-type glioblastoma using the radiomic signature and clinical risk factors.34 This tool may benefit clinicians, as patients with a shorter predicted life expectancy can potentially be spared invasive and painful procedures. Interestingly, radiomic feature extraction does not always improve the predictive power of models. Sanli et al performed a study on 250 patients who were treated for spinal metastasis with a Prognostic Index calculated for each patient; this was termed a radscore (radiomics score) and a clinscore (clinical score).35 The clinscore model showed good model accuracy, whereas the radiomics model added little predictive information (AUC 0.731 vs 0.623).
Limitations
Despite the growing evidence in radiomics and its application to a variety of clinical questions, there are several limitations to consider. Many of the limitations stem from the complex subprocesses involved in radiomics from image acquisition, feature extraction, and modeling. Each of these steps is affected by a wide range of nonstandardized decisions and parameter selections.9
Technical Limitations
To quantify radiomic features, several technical factors are involved and are subject to variability. To perform automatic segmentation in ROI, texture is a commonly utilized feature property for image classification. Galavis et al evaluated 50 textual features from positron emission tomography CT images of 20 patients with solid tumors. These features were classified according to their variability, which occurs due to different reconstruction parameters, acquisition modes, matrix sizes, and iteration numbers.36 Forty of the features (80%) were found to have a variation greater than 30%, including contrast, coarseness, and busyness.
The scanner used to acquire images for radiomic analysis can also pose a limitation. Mackin et al found that different CT scanners resulted in variability in the values of radiomics features extracted and concluded that the interscanner differences should be considered for future radiomic studies.37
Reproducibility and Overfitting
In radiomics, reproducibility depends on image acquisition, segmentation, and feature extraction.38 Reproducibility contributes to the internal validity of the study where the relationship between predicting variables and outcomes is explained without additional “noise.” Generalizability refers to the external validity when the model is applied across different population groups (Figure 3). Radiomics studies are typically retrospective and involve small patient datasets. Although these studies are important for proof of concept, the number of radiomic features extracted is much greater than the number of patients, and, therefore, this can lead to false positive results and feature selection bias.39 To confirm the predictive importance of models built upon radiomic features, a prospective external validation dataset should be utilized.9,40
Diagram illustrating how reproducibility relates to internal validity and the subsequent generalizability across the population. Source: Reprinted from Park JE, Park SY, Kim HJ, Kim HS. Reproducibility and generalizability in radiomics modeling: possible strategies in radiologic and statistical perspectives. Korean J Radiol. 2019;20(7):1124-1137. https://doi.org/10.3348/kjr.2018.0070.38
Overfitting is an associated concept and is a common problem in ML models. It occurs when an algorithm is trained too exactly with a dataset, thereby limiting its generalizability.41 Radiomic approaches result in “high dimensionality,” which refers to the production of a very large number of features implemented in the subsequent modeling and can risk overfitting.42 To mitigate overfitting, the number of radiomic features can be minimized using a dimensionality reduction algorithm. Dimensionality reduction removes the noise in the dataset and, therefore, keeps the most important features for the model to learn and apply to other datasets, not just the one the model is trained with.43 Other strategies to mitigate overfitting include using an expanded dataset and using data resampling techniques, such as bootstrapping aggregating.42,44 Cross-validation, such as K-fold cross-validation, is an additional method in which the complete dataset is split into parts to evaluate how the algorithms perform on unseen data.44
Class Imbalances
Class balance is another challenge where radiomic approaches are combined with ML algorithms. Class imbalance occurs when the number of examples available in 1 class is far less than in other classes; the class with a large number of samples is the “majority class,” and the one with few samples is the “minority class.” This is a problem because most ML algorithms assume an equal distribution of data between classes, and, therefore, a class imbalance will cause bias toward the majority class.
Class imbalance can be addressed through data handling techniques (eg, synthetic minority oversampling technique). For example, Kha et al built a model where radiomic features of low-grade gliomas with known genetic mutations were extracted from MRIs to predict a specific gene mutation of the tumor.45 An oversampling data technique was applied to address the class imbalance because a greater proportion of the patients did not have the gene mutation of interest. Therefore, the model would be less specific and biased toward identifying patients without the gene mutation.
Future Directions
Radiomics will no doubt play a role in the development of useful clinical tools for clinicians in the future. However, for radiomics to integrate within standard clinical use, several developments must occur. Radiomic studies are typically based on retrospectively collected data, which have limitations and serve primarily as proofs of concept.10 The retrospective nature of these radiomic studies results in the lack of standardization for imaging protocols and the introduction of unmeasured confounding variables.10 To confirm the utility of radiomics, validation studies using prospective datasets are necessary.
Furthermore, future radiomic studies should have coherent evaluation criteria and reporting guidelines. The transparent reporting of a multivariable prediction model for individual prognosis or diagnosis statement is a good example of recommendation guidelines for prediction models.46 Lambin et al outlined a radiomics quality score (RQS) to help reviewers, editors, and readers to evaluate whether the investigators are compliant with best practice methodology.9 The RQS includes 16 criteria, including image protocol quality to allow reproducibility/replicability, imaging at multiple time points, and reporting specific metrics. Each criterion, if achieved in the study, is assigned variable points to give a score out of possible 36 points. Notably, the highest point awarded is 7 points if a study is prospective and registered in a trial database for validation of the radiomics signature. Points can also be deducted if the study lacks a particular requirement. For example, 5 points are deducted if validation is missing; however, if validation is based on 3+ databases from multiple institutes, then 5 points are added. Therefore, the RQS clearly accentuates the principles that are required for future radiomic studies to have clinical utility—prospective datasets and appropriate validation. Koçak et al also provided a checklist of important criteria which should be transparently reported in radiomic studies, incorporating artificial intelligence analysis.42
To achieve the goal of acquiring a validated high-quality dataset, data sharing across intuitions should be employed. The power of prediction models created with radiomics and ML algorithms depends largely on the size and quality of the data.5 Although the image acquisition quality is important, the covariates collected must also be considered. Overall survival is a commonly reported outcome in the oncologic radiomics literature, although this may include all-cause mortality rather than the exact disease studied. More precise measures, such as disease-free survival, would be more clinically applicable but require laborious medical record reviews. Such a process could be simplified with a multicenter approach to collect more patient samples. One of the existing challenges is that imaging data must be shared in a Health Insurance Portability and Accountability Act–compliant manner. Deidentifying data, such as in the Cancer Imaging Archive, is one solution; or processing the data through a multisite institutional review board is another potential solution.
The ambition of radiomics is to enable clinicians to be increasingly informed in their diagnostic process and effectively counsel patients regarding their individualized risks and prognosis. Future radiomic studies may involve the integration of other data. Radiogenomics is one such approach where quantitative information extracted from radiomic analysis of clinical images is combined with individual genomic phenotype to construct prediction models.47 Imaging data are seldom used to predict clinical outcomes in isolation but are rather interpreted in the context of history, physical examination findings, laboratory data, etc. It is likely unreasonable to expect that, ultimately, the utility of radiomics would differ significantly from this integrated approach.
Conclusion
In the growing era of personalized medicine, spinal radiomics offers clinicians a promising decision-making tool.48 However, further work must be done to ensure these models are validated appropriately on high-quality datasets before being introduced within the clinical environment. As in many ML applications, future work in spinal radiomics will be required to reduce the opacity of these algorithms, facilitating both clinical utilization and the generation of novel clinical information.
Footnotes
Funding The authors received no financial support for the research, authorship, and/or publication of this article.
Declaration of Conflicting Interests E.O.K. reports the following: consulting fees from Seaspine and Spineart. A.H.D. reports the following disclosures: consulting fees from Stryker, Orthofix, Spineart, and EOS; research support from Southern Spine; and fellowship support from Orthofix. The remaining authors have nothing to disclose.
- This manuscript is generously published free of charge by ISASS, the International Society for the Advancement of Spine Surgery. Copyright © 2023 ISASS. To see more or order reprints or permissions, see http://ijssurgery.com.
References
In this issue
Jump to section
Related Articles
Cited By...
- No citing articles found.