초음파내시경 기반 인공지능을 이용한 췌장 낭성질환의 진단과 치료

Endoscopic Ultrasound-Based Artificial Intelligence Diagnosis of Pancreatic Cystic Neoplasms

Article information

Korean J Pancreas Biliary Tract. 2023;28(3):53-58
Publication date (electronic) : 2023 July 31
doi : https://doi.org/10.15279/kpba.2023.28.3.53
Department of Internal Medicine, Inha University School of Medicine, Incheon, Korea
박진석orcid_icon, 정석orcid_icon
인하대학교 의과대학 소화기내과학교실
Corresponding author : Jin-Seok Park Department of Internal Medicine, Inha University School of Medicine, 27 Inhang-ro, Jung-gu, Incheon 22332, Korea Tel. +82-32-890-2548 Fax. +82-32-890-2549 E-mail: pjsinha@naver.com
Received 2023 June 26; Revised 2023 July 13; Accepted 2023 July 13.

Abstract

췌장낭성병변은 최근 영상기술의 발전으로 우연히 발견되는 비율이 점차 증가하고 있으며, 유병률은 복부컴퓨터단층촬영을 시행한 사람에서 많게는 13.5%까지 보고되었다. 그러나 췌장낭성질환의 정확한 진단은 양성에서 악성 질환까지 다양한 형태로 보일 수 있어 영상학적 진단만으로는 매우 어렵다. 초음파내시경은 췌장낭성병변을 비교적 정확하게 진단하고 치료를 결정하는 데 매우 중요한 도구로 사용된다. 그러나 내시경 초음파는 악성으로 진행 가능한 점액성 췌장낭종과 다른 췌장낭종질환을 구분하는 데 정확도가 65-75%에 불과하다. 인공지능은 대장암, 폐암, 유방암과 같은 여러 종류의 암 진단의 정확도를 향상시키는 데 효과적인 도구로 사용되고 있으며, 최근 연구에서는 췌장낭성병변에서도 점액성 종양과 비점액성 종양을 구분하고 악성으로 진행 위험도를 평가하는 데 도움이 되는 것으로 보고되고 있다. 인공지능의 적용은 영상분석에도 국한되지 않고 최근에는 췌장낭종의 액체 분석, 유전자 분석, confocal laser endomicroscopy 등 다양한 분야에서 활용되고 있으며 기대되는 연구 결과를 발표하고 있다. 인공지능은 의료 분야에서 아직 시작단계에 있어, 임상에 적용하기 위해 적절한 알고리즘을 개발하는 데에는 개발자들의 큰 노력이 필요하다. 그러나 이러한 기술은 앞으로 췌장낭종 병변을 보다 정확하게 진단하고 효과적이고 효율적으로 관리하는 데에 도움을 줄 수 있는 잠재력을 가지고 있다고 하겠다.

Trans Abstract

Pancreatic cystic neoplasms (PCNs) are precursors of pancreatic cancer, and the rate of their incidental detection has gradually increased recently with a reported prevalence from 2.4 to 13.5%. However, accurate diagnosis can be challenging because PCNs have morphologies ranging from benign to malignant disease, and as for other cancers, precise and timely management of premalignant PCN is essential to prevent malignant transformation. Endoscopic ultrasound (EUS) is a useful tool for the differential diagnosis PCN and treatment decision-making because its imaging features predict malignant transformation. However, its performance is suboptimal, and its accuracy for differentiating mucinous pancreatic cysts and other PCNs is only 65-75%, which has increased interest in the application of artificial intelligence (AI). AI has already provided tools that have improved diagnostic accuracies for many cancers, including colon, lung, and breast cancer, and recent studies have shown AI has the potential to differentiate mucinous and non-mucinous tumors and stratify the malignant potentials of PCNs. This article provides a review of the literature on EUS-based AI studies of PCNs.

INTRODUCTION

Endoscopic ultrasound (EUS) is used for diagnosing pancreatic cystic neoplasms (PCNs) such as intraductal papillary mucinous neoplasms (IPMNs), mucinous cystic neoplasms (MCNs), and serous cystic neoplasms (SCNs) [1]. Because of the improved quality and ubiquitous use of EUS abdominal imaging, the number of incidental PCNs has risen substantially recently, with estimated prevalence ranging from 2.4-13.5% [2]. However, only a few subtypes of these cysts are considered precursor lesions of cancer. In clinical practice, accuracies for discriminating cystic subtypes of PCN using EUS range from 75 to 95%, and final diagnoses can only be made after histopathological analysis [3]. Importantly, PCN resection may dramatically reduce quality of life because it is associated with a 50% risk of complications and a 5% risk of death. Furthermore, it has been demonstrated that ~60% of surgeries are conducted unnecessarily on benign cysts [4]. Given this challenging situation, artificial intelligence (AI) might improve the accuracy of PCN classification. Many studies have been performed on this topic over recent years, and the majority reported the use of AI improved the differential diagnosis of PCL. In this review, the efficacy of EUS-based AI for the diagnosis of PCL is discussed.

ARTIFICIAL INTELLIGENCE

AI enables the analysis of huge numbers of training images and the identification of patterns corresponding to specific clinical features, which can then be used to make diagnoses. Many different algorithms have been devised for this purpose and range in complexity from machine learning (ML) to deep learning (DL) [5].

MACHINE LEARNING

ML is a core discipline of AI and utilizes algorithms that detect patterns within existing data and then uses these patterns to ‘train’ itself to make predictions based on new data. Simple predictive models, such as logistic regression, have been used since the 1960s, but recent decades have witnessed the development of neural network algorithms that predict the risks for various cancers, including breast, lung, and colon cancer. ML uses mathematical algorithms to analyze input values and predict output values without being explicitly programmed to do so. These algorithms are designed to derive different predictive models using a training process during which parameters of an artificial neural network (ANN) model are estimated [6]. The greatest advantage of ML is that it can integrate vast amounts of data and combine observed and predicted quantities in nonlinear and highly interactive ways [7]. ML can be broadly classified based on the type of learning adopted, such as supervised, unsupervised, semi-supervised, or reinforcement learning. Examples of ML include linear discriminants, Bayesian networks, random forest, and support vector machines. Each ML method requires training with input and outcome datasets. In everyday life, ML is used for email spam filtering, online recommendation systems for movies or books, and weather prediction models.

DEEP LEARNING

DL differs from ML in that it can handle much larger datasets and has a neural-inspired architectural design. ANNs are AI algorithms that mimic human neurons. Each ANN has an input layer that receives a signal and an output layer that categorizes input signals. Just as neurons weigh action potentials to determine whether to propagate a signal, hidden layers between the input and output layers of ANNs weigh data characteristics and input from other neurons to determine outputs. DL systems are composed of multiple ANNs and can perform all the above-mentioned ML applications but are more complex, can provide decision-making capabilities, and handle extremely large datasets. DL algorithms have been applied to numerous specialties in the medical field. Its most prominent applications involve detecting abnormalities or diseases based on radiologic and pathologic data [8]. DL can accomplish many tasks, such as identifying the location of a lesion of interest and generating differential diagnoses. Furthermore, convoluted neural networks (CNNs) were recently reported to outperform gastroenterologists at identifying pathologies in endoscopic images [9]. CNNs differ from traditional neural networks because they incorporate many different types of layers, such as convolutional layers and pooling layers [10]. CNNs use convolutional layers to extract features from input signals and identify important features. Pooling layers minimizes network size and maintain computer systems at computational thresholds. CNNs are much better at classifying large images than traditional neural networks.

EUS-BASED ARTIFICIAL INTELLIGENCE AND THE MANAGEMENT OF CYSTIC PANCREATIC LESIONS

Increased EUS availability has enabled pancreatic cyst surveillance. EUS provides more granularity and pancreatic images with better spatial resolutions than other imaging modalities, including computed tomography and magnetic resonance imaging, because of transducer proximity to pancreas [11]. However, the learning curve of EUS is protracted, and thus to acquire competence in all aspects of EUS, it is suggested that clinicians perform 150 supervised cases. Thus, insufficient operator experience can result in misdiagnoses, and even experienced operators can be affected by fatigue due to the durations of some EUS procedures. In practice, the detection of small lesions by EUS is challenging, which makes tumor staging and differential diagnoses difficult because the sonographic appearances of many benign and malignant cystic lesions are similar. Moreover, the increased diagnostic accuracy of EUS-fine needle aspiration (FNA) cystic fluid analysis for differential diagnosis or prognosis prediction is also a concern. Given the amount of information provided by EUS procedures not perceived by the eye and beyond human interpretation, clinicians are developing specific ML and DL algorithms to aid the diagnosis and risk stratification of PCL. Unfortunately, most studies on the use of AI in PCN have used computer tomographic or MRI data, and few have investigated the use of EUS-based AI systems.

1. The application of artificial intelligence to pancreatic cyst differentiation

The first EUS-based AI evaluation of pancreatic lesions was performed in 2001. In this study, the program differentiated focal pancreatitis and malignant in 35 patients with a specificity, sensitivity, and accuracy of 50, 100, and 80%, respectively, versus histopathologic results, which compared with an accuracy of 89% achieved by two endosonographers [12]. This study represented a monumental step in the use of AI, though, at the time, AI-based interpretations were no better than human interpretations. In the early days, ML techniques were mainly used in the AI algorithms used to analyze EUS images. However, thanks to advancements in AI, DL concepts such as CNN are now being applied to assist the differential diagnosis of PCL using EUS images. Nguon et al. [9] developed DL-based algorithms for the differentiation of the MCN and SCN, and analyzed the EUS images of 109 patients (60 MCN, 49 SCN); MCN was defined based on histologic results obtained by EUS-FNA or surgery. An accuracy of up to 82.75% was achieved for differentiating MCN and SCN with an area under the receiver operating curve of 0.88 [9]. Vilas-Boas et al. [13] developed a DL-based diagnostic system for differentiating mucinous and non-mucinous cysts using histologic or cystic fluid study results as the gold standard. Mucinous cysts were defined to have calcinoembryonic antigen fluid levels of >192 ng/mL, glucose levels <50 mg/dL, or mucinous epithelial cells by cytology. EUS images from 28 pancreatic cysts were used to train the model, and overall accuracy, sensitivity, and specificity were 98.5, 98.3, and 98.9%, respectively. However, given their various morphologies and heterogenous echogenicities, PCNs have been difficult to assess using AI until recently.

2. The application of artificial intelligence to pancreatic cystic neoplasms malignant risk stratification

AI helps clinicians stratify PCN malignant risk by identifying deeper characteristics in EUS images. Similarly, EUS-delineated cyst morphology has been utilized to develop AI models that differentiate dysplasia in PCNs. In 2019 a retrospective study was conducted using a DL algorithm to analyze 3790 EUS images of IPMN patients with the aim of evaluating the ability of the algorithm to differentiate malignant potential in patients with a pathological diagnosis that underwent resection. The DL program returned malignant potentials of 95.7, 96.2, and 94% for the sensitivity, specificity, and accuracy, respectively [14]. Schultz et al. [15] developed CNNs to differentiate IPMNs with low- or high-grade dysplasia. EUS images were collected from 43 patients with IPMN, as determined by histopathology of surgical specimens. CNN models were used to analyze EUS images, and the algorithm competently classified advanced neoplasia with a surprising accuracy of 99.6%, which was considerably higher than international guidelines (American Gastroenterology Association, American College of Gastroenterology, and Fukuoka guidelines); international guidelines had accuracies ranging from 51.8 to 70.3% for this cohort [15]. The results of AI studies on the differentiation of pancreas cyst and risk stratification are summarized in Table 1.

EUS-based AI models used for pancreatic cystic neoplasm evaluation

3. EUS-guided needle-based confocal laser endomicroscopy artificial intelligence applications

Confocal laser endomicroscopy (CLE) is a new technique that couples cystic epithelial tissue illumination with real-time, high-resolution microscopic imaging and allows endoscopists to obtain real-time optical biopsies of PCNs in multiple locations. Major trials have established reference standards and safety profiles for the EUS-guided needle-based CLE (EUS-nCLE) of PCNs. This technique provides significant benefits for the differentiation of IPMNs and other PCNs. In addition, certain characteristics of EUS-nCLE enable the prediction of advanced neoplasia, such as high-grade dysplasia or carcinoma, in IPMNs. However, EUS-nCLE video files are often difficult to interpret because they are typically large with multiple frames, which results in interobserver variations. AI provides the ability to interpret such large amounts of data and detect advanced neoplasia. Furthermore, AI algorithms have been used to stratify EUS-nCLE images. For example, Machicado et al. [16] developed a CNN algorithm to risk-stratify IPMNs. EUS-nCLE video frames from 35 patients with histologically proven IPMNs were used to design a CNN model that measured papillary epithelial thickness and extracted nCLE features for risk stratification. The algorithm had higher accuracy (85.7%), sensitivity (83.3%), and specificity (88.2%) than those required by international guidelines.

4. The applications of artificial intelligence for cystic fluid analysis

AI algorithms have been used indirectly to identify biomarkers in cystic fluid associated with high-grade dysplasia in IPMN. Current clinical guidelines cannot accurately identify patients with IPMN of the pancreas at high risk of pancreatic cancer; thus, a bio-signature that can accurately predict IPMN with high malignant potential is required. Maker et al. [17] used Lasso-penelized logistic regression to analyze the cystic fluid levels of various mRNAs and miRNAs and of KRAS and GNAS in 59 IPMN patients to identify an optimal bio-signature for high-grade dysplasia in IPMN. They found that IL1β, MUC4, and prostaglandin E synthase 2 mRNA levels most accurately differentiated high- and low-risk IPMN with an area under the curve of up to 0.86 (p=0.02). However, few studies have addressed the diagnostic or risk stratification potentials of AI-based genomic studies.

5. Application of artificial intelligence to pancreatic cystic neoplasms treatment decision-making

PCNs are common and often pose a management dilemma because some cysts are precancerous, whereas others have little risk of developing into invasive cancers. Thus, the accurate differentiation of low-risk PCNs and high-risk PCLs is essential to prevent unnecessary pancreatic surgery and for the appropriate management of high-risk patients. AI has demonstrated its ability to assist clinician decision-making by integrating clinical characteristics, imaging features, and genomic analysis results. Springer et al. [18] applied ML to develop the CompCyst algorithm to differentiate patients requiring surgery, routine monitoring, or not requiring further surveillance. CompCyst was trained using the clinical features, imaging characteristics, and the cystic fluid genetic and biochemical markers of 436 patients with pancreatic cyst and then tested it in an independent cohort of 426 patients using histopathology as the gold standard. Clinical management informed by CompCyst was more accurate than management determined using conventional clinical and imaging criteria. In particular, in a subset of patients without advanced neoplasia (n=140), CompCyst recommended surveillance in 68%, whereas standard of care recommended surveillance in 34% (p=0.02). Thus, compliance with CompCyst results would have spared more than half of the patients (60%) that underwent cyst resection. However, standard management and CompCyst similarly identified lesions requiring surgery with high accuracy (89 and 91%, respectively).

CONCLUSIONS

The use of AI is in its infancy in the medical field, and much effort will be required from clinicians to develop algorithms suitable for clinical practice. New modalities based on the use of AI tools will undoubtedly allow patient risk stratification for malignancy, improve the management of PCNs, and enable clinicians to diagnose pancreas cysts more accurately.

Notes

Conflicts of Interest

The authors have no conflicts to disclose.

References

1. Huelsen A, Cooper C, Saad N, Gupta S. Endoscopic ultrasoundguided, through-the-needle forceps biopsy in the assessment of an incidental large pancreatic cystic lesion with prior inconclusive fineneedle aspiration. Endoscopy 2017;49(S 01):E109–E110.
2. Martínez B, Martínez JF, Aparicio JR. Prevalence of incidental pancreatic cyst on upper endoscopic ultrasound. Ann Gastroenterol 2018;31:90–95.
3. Perri G, Marchegiani G, Frigerio I, et al. Management of pancreatic cystic lesions. Dig Surg 2020;37:1–9.
4. Litchinko A, Kobayashi K, Halkic N. A retrospective study of histological outcome for IPMN after surgery in Lausanne, Switzerland: A case series. Ann Med Surg (Lond) 2020;60:110–114.
5. Le Berre C, Sandborn WJ, Aridhi S, et al. Application of artificial intelligence to gastroenterology and hepatology. Gastroenterology 2020;158:76–94.e2.
6. Fu GS, Levin-Schwartz Y, Lin QH, Zhang D. Machine learning for medical imaging. J Healthc Eng 2019;2019:9874591.
7. Obermeyer Z, Emanuel EJ. Predicting the Future - big data, machine learning, and clinical medicine. N Engl J Med 2016;375:1216–1219.
8. Chang HY, Jung CK, Woo JI, et al. Artificial intelligence in pathology. J Pathol Transl Med 2019;53:1–12.
9. Nguon LS, Seo K, Lim JH, et al. Deep learning-based differentiation between mucinous cystic neoplasm and serous cystic neoplasm in the pancreas using endoscopic ultrasonography. Diagnostics (Basel) 2021;11:1052.
10. Rawat W, Wang Z. Deep convolutional neural networks for image classification: a comprehensive review. Neural Comput 2017;29:2352–2449.
11. Yamaguchi KW, Okusaka T, Shimizu K, et al, ; Committee for Revision of Clinical Guidelines for Pancreatic Cancer of the Japan Pancreas Society. Clinical practice guidelines for pancreatic cancer 2016 from the Japan Pancreas Society: a synopsis. Pancreas 2017;46:595–604.
12. Norton ID, Zheng Y, Wiersema MS, Greenleaf J, Clain JE, Dimagno EP. Neural network analysis of EUS images to differentiate between pancreatic malignancy and pancreatitis. Gastrointest Endosc 2001;54:625–629.
13. Vilas-Boas F, Ribeiro T, Afonso J, et al. Deep learning for automatic differentiation of mucinous versus non-mucinous pancreatic cystic lesions: a pilot study. Diagnostics (Basel) 2022;12:2041.
14. Kuwahara T, Hara K, Mizuno N, et al. Usefulness of deep learning analysis for the diagnosis of malignancy in intraductal papillary mucinous neoplasms of the pancreas. Clin Transl Gastroenterol 2019;10:1–8.
15. Schulz D, Heilmaier M, Phillip V, et al. Accurate prediction of histological grading of intraductal papillary mucinous neoplasia using deep learning. Endoscopy 2023;55:415–422.
16. Machicado JD, Chao WL, Carlyn DE, et al. High performance in risk stratification of intraductal papillary mucinous neoplasms by Confocal laser endomicroscopy image analysis with convolutional neural networks (with video). Gastrointest Endosc 2021;94:78–87.e2.
17. Maker AV, Hu V, Kadkol SS, et al. Cyst fluid biosignature to predict intraductal papillary mucinous neoplasms of the pancreas with high malignant potential. J Am Coll Surg 2019;228:721–729.
18. Springer S, Masica DL, Dal Molin M, et al. A multimodality test to guide the management of patients with a pancreatic cyst. Sci Transl Med 2019;11:eaav4772.

Article information Continued

Table 1.

EUS-based AI models used for pancreatic cystic neoplasm evaluation

Study Sample size Model Task Accuracy
Nguon et al. [9] 109 CNN Differentiate MCN and SCN 83%
Schults et al. [15] 43 CNN Differentiate low and high grade IPMN 96.6%
Kuwahara et al. [14] 50 Deep learning Determine the malignant potential of IPMN 94%
Machicado et al. [16] 35 CNN Differentiate low and high grade IPMN 82%
Vilas-Boas et al. [13] 28 Deep learning Differentiate mucinous and non-mucinous cysts 98.5%

AI, artificial intelligence; CNN, convoluted neural network; EUS, endoscopic ultrasound; IPMN, intraductal papillary mucinous neoplasm; MCN, mucinous cystic neoplasm; SCN, serous cystic neoplasm.