A multi-task two-path deep learning system for predicting the invasiveness of craniopharyngioma

doi:10.1016/j.cmpb.2022.106651

CORC > 自动化研究所 > 中国科学院自动化研究所 > 模式识别国家重点实验室 > 生物识别与安全技术研究中心

	A multi-task two-path deep learning system for predicting the invasiveness of craniopharyngioma
	Zhu, Lin 7,8; Zhang, Lingling 6; Hu, Wenxing 5; Chen, Haixu 1,2; Li, Han 3,8; Wei, Shoushui 7; Chen, Xuzhu 6; Ma, Xibo 4,8
刊名	COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE
	2022-04-01
卷号	216 页码:13
关键词	Craniopharyngioma MRI Imaging Deep learning Invasiveness diagnosis Lesion segmentation
ISSN号	0169-2607
DOI	10.1016/j.cmpb.2022.106651
通讯作者	Wei, Shoushui(sswei@sdu.edu.cn) ; Chen, Xuzhu(radiology888@aliyun.com) ; Ma, Xibo(xibo.ma@ia.ac.cn)
英文摘要	Background and Objective: Craniopharyngioma is a kind of benign brain tumor in histography. However, it might be clinically aggressive and have severe manifestations, such as increased intracranial pressure, hypothalamic-pituitary dysfunction, and visual impairment. It is considered challenging for radiologists to predict the invasiveness of craniopharyngioma through MRI images. Therefore, developing a non-invasive method that can predict the invasiveness and boundary of CP as a reference before surgery is of clinical value for making more appropriate and individualized treatment decisions and reducing the occurrence of inappropriate surgical plan choices. Methods: The MT-Brain system has consisted of two pathways, a sub-path based on 2D CNN for capturing the features from each slice of MRI images, and a 3D sub-network for capturing additional context information between slices. By introducing the two-path architecture, our system can make full use of the fusion of the above 2D and 3D features for classification. Furthermore, position encoding and mask-guided attention also have been introduced to improve the segmentation and diagnosis performance. To verify the performance of the MT-Brain system, we have enrolled 1032 patients with craniopharyngioma (302 invasion and 730 non-invasion patients), segmented the tumors on postcontrast coronal T1WI and randomized them into a training dataset and a testing dataset at a ratio of 8:2. Results: The MT-Brain system achieved a remarkable performance in diagnosing the invasiveness of craniopharyngioma with the AUC of 83.84%, the accuracy of 77.94%, the sensitivity of 70.97%, and the specificity of 80.99%. In the lesion segmentation task, the predicted boundaries of lesions were similar to those labeled by radiologists with the dice of 66.36%. In addition, some explorations also have been made on the interpretability of deep learning models, illustrating the reliability of the model. Conclusions: To the best of our knowledge, this study is the first to develop an integrated deep learning model to predict the invasiveness of craniopharyngioma preoperatively and locate the lesion boundary synchronously on MRI. The excellent performances indicate that the MT-Brain system has great potential in real-world clinical applications. (C) 2022 Published by Elsevier B.V.
资助项目	National Key Research Program of China[2016YFA0100902] ; National Natural Science Foundation Projects of China[82072014] ; National Natural Science Foundation Projects of China[82090051] ; National Natural Science Foundation Projects of China[81871442] ; National Natural Science Foundation Projects of China[817720 05] ; Shandong Province Natural Science Foundation[ZR2020MF028] ; Youth Innovation Promotion Association CAS[Y201930] ; Beijing Municipal Science & Technology Commission[Z191100006619088]
WOS研究方向	Computer Science ; Engineering ; Medical Informatics
语种	英语
出版者	ELSEVIER IRELAND LTD
WOS记录号	WOS:000766134000003
资助机构	National Key Research Program of China ; National Natural Science Foundation Projects of China ; Shandong Province Natural Science Foundation ; Youth Innovation Promotion Association CAS ; Beijing Municipal Science & Technology Commission
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/48017]
专题	自动化研究所_模式识别国家重点实验室_生物识别与安全技术研究中心
通讯作者	Wei, Shoushui; Chen, Xuzhu; Ma, Xibo
作者单位	1.Chinese Peoples Liberat Army Gen Hosp, Natl Clin Res Ctr Geriatr Dis, Med Ctr 2, Beijing 100853, Peoples R China 2.Chinese Peoples Liberat Army Gen Hosp, Inst Geriatr, Med Ctr 2, Beijing 100853, Peoples R China 3.Guangdong Acad Med Sci, Dept Orthoped, Guangdong Prov Peoples Hosp, Guangzhou, Peoples R China 4.Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China 5.Univ New South Wales, Sydney, NSW, Australia 6.Capital Med Univ, Beijing Tiantan Hosp, Dept Radiol, Beijing, Peoples R China 7.Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Shandong, Peoples R China 8.Chinese Acad Sci, Inst Automat, CBSR & NLPR, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Zhu, Lin,Zhang, Lingling,Hu, Wenxing,et al. A multi-task two-path deep learning system for predicting the invasiveness of craniopharyngioma[J]. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE,2022,216:13.
APA	Zhu, Lin.,Zhang, Lingling.,Hu, Wenxing.,Chen, Haixu.,Li, Han.,...&Ma, Xibo.(2022).A multi-task two-path deep learning system for predicting the invasiveness of craniopharyngioma.COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE,216,13.
MLA	Zhu, Lin,et al."A multi-task two-path deep learning system for predicting the invasiveness of craniopharyngioma".COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 216(2022):13.