中国科学院重庆绿色智能技术研究院机构知识库

QQ客服 官方微博 反馈留言

	Semi-supervised spatio-temporal CNN for recognition of surgical workflow
	Chen,Yuwen1,2,3; Sun,Qi Long3; Zhong,Kunhua1,2,3
	2018-08-25
摘要	AbstractRobust and automated surgical workflow detection in real time is a core component of the future intelligent operating room. Based on this technology, it can help medical staff to automate and intelligently complete many routine activities during surgery. Recognition of surgical workflow based on traditional pattern recognition methods requires a large number of labeled surgical video data. However, the labeled surgical video data requires expert knowledge and it is difficult and time consuming to collect a sufficient number of labeled surgical video data in the medical field. Therefore, this paper proposes a semi-supervised spatio-temporal convolutional network for the recognition of surgical workflow based on convolutional neural networks and temporal-recursive networks. Firstly, we build a spatial convolutional extraction feature network based on unsupervised generative adversarial learning. Then, we build a bridge between low-level surgical video features and high-level surgical workflow semantics based on an unsupervised temporal-ordered network learning approach. Finally, we use the semi-supervised learning method to integrate the spatial model and the temporal model to fine-tune the network, and realize the intelligent recognition of the surgical workflow at a low cost to efficiently determine the progress of the surgical workflow. We performed some experiments for validating the mode based on m2cai16-workflow dataset. It shows that the proposed model can effectively extract the surgical feature and determine the surgical workflow. The Jaccard score of the model reaches 71.3%, and the accuracy of the model reaches 85.8%.
关键词	Semi-supervised Surgical workflow CNN
DOI	10.1186/s13640-018-0316-4
发表期刊	EURASIP Journal on Image and Video Processing
ISSN	1687-5281
卷号	2018期号:1
WOS记录号	BMC:10.1186/s13640-018-0316-4
语种	英语