Towards Laparoscopic Visual AI: Development of a Visual Guidance System for Laparoscopic Surgical Palpation
Current Language EN
English English Türkçe Türkçe Español Español Português Português Pусский Pусский Filipino Filipino Tiếng Việt Tiếng Việt हिन्दी हिन्दी العربية العربية বাংলা বাংলা Deutsch Deutsch 中文 中文

Towards Laparoscopic Visual AI: Development of a Visual Guidance System for Laparoscopic Surgical Palpation

Department of Information Systems and Computer Science, Ateneo De Manila University, Quezon City, 1108, PHILIPPINES; G. Caballas, Kerwin; Ateneo Innovation Center, Ateneo De Manila University, Quezon City, 1108, PHILIPPINES; M. Bolingot, Harold Jay; Ateneo Innovation Center, Ateneo De Manila University, Quezon City, 1108, PHILIPPINES; C. Libatique, Nathaniel Joseph; Department of Electronics, Computer, and Communications Engineering, Ateneo De Manila University, Quezon City, 1108, PHILIPPINES; L. Tangonan, Gregory; Ateneo Innovation Center, Ateneo De Manila University, Quezon City, 1108, PHILIPPINES
international journal of integrated engineering 2021 Vol. 13 pp. (5)
4
philippines2021towards

Abstract

Currently, there are numerous obstacles to performing palpation during laparoscopic surgery. The laparoscopic interface does not allow access into a patient’s body anything other than the tools that are inserted through the trocars. Palpation is usually done with the surgeon’s hands to detect lumps and certain anomalies underneath the skin, muscle, or tissues. It can be useful technique for augmenting surgical decision-making during laparoscopic surgery, especially when discerning operations involving cancerous tumors. Previous research demonstrated the use of tactile sensors and mechanical sensors placed at the end-effectors for palpating laparoscopically. In this study, a visual guidance system is proposed for use during laparoscopic palpation, specifically engineered to be part of a motion-based laparoscopic palpation system. In particular, the YOLACT++ model is used to localize a target organ, the gall bladder, on a custom dataset of laparoscopic cholecystectomy. Our experiments showed an AP score of 90.10 for bounding boxes and 87.20 on masks. In terms of the speed performance, the model achieved a playback speed of approximately 20 fps, which translates to approximately 48 ms video latency. The palpation path guides are guidelines that are computer-generated within the identified organ, and they show potential in helping the surgeon implement the palpation more accurately. Overall, this study demonstrates the potential of deep learning-based real-time image processing models to complete our motion-based laparoscopic palpation system, and to realize the promising role of artificial intelligence in surgical decision-making. Visual presentation of our results can be seen on our project page: https://kerwincaballas.github.io/lap-palpation.

Access

DOI:
10.30880/ijie.2021.13.05.004
URL:
https://doi.org/10.30880/ijie.2021.13.05.004

Citation

ID: 283989
Ref Key: philippines2021towards
Use this key to autocite in SciMatic or Thesis Manager

References

References

No Bibliography

Blockchain Verification

Account:
NFT Contract Address:
0x95644003c57E6F55A65596E3D9Eac6813e3566dA
Article ID:
283989
Unique Identifier:
10.30880/ijie.2021.13.05.004
Network:
Scimatic Chain (ID: 481)
Blockchain Readiness Checklist
Authors
Abstract
Journal Name
Year
Title
5/5
Creates 1,000,000 NFT tokens for this article
Token Features:
  • ERC-1155 Standard NFT
  • 1 Million Supply per Article
  • Transferable via MetaMask
  • Permanent Blockchain Record
Blockchain QR Code
Scan with Saymatik Web3.0 Wallet
Gas fees required in SCI Coins
Buy SCI

Saymatik Web3.0 Wallet

Google Play
App Store