Skip to content
#software testing Open access

Surgical Instrument Detection and Tracking in Orthopaedic Surgery Using Computer Vision.

Sep 2026 · Surgical Innovation · pp. 15533506261489510 · 0 citations
Medicine

TL;DR

The proposed computer vision framework represents a cost-effective advancement in surgical digitisation, enabling accurate instrument tracking using standard video data and supporting future optimisation of orthopaedic surgical practice with significant implications for clinical research.

Abstract

The purpose of this study is to establish a methodology to digitalise instrument and object tracking analysis in orthopaedic surgery and generate insights into surgical procedures using spatiotemporal data, without introducing costly equipment into the operating theatre. This approach aims to produce descriptive statistics that demonstrate potential improvements in surgical safety and efficiency, presenting opportunities for further research and application in orthopaedic surgery.MethodsThe proposed method utilises a computer vision-based approach by applying instrument tracking and object detection software on a video of a surgical procedure. The model was trained on 23,398 images representing 14 surgical instruments. The model achieved a mean Average Precision of 95.9% on the validation and 96.2% on the test set. A feasibility test was conducted using a surgical video (275 frames, 11 seconds) to detect and track surgical tools. Movement metrics such as distance and spatial distribution were computed to quantify instrument motion patterns.ResultsAll instruments were successfully detected and tracked. Retractors showed lowest (mean total movement <50 px), while Metzenbaum scissors demonstrated the highest activity (>150 px). Violin plots revealed variation in vertical movement among instruments. The system generated detailed spatiotemporal data suitable for surgical workflow analysis and training support.ConclusionThis method produces statistical outputs that may enhance surgical safety by improving procedural organisation and resource allocation. The proposed computer vision framework represents a cost-effective advancement in surgical digitisation, enabling accurate instrument tracking using standard video data and supporting future optimisation of orthopaedic surgical practice with significant implications for clinical research.

Read PDF

Similar papers

Open access Sep 2026

Laser scanning registration for knee arthroplasty

Aims Accurate registration of anatomy is fundamental to robotic and computer-assisted surgery; however, conventional methods rely on manual data acquisition performed by the surgeon using a tracked probe that is slow and affected by operator variability. Limitations of manual methods have hindered wider adoption of sur...

Thomas Warren, Ulani Hayter Otaola, Brett Robertson et al. · 0 citations
Open access Sep 2026

AI‐Based Automated Instrument Tracking During Endoscopic Skull Base Surgery: A Pilot Feasibility Study

ABSTRACT Background Endoscopic endonasal approaches (EEA) to skull base tumors are a technically challenging procedure for both surgeons and trainees. Artificial intelligence and computer vision (CV) may offer an objective analysis that provides surgical assessment on technique and enhanced educational feedback for sur...

David R. Grimm, Dhiraj Pangal, D. Khan et al. · 0 citations
Open access Oct 2026

Using Motion-Tracking to Objectively Assess Skill in Surgery.

BACKGROUND Surgical assessment often relies on subjective expert observation, which may introduce bias. We aimed to objectively differentiate skill levels in a complex simulated operative procedure using hand-tracking metrics through a wearable mixed reality headset. METHODS A validated paediatric open inguinal herni...

Tanay Bapna, Samuel J. A. Robinson, John Valles et al. · 0 citations
Review Open access Sep 2026

Association Between Video-Derived Digital Operative Metrics and GEARS Scores in Robotic Surgery and Development of an Exploratory Multivariable Model

Background: Robotic-assisted surgery has been increasingly adopted across surgical specialties, but objective and efficient assessment of robotic surgical skills remains challenging. The Global Evaluative Assessment of Robotic Skills (GEARS) is commonly used for expert-based evaluation; however, it requires manual revi...

Xing-Yuan Xiao, Yu Du, Zhen-Yu Liu et al. · 0 citations
Review Aug 2026

Computer Vision Applications in Laparoscopic Cholecystectomy: Are We Ready? A Systematic Review.

This systematic review evaluates current computer vision models and their applications in laparoscopic cholecystectomy. Using PRISMA guidelines, we analyzed studies reporting on primary computer vision model applications in laparoscopic cholecystectomy, from inception to March 2026. A total of 85 studies were included:...

Intekhab Hossain, Abdulrahman Alomar, D. Tham et al. · 1 citation · ⚡1
Review Open access Sep 2026

Toward the intelligent operating room: Artificial intelligence and computer vision applications in surgery.

The operating room is evolving into an information-rich environment where surgical care is increasingly shaped by integrated digital architectures. The proliferation of minimally invasive and robotic platforms has generated a massive influx of high-resolution video, shifting the field toward real-time computational ana...

B. Sengun, Y. Iscan · 0 citations

Related blog posts

MIT News · Artificial Intelligence Oct 2, 2026

Documenting the tech worker movement

Writing as a participant and researcher, PhD student JS Tan SM ’22 has co-authored a new book about the rise of tech worker protests and the employer backlash that followed.

GPT-Lab Sep 23, 2026

Requirements Don’t Live in Isolation: What We’re Exploring with Req-Space

Requirements in large systems rarely exist in isolation. Their meaning depends on the wider project context - other requirements, policies, decisions, tests, and implementation details. That becomes especially important when AI is used for review, because spotting a possible conflict or gap is only the beginning. ReqSpace explores how AI, visualisation, and connected project context can help reviewers understand those findings, trace the relationships behind them, and focus on the questions that…

GPT-Lab Sep 17, 2026

Beyond Prompt Engineering: The Role of Tacit Knowledge in Software Engineering

AI is making software generation faster, but speed does not remove the need for expertise. As more work is delegated to AI, tacit knowledge may become one of the most important human advantages in software engineering. The post Beyond Prompt Engineering: The Role of Tacit Knowledge in Software Engineering appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.