Endoseek and Fora Soft logos

Endoscopy video software for doctors and patients

Published: Nov 14, 2026
Endoseek Edits video editor with a clip timeline on a laptop
Endoseek Records live endoscope feed next to the AI markup view on a laptop
Endoseek study screen with a gallery of endoscopy photos and videos on a laptop
Fora Soft developed Endoseek's software end to end: three desktop apps that cover an endoscopy study from patient check-in to the file the patient takes home. Development continues.
Endoseek is endoscopy video software: doctors record a study from the endoscope, edit the footage and export it, and the recording can include the markup that a third-party AI service draws on the image for tumor detection. According to Endoseek, doctors had no simple way to record video off the endoscope itself, and patients needed a DICOM viewer (software for the medical imaging format) to play their own footage.
Endoseek Records study screen with Photo, Video, Timer and Comment buttons

What we did

We designed and built three apps, each for its own step of a study:

For the foot pedals, we also built a USB adapter and its firmware.

The workstation stands next to the patient during a procedure. It records the feed at full resolution, shows it live, takes photos and understands spoken commands, all offline on one Linux PC.

Endoseek QR, Endoseek Records and Endoseek Edits: the three apps of an endoscopy study
Blackmagic DeckLink card opened once and one FFmpeg process that encodes the feed

One Connection, One FFmpeg Process

The capture card accepts one connection, but the workstation needs recording, a preview and photos at the same time. Records opens the Blackmagic DeckLink card once, and one FFmpeg process splits the feed into four outputs.

Endoseek Records study with a grid of endoscopy photos taken during recording

Recording, Photos, and Preview at Once

Recording copies an H.264 stream at source resolution into an MP4 file without encoding it again. A still frame refreshes twice a second, so a photo works during recording, and a 720p preview at about 3 Mbit/s keeps the delay under 1.5 seconds.

AI markup controls: AI, Detection, Sensitivity, Size and Conference buttons

Recording the AI Markup Without Changing the Vendor's Software

The endoscope signal goes to a third-party AI application first, which draws contours, boxes and size labels but has no documented way to output its video. Its picture returns through an SDI loop into the same capture card, so the recording shows the markup as the doctor saw it.

The doctor switches the markup on and off from the Records screen or by voice. If the AI application does not respond, the buttons show that control is unavailable.

Offline Voice Control and Dictation

The doctor's hands hold the endoscope, so the study is controlled by voice. Speech recognition runs on the workstation's processor without an internet connection, and we fine-tuned the model for endoscopy vocabulary. After a wake word, the doctor takes a photo, starts or stops video or a comment, switches the AI markup or ends the study.

Dictated comments go into the report with timestamps. Punctuation is added only if no word changes, so the record keeps the doctor's exact words.

Endoseek Records with two endoscope views and voice comment settings on a laptop

A Video Feed That Recovers on Its Own

If the signal drops, Records restores the feed by itself. A watchdog restarts the feed after 10 seconds without a frame, but never during a recording, so the recording file stays intact. An optional detector warns the doctor when the converter sends color bars or a black screen instead of a signal.

Two pedals connected through 3.5 mm jacks to an ESP32-S3 adapter and over USB to Endoseek Records

Foot Pedals on a Custom USB Adapter

Two foot pedals take photos and start or stop video. Reading them through the PC's audio input caused false triggers when a microphone or headphones were connected, so we moved them to a USB adapter that runs our firmware on an ESP32-S3 board.

The pedals work independently, so the doctor can take a photo during a recording. We wrote assembly instructions, so Endoseek can build more adapters.

Studies That Survive Failing Drives and Networks

A study is a folder with videos, photos and a report, and Records keeps copies of it, so the work goes on when a drive or a server disappears.

  • The open study is copied every minute to a USB drive and to a network folder over SMB (Windows file sharing).
  • An offline server cannot freeze the app, because Records checks it every 30 seconds and limits how long system commands run.
  • Records reads the disk's SMART data (its built-in health readings) and warns when the disk is at risk.
Endoseek Records archive with search filters and a list of recorded procedures
Endoseek QR on a clinic PC, a printed QR code and a USB scanner filling in the new-study form in Endoseek Records

Patient Check-In by QR Code

Clinic staff enter patient details on a separate PC and print a QR code, and the workstation reads it to fill in the new-study form. There is no network between the two computers.

The QR app blocks every network request and keeps patient details only in memory. Fields are encoded so that a USB scanner reads them correctly whatever the keyboard layout. The app has more than 90 automated tests, and one of them decodes the real QR image with an independent reader.

A Video and Photo Editor for Doctors

In Edits, a doctor turns a raw recording into a short video for a patient or a colleague.

It opens video, images, DICOM files and ZIP archives:

MP4
MOV
MKV
WebM
JPEG
PNG
DICOM
ZIP
  • The doctor reorders, trims, splits, rotates and crops clips, sets speed up to 8× and blurs up to five areas to hide confidential data
  • Voice comments are recorded over the timeline
Endoseek Edits toolbar and timeline with a video clip and two voice comment tracks
Endoseek Edits export panel next to two endoscopy clips on a laptop

MP4 Export and DICOM Conversion

Edits applies all edits in one export and produces an MP4 or MOV file that a patient plays at home without a DICOM viewer.

The export fits the clips to one of three sizes at 30 fps and mixes in the voice comments:

720p
1080p
4K

Before each export, Edits test-encodes a small frame with each hardware encoder and uses the first that works, otherwise x264:

NVIDIA
AMD
Intel
Apple
x264 (software)

Edits converts DICOM files for patients:

DICOM series → MP4 video
Single frame → PNG image

Technical Implementation

🖥 Platforms
Linux (Ubuntu) for Endoseek Records and Endoseek QR, with a portable Windows build of QR; Windows 10/11, macOS, and Linux for Endoseek Edits
🧩 Desktop
Electron, React, TypeScript, Effector, Vite
🎥 Video
FFmpeg, Blackmagic DeckLink SDK, H.264, MPEG-TS over UDP, WebSocket, mpegts.js (Media Source Extensions)
🎙️ Speech
sherpa-onnx, ONNX Runtime, a speech recognition model fine-tuned for endoscopy vocabulary
🩻 Medical imaging
dicom-parser
🔌 Hardware
ESP32-S3 (Arduino) firmware for the pedal adapter, C++ (Node-API)
🧪 Build and tests
electron-builder (AppImage, DMG, NSIS), GitLab CI, Vitest

Delivery and Outcome

Records starts with the computer and runs full screen on the endoscopy workstation. Endoseek distributes Edits free of charge for Windows, macOS and Linux, and DICOM export opens with an activation key that clinics request from Endoseek.

The project combined desktop app development with video capture from medical equipment, offline speech recognition, DICOM processing and custom USB hardware. We build the same kind of software for other medical video and imaging products.

Endoseek logo with Records, Edits and QR apps