RENLABENDOSCOPIC AUTONOMY Chi Kit Ng
← All research projects

Vision-language grounding 2026 · Preprint

EBV-CAN

Vision–Language Grounding for Contact-Aided Endoscope Navigation

Navigate locally. Keep the global goal in sight.

Chi Kit Ng*, Shuchang Liu*, Jinsong Lin*, Yidong Zhang, Xizi Wang, Ho Yin Chim, Hongliang Ren†.

* Equal contribution · † Corresponding author

EBV-CAN robotic platform, bird’s-eye view and language-grounded navigation setup.
The physical platform, camera views and language-linked dataset. Figure 2 of the preprint. Source ↗

01 / The idea

Navigate locally. Keep the global goal in sight.

One initial bird’s-eye image provides a fixed spatial reference. Endoscopic observations and motor state update three grounded queries—tip, waypoint and target—to guide bending and insertion through environmental contact.

517demonstrations in VLCA
1,920physical trials · eight policies
76.25%EBV-CAN success · 183/240

Physical success uses automatic blue-area scoring on the planar contact-aided navigation platform. Evaluation details ↗

02 / The approach

How it works

From observations to a physical outcome.

01

Remember the scene

Cache the initial bird’s-eye image as a shared spatial reference.

02

Ground the instruction

Estimate the tip, next waypoint and requested target.

03

Navigate with contact

Translate grounded representations into bending and insertion commands.

Cached global features meet evolving local observations and semantic queries. Figure 4 of the preprint.
Cached global features meet evolving local observations and semantic queries. Figure 4 of the preprint. Source ↗

03 / Physical evidence

Inside the experiments

Full results in the paper ↗
Selected successful multi-guide and target-conditioned executions. Figure 9 of the preprint.
Selected successful multi-guide and target-conditioned executions. Figure 9 of the preprint. Source ↗

04 / Reference

Build on this work

@misc{ng2026ebvcan,
  title = {EBV-CAN: Vision–Language Grounding for Contact-Aided Endoscope Navigation},
  author = {Chi Kit Ng and Shuchang Liu and Jinsong Lin and Yidong Zhang and Xizi Wang and Ho Yin Chim and Hongliang Ren},
  year = {2026},
  eprint = {2610.30786},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2610.30786}
}

Chi Kit Ng · CUHK

Get in touch.

For research, student projects and opportunities.

Open email app ↗