Skip to content
RobothecaBeta
Log in

VisionProTeleop

  • Software
  • Humanoids and robot learning
  • Tool

A toolkit for using Apple Vision Pro in robotics research, covering hand/head tracking streams, video/audio/simulation streaming back to the headset, and egocentric dataset recording.

Made by Improbable-AI @MIT.

Source on GitHub: github.com/Improbable-AI/VisionProTeleop (opens in a new tab). Facts read at commit 4c54990 (opens in a new tab).

Licenses

Code
MIT (opens in a new tab)

Read by Robotheca from LICENSE (opens in a new tab) (MIT) at commit 4c54990 (opens in a new tab), on 16 Oct 2026.

Commercial use
Yes

What it does

  • Streams hand and head tracking from Vision Pro to a Python client via the avp_stream library.
  • Sends video, audio, or MuJoCo and Isaac Lab simulation poses back to Vision Pro for AR rendering.
  • Supports real-world teleoperation with a robot camera feed alongside tracking data.
  • Records egocentric video with synchronized hand tracking using a UVC camera mounted on the headset.
  • Offers an External Network mode that connects Vision Pro and the Python client over the internet via a room code.
  • Includes a companion iOS app for managing recordings, calibrating cameras, and sharing datasets publicly.

Written by Robotheca from the project's README (opens in a new tab) at commit 4c54990.

Getting started

Difficulty
Intermediate

Maintenance

Status
Maintained: a commit in the last 12 months
Newest commit
28 Dec 2025 on main
Latest release
VisionProTeleop v2.50 : External Network Connection, Isaac Lab Support, etc. (22 Dec 2025)

Checked on GitHub on 16 Oct 2026.

Links

Robots that can run it

  • Photo on GitHub
    Other

    RAPID Hand

    A low-cost, modular dexterous robotic hand platform with hardware design and vision-guided teleoperation software for manipulation research.

    Level
    Advanced
    Buildability
    70/100
    Buildable with some effort
    Cost
    Not stated

    Found by Robotheca in RapidTeleop/requirements.txt (opens in a new tab)

Robotheca lists software as a reference: nothing is hosted or run here, and every fact links to where it was read.