passthrough-camera-api

Open-source room scanner for Meta Quest 3: real-time textured 3D mesh, texture refinement and Gaussian splats in Unity

3D reconstruction from Meta Quest passthrough and depth via Reality Capture app, with Open3D/TSDF, COLMAP/Nerfstudio export, and Gaussian Splatting prep.

A Unity package that enables real-time computer vision operations on Meta Quest headsets using the Passthrough Camera API (PCA) with WebRTC streaming to external servers for AI inference.

A Unity package to use the new Meta Quest Passthrough Camera API.

The world's first passthrough API for Vision Pro

Demonstrates how to use Unity Inference Engine and YOLO11 to perform image segmentation using the Meta Quest Passthrough Camera

Record Passthrough camera frames from Meta Quest 3 devices and save as video (.mp4) on the device.

This project uses XR interaction and modern segmentation models to generate real-time “stickers” and object descriptions from controller-defined regions on the Meta Quest 3.