OWA Dataset Visualizer¶

Browser-based visualization tool for exploring OWAMcap datasets with synchronized playback of screen recordings and interaction events.

🌐 Public Hosted Viewer¶

Quick Start: https://huggingface.co/spaces/open-world-agents/visualize_dataset

Features¶

Drag & Drop: Load local .mcap + .mkv files directly in browser
HuggingFace Integration: Browse and load datasets via ?repo_id=org/dataset
Synchronized Playback: Video synced with keyboard/mouse overlays
Large File Support: Uses MCAP index for seeking, never loads entire file
Input Overlay: Keyboard (all keys), mouse (L/R/M buttons, scroll), cursor minimap

Usage¶

Visit the viewer URL
Either drag & drop local files, or enter a HuggingFace dataset ID
Explore your data with synchronized video and input overlays

🏠 Local Development¶

Prerequisites¶

Install Node.js via nvm (recommended):

curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.40.3/install.sh | bash
nvm install --lts

Run¶

cd projects/owa-dataset-visualizer
npm install
npm run dev

Open http://localhost:5173

📂 Local File Server¶

For browsing multiple recordings from a local directory:

# Serve a directory containing mcap/mkv pairs
python scripts/serve_local.py /path/to/recordings -p 8080

# Open visualizer with local server
# http://localhost:5173/?base_url=http://localhost:8080

Features¶

Auto-scans for mcap/video pairs
HTTP Range support for streaming large videos
Multi-threaded for concurrent requests

URL Modes¶

URL	Description
`/`	Landing page with featured datasets
`?repo_id=org/dataset`	Load HuggingFace dataset
`?base_url=http://localhost:8080`	Load from local file server
`?mcap=url&mkv=url`	Direct file URLs