Focused, task-oriented skills for building AI + XR apps with the XR Blocks SDK
(import * as xb from 'xrblocks'). Each subfolder is one skill with a SKILL.md whose YAML
description tells an agent what it does and when to use it. Start with xb-core, then
pull in feature skills as needed.
For repo/build/architecture rules see ../AGENTS.md; for the agent rules of
engagement see ../CONTEXT.md; for the full SDK overview see
../src/SKILL.md.
xb-<area> for a capability, xb-<area>-<action> for a narrower task (mirrors the
gws-<service>[-<action>] scheme in googleworkspace/cli).
The xb- prefix matches the xb import alias.
| Skill | Use when you need to… |
|---|---|
xb-core |
Bootstrap an app: Script, Options, the frame loop, run it |
xb-ui |
Build a HUD/menu with the core SpatialPanel grid |
xb-uiblocks |
Build rich flexbox UI (gradients, shadows) via the uiblocks addon |
xb-modelviewer |
Load & display GLTF / splat / primitive 3D models |
xb-hands |
Use hand tracking (joints, pinch, touch, grab) |
xb-agenthands |
Give an AI agent gesturing hands + an orb that point at real objects |
xb-gestures |
Detect pinch/fist/point/spread/thumbs-up/open-palm |
xb-head-gestures |
Detect completed head nod and shake motions |
xb-depth |
Add depth sensing, occlusion, and depth-mesh colliders |
xb-world |
Detect real-world planes, meshes, and objects |
xb-context |
Read agent-facing scene context, visible objects, and SOM labels |
xb-ai |
Query Gemini/OpenAI, run a live session, generate images |
xb-physics |
Add Rapier rigid-body physics |
xb-simulator |
Develop/test in the desktop simulator |
xb-netblocks |
Add multiplayer presence, shared objects, voice |
xb-lipsync |
Drive audio-driven avatar mouths from any MediaStream |
xb-sound |
Play spatial audio, record, recognize/synthesize speech |
xb-testing |
Write sequential functional, integration, or simulator tests |
Deep references some skills link to live next to the code:
../src/SKILL.md, ../src/addons/uiblocks/SKILL.md,
../src/addons/netblocks/SKILL.md, ../src/addons/lipsync/SKILL.md.