Accelerating AI + XR
Innovation

↓

Get to know XR Blocks

Join us in exploring the next generation of computing, where digital and physical information come together. These demos highlight experimental features in Android XR, and we recommend trying them on a supported device.

XR Blocks SDK

Create for the immersive web

XR Blocks is an opensource framework to help you develop immersive experiences for the web, featuring XR Realism (depth-aware physics, geometry-aware occlusion, and lighting estimation), XR Interaction (hand interaction, gesture recognition), and creative AI + XR use cases (Gemini, Gemini Live, LiteRT, TensorFlow Lite).

Explore all Samplesarrow_forward Browse GitHub Repoarrow_forward

AI + XR

Gemini Ice-breakers

Get to know Gemini, your friendly and infinitely knowledgeable assistant on both desktop Chrome and Android XR with XR Blocks. This demo gives you a set of conversation starters to show off what Gemini can do for you.

Explore arrow_forward

XR Realism

Ballpit

See how digital and physical information come together in Android XR. Inspired by DepthLab, this demo creates a 3D map of your space in both simulated reality and XR, and allows you to play virtual ballpit with physical collisions.

Explore arrow_forward

XR Interaction

Gesture Recognition

Command the digital world with your bare hands. This demo features an experiment with XR Blocks and LiteRT, highlighting new ways you can interact with hand interactions. Like a conductor leading an orchestra, a simple "yeah" gesture unleashes a vibrant cascade of colorful stripes. Want to add some cheer? A quick thumbs-up fills the screen with a delightful shower of balloons! It's much more intuitive than it looks.

Explore arrow_forward

View on GitHub

Publications

If you find XR Blocks inspiring or useful in your project, please cite our preliminary white paper entiteld XR Blocks: Accelerating AI + XR Innovation,

Example innovation powered by XR Blocks: Sensible Agent: A Framework for Unobtrusive Interaction with Proactive AR Agent. ACM UIST 2025.

Be the first to get updates from XR Blocks

Frequently Asked Questions

What is XR Blocks?

XR Blocks is web-based, a cross-platform framework designed to accelerate human-centered AI+XR innovation. XR Blocks provides a modular architecture with plug-and-play components for core abstraction in AI+XR, including user representation, environmental perception, gestures, and spatial UI. Crucially, it is designed with the mission of “minimum code from idea to reality”, enabling rapid prototyping of complex AI+XR apps. Built upon accessible technologies (WebXR, three.js, TensorFlow, Gemini), our toolkit lowers the barrier to entry for researchers and designers.

How can I start building with XR Blocks?

We recommend you to fork our GitHub repository, browser each template and sample project, and then start coding while referring to the manual.

What is Android XR?

XR stands for extended reality. It’s an umbrella term that encompasses all technologies that blend the real and virtual worlds including virtual reality, augmented reality, and mixed reality. Android XR is an operating system for extended reality devices that use these technologies, like headsets and glasses. It provides the user interface, the ability to access popular apps, and AI assistance from Gemini to these devices.

How do I get Android XR?

Android XR is an operating system for headsets and glasses. The first devices will be available in 2025.

When will Android XR-powered devices be available?

The first devices with Android XR will be available in 2025.

How can I start developing for Android XR?

You can check out developer.android.com/xr for documentation and information to get started with Android XR. If you are choosing WebXR, XR Blocks here is also a great way to make creative Android XR applications.