• Turn creative prompts into interactive XR experiences with Gemini Facebook Twitter LinkedIn Mail With the release ofCanvasin the Gemini web app, ourAndroid XRteam began to explore how we might use it to make immersive computing accessible to developers and users at large. • We noticed that Gemini is particularly adept at generating interactive 3D web graphics, and asked a simple question: What if you could experience Gemini’s 3D web creations in extended reality? • To test this, our team collaborated to build an immersive biology simulation. • Gemini first modeled the complex interactions between blood cells and rendered them visually using WebGL and Three.js. • It looked like a living textbook illustration, but the shift occurred when we converted that content to XR using WebXR APIs. • A button appeared on the screen: “Enter XR”.

Article Summaries:

  • Google’s Gemini web app now supports turning text prompts into fully interactive XR experiences. The Android XR team used Canvas to generate a biology simulation, modeling blood‑cell interactions with WebGL and Three.js, then converted the result to XR via WebXR APIs. A simple “Enter XR” button lets users explore the scene in immersive reality. Gemini’s new tooling lets developers prototype complex 3D environments in real time-e.g., “create a volcanic environment” or “add a butterfly”-and export the result as a shareable web link. The feature requires a Samsung Galaxy XR headset and Gemini 3 Pro, and Google encourages users to experiment with starter prompts and share their creations.

Sources: