The short answer
Mixed reality (MR) on Meta Quest 3 and Quest 3S shows the real world through the headset's colour cameras and places interactive virtual content in it. Developers can now read the shape of the room, anchor content to real surfaces, share that space between players in the same room and, with the user's permission, access the camera feed to recognise objects. That makes MR the most practical form of XR for many business uses, because people stay aware of their surroundings and can use it for longer.
What the platform gives you
Scene understanding
Meta's Mixed Reality Utility Kit (MRUK) provides a model of the user's room: walls, floor, ceiling, furniture and a mesh of surfaces. Your app can place a virtual pet on the real sofa, bounce a ball off the real wall or hide a target behind the real table. MRUK also handles raycasts against real geometry, so placement feels physical.
Anchors and shared spaces
Spatial anchors keep content fixed to the same real-world spot between sessions. Shared anchors let several headsets in one room agree on where things are, which makes colocated multiplayer and group training possible.
Camera access
The Passthrough Camera API gives apps access to the headset's forward cameras on Quest 3 and 3S, after the user grants a camera permission. In Unity it is used through MRUK's PassthroughCameraAccess component. Meta's samples pair it with Unity's on-device inference engine to detect objects and find their position in the room, for example recognising a piece of equipment and showing instructions on it.
Know the limits
- Camera speed. When the API launched, Meta quoted up to 1280×960 per camera at 30 frames per second with about 40–60 milliseconds of latency. Fine for recognising objects and reading signs, not for tracking a fast-moving ball.
- Privacy. Camera access requires explicit permission and a clear explanation. Design the app to work, in a reduced way, if the user says no.
- Lighting and clutter. Scene understanding and recognition work best in reasonably lit, tidy rooms. Test in real homes and workplaces, not just the office.
- Battery and heat. Running passthrough, scene mesh and on-device AI together is demanding. Budget performance from day one.
Where mixed reality wins
| Use case | Why MR beats full VR here |
|---|---|
| Games in your living room | Real furniture becomes the level; players stay safe and social |
| Training on real equipment | Step-by-step guidance overlaid on the actual machine |
| Retail and product visualisation | See a product at true scale in your own space; see our AR furniture work for the same idea on phones |
| Fitness and wellbeing | Longer sessions with less discomfort because the room stays visible |
| Education | Shared 3D models in a real classroom with the teacher still visible |
Design rules for MR
- Respect the room. Never place content inside furniture or block exits. Use the room model to find clear space.
- Make onboarding part of the experience. Room setup and permissions are the moment users drop off. Explain why and keep it short.
- Blend, do not cover. Match lighting and shadows to the room so virtual objects look grounded.
- Plan for every room size. Content must adapt from a small bedroom to an open office.
Business context in 2026
Meta ended its Quest for Business offering, which changed how companies buy and manage headsets; our article on what that means for enterprise VR covers the alternatives. Google's Android XR platform also supports mixed reality, so building on OpenXR where possible keeps a second platform open.
What an MR project costs
A focused single-scene MR experience starts at $999 and a full application at $2,999 under our current VR and AR packages. Projects with object recognition, colocated multiplayer, custom 3D content or enterprise device management are quoted individually; typical market ranges are in the VR development cost guide.
Sources: Meta: Passthrough Camera API overview · Meta: on-device ML with camera access · UploadVR on the Passthrough Camera API. Checked October 12, 2026.
Related: VR game development · VR and AR packages · AR development
Originally published on A Plus Games Studio, a game, AR and VR development studio in Sacramento, CA.
Top comments (0)