XR Projects
October 2023
The "Planet-Z MR Gamezone" MVP built in 2 weeks is a mixed reality hub where friends converge virtually within their real-world spaces to socialize, play, and share experiences. It's about blending the comfort of your room with mixed reality passthrough and socializing, fostering a greater sense of presence and togetherness regardless of physical distance.
Multiplayer Avatars with hand, body, voice and lip sync tracking visible in mixed reality
Shared Content music, games, and real-time interactive shared experiences
Mixed Reality Passthrough, VFX, SFX and 3D Interactive content visible within physical space
Mixed Reality Game & Interactions
Designed 3D capsule system to store "Pong Game" with networked physics and complete game mechanics.
Multiplayer Sync'd Interactive Content
Avatars, VFX, SFX and interactive content sync'd across the network using Meta's Avatar API, Photon Fusion SDK
Technical Details
Project Development and Challenges
In this project the major challenge came from understanding how to sync interactions across the network using Fusion. While there were some templates to use, keeping track of the more customized networked elements such as game mechanics, interactions and dealing with authority proved to be challenging.
Additionally, compared to testing single player projects, multiplayer testing requires at least twice as much time to test and ensure all interactions and content are working properly and sync'd across all devices.
Known Issues
Multi-Spawn Glitch: If game is triggered with multiple players in the scene, the game prefab spawns as many times as players
Everyone can see the same capsule; however, only host has authority to trigger
Ball Authority has issues
When scoring, ball continues to bounce instead of Despawn & Respawn to the scoring team
Particle Music Player Pointable Canvas only visible to host player
Music Player Canvas has black graphic covering the Tracklist scroll selection
Capsule Game VFX Sequence: Reverse Black Hole Shader Effect and spin animation aren't consistently visible in multiplayer
Credits
Fusion VR Avatar Template - Chiligames (Lucas Martinic)
SFX: Splice Samples
Music: Zahid Planet
3D Modeling: Zahid Pasha
Cover Image: Dall-E