What is Mixed Reality?
Mixed reality is a blend of physical and digital worlds, unlocking natural and intuitive 3D human, computer, and environmental interactions. This new reality is based on advancements in computer vision, graphical processing, display technologies, input systems, and cloud computing. Most people witness mixed reality in movies that require a human/living actor to be portrayed in immersive, elaborate backgrounds and in fantastical scenes that are computer-generated and usually are not capable of existing within the real world. https://learn.microsoft.com/en-us/windows/mixed-reality/discover/mixed-reality
How to start creating Mixed Reality
The essentials that you need to get started include:
A PC or gaming laptop
A computer camera
A green screen
With the Mixed Reality Capture Tool, you can capture yourself in the virtual world within minutes of setting up the software!
To set up the Mixed Reality Capture Tool:
From your PC, download the Mixed Reality Capture Tool.
Launch the app and click Get Started.
Review the terms and conditions and click Agree.
Click Meta Quest to begin setup.
If you have an Oculus Rift S, follow the setup instructions in this article.
If this is your first time using mixed reality capture, install the Mixed Reality Capture app on your Meta Quest 2 or Meta Quest.
Launch the Mixed Reality Capture app in your Meta Quest 2 or Meta Quest and click Search for Device. If the IP address is different on your computer than the one shown on your Meta Quest 2 or Meta Quest, you can enter the IP address manually.
Once the device is found click Calibrate Your Camera.
Select your webcam from the Current Camera menu and then click Begin Calibration.
Follow the onscreen instructions to calibrate your controller and then click Save to Headset.
You will need to obtain Open Broadcaster Software to capture the events within your game, and within the real world, to make proper Mixed Reality content.
To use the Mixed Reality Capture Tool with Open Broadcaster Software, or OBS:
Follow the link from the capture tool to install the required OBS version.
Once OBS is installed, click the link in the capture tool to install Meta Mixed Reality Capture OBS Plugin.
Click Generate OBS Scene Collection and launch OBS.
From the top of OBS, click Scene Collection Menu then click Import. Pick the OBS Scene Collection file you saved. Once it's imported, go back to the Scene Collection Menu and select your file from the dropdown.
From the Sources panel, click Video Capture in the device layer to make sure your camera is turned on.
Double click the Meta Mixed Reality Capture layer in the Sources menu. A blue and green split screen will appear. Go to your Meta Quest 2 or Meta Quest and make sure you have a game running that's compatible with Mixed Reality Capture.