Prerequisites

<aside> ⚠️ iPhone face capture requires the APS Sidekick iPhone Face Tracking App from the app store to work.

Untitled

</aside>

<aside> ⚠️ Models require ARKit face tracking blendshapes to work

https://miniface.org/

Untitled

</aside>

Linking iPhone streaming to PC

Once installed, set your ip address, port, link them to Mocap Fusion on your PC.

How to get head tracking

Method #1

One way to capture your face with an iphone, while doing body mocap, is to slide the headset on your forehead to keep head tracking (in Profile tab top left, you can compensate the avatar’s neck rotation like in the gif.), adjusting the “neck pivot” setting on your avatar will allow you to use the headset as a head tracker, instead of needing to use a separate Vive tracker instead.

For people using an iPhone head mount alongside a VR headset

Method #2

Another way is to use a small VR headset attached to an iPhone camera mount. This way, you’re able to see the VR scene while having full face and eye tracking.

How to tether iphone networking over ethernet, to your PC

1. Share the PC's internet

1. Plug everything in. Many Lightning-to-Ethernet adapters need power through their Lightning passthrough port to work, so connect a charger if yours has one.
2. Press Win + R, type ncpa.cpl, and press Enter to open Network Connections.
3. Identify the two adapters:
   • The one that has internet (e.g. "Wi-Fi" or "Ethernet").
   • The one the iPhone is on. It usually shows up as "Ethernet 2" or similar and may say "Unidentified network".
4. Right-click the adapter that has internet and choose Properties, then open the Sharing tab.
5. Tick "Allow other network users to connect through this computer's Internet connection."
6. In the Home networking connection dropdown, pick the adapter the iPhone is on, then click OK.