AR Mannequin
Software Engineer
About: An AR experience for Emergency Department Staffs who need to learn CPR, the AR Mannequin is a AR CPR mannequin simulator that provides augmented CPR learning using Hololens and real-time facilitator control via a network connection. Unlike VR CPR training, AR Mannequin uses real objects like a CPR mannequin and medical devices.
Type: Hybrid Microsoft Hololens and tablet AR experience made with Unity C#
Time-frame: September 2019 – December 2019
Role: Software Engineer
- Integrate Photon Engine PUN 2 for communication between Microsoft Hololens and external tablet device
- Program UI for tablet device view
- Design and implement custom, scalable command buffer system using Photon raised events
Role: Software Engineer
- Overcoming incompatibilities between Hololens and PUN
- Sending events via PUN to objects instantiated for Hololens environment
- Tracking status of facilitator upon disconnection and reconnection
Learned:
- PUN 2 for multi-device communication
- Gained familiarity with Hololens Toolkit
- How to set up a Unity scene for Hololens Toolkit and Vuforia