Magic Leap 1 Object Recognition
Company: Magic Leap
Provided: interaction design,
Date: 2016 - 2020
At Magic Leap, in addition to input, I worked on design of important features for Lumin OS, including Capture, Settings, LED / haptic patterns and Object Recognition. Privacy by design is an area of interest to me. I am a strong proponent of transparency and avoiding dark patterns (misleading interactions around user consent). This was an opportunity for me to allow ethics to inform the design practice.
I led the user experience design of World Understanding (Object Recognition), collaborating with other designers on the appropriate privacy settings. To demo this platform feature users must first enable World Understanding in Settings, and then walk around their space. Real world objects, such as posters and couches, are labeled automatically as detected. Moving around the objects at different perspectives increases the confidence of computer vision algorithms. I also designed privilege and permission dialogs to establish user consent for third-party developers to utilize this feature in their apps, and partnered with another designer to determine the object regonition lightwear LED pattern.
Videos of Magic Leap’s Object Recognition Settings and me giving a talk on user data privacy and the metaverse with Feras Ahmed.
To access more content from this project, please contact