https://timstutts.cargo.site Tim Stutts Emerging Product Design Fri, 06 Oct 2023 00:47:17 +0000 https://timstutts.cargo.site en https://timstutts.cargo.site/Cognixion-One-Brain-Computer-Apps Tue, 31 Jan 2023 01:46:26 +0000 Tim Stutts Emerging Product Design https://timstutts.cargo.site/Cognixion-One-Brain-Computer-Apps Cognixion One Brain-Computer Applications Company: Cognixion Provided: design direction, UI/UX, sound/haptic design Date: 2022 - 2023At Cognixion I directed the design of interactive experiences, including input, sensory feedback, software applications and hardware, for Cognixion One, the world's first accessibility-focused augmented reality headset with a brain computer interface. I managed the efforts of our Design Team of full-time, contract and intern designers, prototypers and researchers, that I assembled from the ground up to join along this journey.<img width="2500" height="1407" width_o="2500" height_o="1407" data-src="https://freight.cargo.site/t/original/i/5bf936a1172696159b3a19f421f7ecd9095899a0185f273ff0a9a6b817d91d6e/Hello-1.png" data-mid="198879855" border="0" src="https://freight.cargo.site/w/1000/i/5bf936a1172696159b3a19f421f7ecd9095899a0185f273ff0a9a6b817d91d6e/Hello-1.png" /> One of the Design Team’s frist efforts was updating the design of the Speakprose AR application for assisted communications that runs on our Cognixion One headset via headpose interactions. The user (often person with motor / vocal disabilities, such cerebral palsy), is able to use head-pose targeting / dwelling on UI to compose messages on a virtual keyboard, and project them to be sonified and projected out a front-facing display for co-located conversation, or as commands for smart home devices (e.g. television). <img width="1750" height="984" width_o="1750" height_o="984" data-src="https://freight.cargo.site/t/original/i/d86df1e8b8ad530a9ec1b8475209376ec100080f44393f6dac59560458fadd24/3.png" data-mid="204181657" border="0" src="https://freight.cargo.site/w/1000/i/d86df1e8b8ad530a9ec1b8475209376ec100080f44393f6dac59560458fadd24/3.png" /><img width="1750" height="1080" width_o="1750" height_o="1080" data-src="https://freight.cargo.site/t/original/i/80d8d8ea36a3cb2d257677352db4023bc1114ba1cb365a0d66ac9087d8baaa7e/Headpose---Doctor.png" data-mid="204181882" border="0" src="https://freight.cargo.site/w/1000/i/80d8d8ea36a3cb2d257677352db4023bc1114ba1cb365a0d66ac9087d8baaa7e/Headpose---Doctor.png" /> <img width="1750" height="984" width_o="1750" height_o="984" data-src="https://freight.cargo.site/t/original/i/3b13e000a649c123049643f06d10f3d532c18cdca6024f98893dab10d5d827c1/ASHA-Phrase-Management.png" data-mid="204181846" border="0" src="https://freight.cargo.site/w/1000/i/3b13e000a649c123049643f06d10f3d532c18cdca6024f98893dab10d5d827c1/ASHA-Phrase-Management.png" /> Pictured above: Cognixion One user Chris Benedict communicating via the device’s front-facing display via Speakprose AR application. Below these is a head-pose controlled keyboard interface our team designed. A later effort effort was working on AR applications that use BCI as input. The user, in this case person with late-stage ALS (amyotrophic lateral sclerosis) focuses their mind on labeled SSVEP (Steady State Visually Evoked Potential) stimuli to provide Yes/No/Rest response or freeform text reponse to communicate with a caretaker.&nbsp; <img width="1920" height="1080" width_o="1920" height_o="1080" data-src="https://freight.cargo.site/t/original/i/58e70b10ba3efc1cf4c991a4053f9c685ac2714aaf81f7f1ded3206e88abcfa4/BCI---YNRest-.png" data-mid="186605595" border="0" src="https://freight.cargo.site/w/1000/i/58e70b10ba3efc1cf4c991a4053f9c685ac2714aaf81f7f1ded3206e88abcfa4/BCI---YNRest-.png" /> <img width="1920" height="1080" width_o="1920" height_o="1080" data-src="https://freight.cargo.site/t/original/i/da326f764180225cd059589ae2f6cf3a292efc1ce4296c6fb6906775e4fce2c9/BCI-Resting.png" data-mid="186605594" border="0" src="https://freight.cargo.site/w/1000/i/da326f764180225cd059589ae2f6cf3a292efc1ce4296c6fb6906775e4fce2c9/BCI-Resting.png" /> Pictured above: In this application the headset wearer communicates with a caretaker by focusing their mind on visual stimuli (SSVEP) labeled yes and no. When selected, a yes or no response is sonified and projected from the display as text. The rest stimuli, accompanied by ambient sound and particle system, is used to take a break. A talk from the Cognixion design team sharing their work under my direction with the XR accessibility community. View more content from this project in my portfolio deck. https://timstutts.cargo.site/Vuforia-HoloLens-2-Apps Thu, 03 Mar 2022 11:28:15 +0000 Tim Stutts Emerging Product Design https://timstutts.cargo.site/Vuforia-HoloLens-2-Apps Vuforia Work Instructions Apps for HoloLens 2 Company: PTC Provided: design direction, project management, UI/UX, sound design, research Date: 2021 - 2022 I led the overall design effort of augmented reality head-mounded display applications for the Vuforia Work Instructions platform. We supported HoloLens and Magic Leap, with the debut of Capture and Vantage applications for hands-free procedure recording and playback on the factory floor. I project managed a small team of talented 2D and 3D designers, while also functioning as an individual contributor in areas of input, interaction, user uxperience and sound design. Download Capture and Vangage on the Microsoft HoloLens Store <img width="5760" height="3840" width_o="5760" height_o="3840" data-src="https://freight.cargo.site/t/original/i/5f6258bce477482c0bc6e8a92afaf33f0af73bca2192e5c01f1f5db856c20339/Capture_Concept_Art_111921_01.jpg" data-mid="135194573" border="0" src="https://freight.cargo.site/w/1000/i/5f6258bce477482c0bc6e8a92afaf33f0af73bca2192e5c01f1f5db856c20339/Capture_Concept_Art_111921_01.jpg" /> <img width="6000" height="4000" width_o="6000" height_o="4000" data-src="https://freight.cargo.site/t/original/i/5c0f40a3375a2f9582ccfff5e3c93ade450cfce022ef10a34eeaf94793f39e2a/Vantage_Concept_Art_111921_02.jpg" data-mid="135194578" border="0" src="https://freight.cargo.site/w/1000/i/5c0f40a3375a2f9582ccfff5e3c93ade450cfce022ef10a34eeaf94793f39e2a/Vantage_Concept_Art_111921_02.jpg" /> Pictured: high fidelity concept images Vuforia Capture and Vantage applications on head-mounted display. Video of me sharing our Vuforia design team’s head-mounted display instructional work with the XR accessibility community, featuring co-presenter Mark Steelman from Transfr. View more content from this project in my portfolio deck. https://timstutts.cargo.site/Faceware-Studio-App Mon, 25 May 2020 14:23:54 +0000 Tim Stutts Emerging Product Design https://timstutts.cargo.site/Faceware-Studio-App Faceware Studio Desktop Application Company: Faceware Technologies Provided: design direction, UI/UX, research Date: 2020 - 2021 At Faceware I directed the design of new features for Studio, real-time animation software that tracks facial movement from live or recorded video onto 3D characters. Enhancements include improved design around the user interface, particularly related to color, for usability. I also worked with product management to establish goals and designs for future software releases. <img width="1920" height="1040" width_o="1920" height_o="1040" data-src="https://freight.cargo.site/t/original/i/ce28b1351a8b5be52ae3bc3a4c18c64eaaff7e71271484fb0d8d16103de6c0be/EiifarEWkAQa9A2.jpg" data-mid="103667680" border="0" src="https://freight.cargo.site/w/1000/i/ce28b1351a8b5be52ae3bc3a4c18c64eaaff7e71271484fb0d8d16103de6c0be/EiifarEWkAQa9A2.jpg" /> Pictured: user interface improvements to the Faceware Studio facial motion capture application.&nbsp; Video features me presenting Faceware’s technology on a panel covering virtual production at Miami SciFi conference. View more content from this project in my portfolio deck. https://timstutts.cargo.site/Magic-Leap-2-Platform Tue, 31 Jan 2023 01:39:05 +0000 Tim Stutts Emerging Product Design https://timstutts.cargo.site/Magic-Leap-2-Platform Magic Leap 2 Platform Company: Magic Leap Provided: design direction, UI/UX, LED design Date: 2019 - 2020 After the release of Magic Leap 1 Enterprise Edition I began work on the design of a number of platform features for an unreleased Magic Leap 2 system. Efforts included partnering with industrial design and electical engineering teams to determine LED count / layout / visibility requirements on the hardware, a design audit I led that landed us on the single LED at the base of the controller and the arc of five LEDs on Lightpack seen in the product today. I also led the design of controller input / interations, working closely with the design team to determine the necessary button configutations and interactions to make Magic Leap 2 platform input a success. <img width="1920" height="1080" width_o="1920" height_o="1080" data-src="https://freight.cargo.site/t/original/i/03890ac5f0fceb847f75b44d08dd78bdcdfca1715a0df6090414e3a8266c388b/magic-leap-2-by-magicleap-cover.jpeg" data-mid="172701136" border="0" src="https://freight.cargo.site/w/1000/i/03890ac5f0fceb847f75b44d08dd78bdcdfca1715a0df6090414e3a8266c388b/magic-leap-2-by-magicleap-cover.jpeg" /> View more content from this project in my portfolio deck. https://timstutts.cargo.site/Magic-Leap-1-Text-Input Wed, 12 Aug 2020 01:46:04 +0000 Tim Stutts Emerging Product Design https://timstutts.cargo.site/Magic-Leap-1-Text-Input Magic Leap 1 Text Input Company: Magic Leap Provided: interaction design, prototyping, research Date: 2016 - 2020 I led the design of text entry for the Magic Leap 1 spatial computing platform. Lumin OS supported text entry via Control Virtual Keyboard, Voice Dictation, Bluetooth Keyboard and Mobile App Keyboard. On different efforts I functioned as interaction designer, prototyper, and researcher. I also led design of haptic patterns for the controller, many of which were several of which were used in the virtual keyboard. This work involved close partnership with teams across the organization, including Product, Software, Hardware, Mechanical, Electrical and Industrial Design.I prototyped several initial Virtual Keyboard concepts in Unity for our Control, partnered with other prototypers to evolve them further, defined interaction design to spec, worked closely with our visual designer, and saw the implementation through with the software team leading up to Magic Leap 1 release and beyond. Along the way there were numerous user tests and tweaks to custom parameters to enhance the usability around the primary means of text entry in our OS. <img width="1626" height="956" width_o="1626" height_o="956" data-src="https://freight.cargo.site/t/original/i/232b3c2e7df68ffc495bd57ba4be58dc56dc6b74346addcebec351b11c2103be/Screen-Shot-2020-05-21-at-10.35.15-AM.png" data-mid="79677046" border="0" src="https://freight.cargo.site/w/1000/i/232b3c2e7df68ffc495bd57ba4be58dc56dc6b74346addcebec351b11c2103be/Screen-Shot-2020-05-21-at-10.35.15-AM.png" /> <img width="1920" height="1080" width_o="1920" height_o="1080" data-src="https://freight.cargo.site/t/original/i/4dbc7989131f210bfa0f794c2d780813ced61d395a5bcb9c52d21b0e780c9e38/PinKeyboard.png" data-mid="187916545" border="0" src="https://freight.cargo.site/w/1000/i/4dbc7989131f210bfa0f794c2d780813ced61d395a5bcb9c52d21b0e780c9e38/PinKeyboard.png" /> View more content from this project in my portfolio deck. https://timstutts.cargo.site/Magic-Leap-1-Object-Recognition-1 Fri, 06 Oct 2023 00:47:17 +0000 Tim Stutts Emerging Product Design https://timstutts.cargo.site/Magic-Leap-1-Object-Recognition-1 Magic Leap 1 Object Recognition Company: Magic Leap Provided: interaction design, Date: 2016 - 2020 At Magic Leap, in addition to input, I worked on design of important features for Lumin OS, including Capture, Settings, LED / haptic patterns and Object Recognition. Privacy by design is an area of interest to me. I am a strong proponent of transparency and avoiding dark patterns (misleading interactions around user consent). This was an opportunity for me to allow ethics to inform the design practice. I led the user experience design of World Understanding (Object Recognition), collaborating with other designers on the appropriate privacy settings. To demo this platform feature users must first enable World Understanding in Settings, and then walk around their space. Real world objects, such as posters and couches, are labeled automatically as detected. Moving around the objects at different perspectives increases the confidence of computer vision algorithms. I also designed privilege and permission dialogs to establish user consent for third-party developers to utilize this feature in their apps, and partnered with another designer to determine the object regonition lightwear LED pattern. Videos of Magic Leap’s Object Recognition Settings and me giving a talk on user data privacy and the metaverse with Feras Ahmed. View more content from this project in my portfolio deck. https://timstutts.cargo.site/Magic-Leap-1-LED-and-Haptic-Patterns Sun, 24 May 2020 19:01:54 +0000 Tim Stutts Emerging Product Design https://timstutts.cargo.site/Magic-Leap-1-LED-and-Haptic-Patterns Magic Leap 1 LED and Haptic Patterns Company: Magic Leap Provided: LED pattern design and research Date: 2017 - 2020 Leading up to release of Magic Leap One Creator's Edition and beyond, I nurtured the design of sensory feedback for spatial computing in Lumin OS, including haptic and LED patterns. For haptic patterns I was a design stakeholder in evaluating and determining which haptic motor would go in the Control and provide freedback for system ​(e.g. charging) and input (e.g. hovering UI elements) functions. I led the design of dozens of haptic patterns for both Control and Mobile Companion app, which found use across the OS. For the LED patterns I was in charge of the design for the entire hardware platform--Control, Lightpack and Lightwear. These patterns are used to communicate everything from video capture on the Lightwear to pairing on the Lightpack. Designed in collaboration with visual and motion designers, I also helped partner with design researchers to run user trials, and later converted the patterns to technical specs complete with timing tables and behaviors for implementation. These efforts involved close partnership with teams across the organization, including Software, Product, Hardware, Electrical, Privacy, and Industrial Design. In years that followed product launch, I led the design of enhancements to these patterns released in over-the-air updates. <img width="1600" height="944" width_o="1600" height_o="944" data-src="https://freight.cargo.site/t/original/i/f6f93e48d8105b80713632ea1da1856094d7b67ec9bab3215ae46fcaeeeb571c/Screen-Shot-2020-05-21-at-10.31.31-AM_1600_c.png" data-mid="216194817" border="0" src="https://freight.cargo.site/w/1000/i/f6f93e48d8105b80713632ea1da1856094d7b67ec9bab3215ae46fcaeeeb571c/Screen-Shot-2020-05-21-at-10.31.31-AM_1600_c.png" /> View more content from this project in my portfolio deck. https://timstutts.cargo.site/IBM-Watson-News-Explorer Wed, 12 Aug 2020 01:46:00 +0000 Tim Stutts Emerging Product Design https://timstutts.cargo.site/IBM-Watson-News-Explorer IBM Watson News Explorer Web Application Company: IBM Provided: interaction design, user interface design, data visualization, research, development Date: 2015 - 2016 IBM Watson News Explorer combined Alchemy News API and d3.js library to automatically construct a news information network and presents large volumes of news results via interlinked data visualizations. News Explorer was created by the Watson Cognitive Visualization Lab (now Visual AI Lab), of which I was a part. I completed the user interface design and development of the application, in addition to co-developing the data visualizations with Steve Ross, who also developed the back-end. Megan Monroe was also a collaborator. Our team was managed by Mauro Martino. News Explorer is no longer online, but had over 2 million unique queries over the years,&nbsp; received a prestigious 'Kantar Information is Beautiful Award,' and was recently featured in the book ‘Atlas of Macroscopes: Interactive Data Visualizations” from MIT Press.&nbsp; <img width="1920" height="1008" width_o="1920" height_o="1008" data-src="https://freight.cargo.site/t/original/i/9a26d23f067c05dad1fc0b80c9b6db9c7a1e69a83c6c9933ff176ef704af1fde/AppleAndISISNewsConnection.png" data-mid="79677060" border="0" src="https://freight.cargo.site/w/1000/i/9a26d23f067c05dad1fc0b80c9b6db9c7a1e69a83c6c9933ff176ef704af1fde/AppleAndISISNewsConnection.png" /> <img width="1920" height="1008" width_o="1920" height_o="1008" data-src="https://freight.cargo.site/t/original/i/0c52b5a0fcb9ed2d5b4e89e285503be53fef90b8eb45adde5965a11edf3d6bde/NimralNimrToSaudiArabia.png" data-mid="79677059" border="0" src="https://freight.cargo.site/w/1000/i/0c52b5a0fcb9ed2d5b4e89e285503be53fef90b8eb45adde5965a11edf3d6bde/NimralNimrToSaudiArabia.png" /> <img width="1920" height="1008" width_o="1920" height_o="1008" data-src="https://freight.cargo.site/t/original/i/5e25efc356f05a198e7f53a5230b9f0c6188df0dea0a9990fbcb6744b470543b/trending-and-breaking-news.png" data-mid="79677058" border="0" src="https://freight.cargo.site/w/1000/i/5e25efc356f05a198e7f53a5230b9f0c6188df0dea0a9990fbcb6744b470543b/trending-and-breaking-news.png" /> <img width="1920" height="1007" width_o="1920" height_o="1007" data-src="https://freight.cargo.site/t/original/i/ec92a4c59051582bd31bb22554dfc201ea2082f02cc432c5f21ce4ca65080ddc/NEtropicalCyclone.png" data-mid="79677056" border="0" src="https://freight.cargo.site/w/1000/i/ec92a4c59051582bd31bb22554dfc201ea2082f02cc432c5f21ce4ca65080ddc/NEtropicalCyclone.png" /> https://timstutts.cargo.site/Honda-Head-Up-Display Wed, 12 Aug 2020 01:45:56 +0000 Tim Stutts Emerging Product Design https://timstutts.cargo.site/Honda-Head-Up-Display Honda Head-Up Display Prototype Client: Honda Research Institute USA Provided:&nbsp;design, prototyping, sound Date: 2013 I worked with Honda Research Institute to create a prototype head-up display application that addressed a number of defensive driving scenarios, focused around situational awareness, specially objects moving in front of the car, speeding vehicle approaching in rear, and vehicle breaking in front of car. I also designed a morphing rear-fan to help the driver become aware of situations in the rear proximity. In all of these concepts the following technology is assumed: car's built-in IR sensor / camera to track objects that move in the path of a vehicle, and then displays overlaying augmented reality graphics onto the windshield via a micro-projector, aligning them to the user's perspective. The resulting application provides a unique way for the client to tweak the look and feel of the graphical animations for the scenarios in real-time, subbing in real driving footage in the background for the imagined scenarios. I programmed the application in openFrameworks (C++/OpenGL), allowing the elements to be procedurally generated. I eventually added sound design to provide sensory feedback. Special thanks to the team that I worked with at Honda Research Institute USA: Karlin Bark, Cuong Tran, and Victor Ng-Thow-Hing. &nbsp;<img width="1439" height="735" width_o="1439" height_o="735" data-src="https://freight.cargo.site/t/original/i/7d1549268ed6f46217e2c2a358dcf40ea592abe0f17b23a4d28e25a2a87cf8af/Screen-Shot-2013-07-27-at-1.32.33-AM.png" data-mid="79677076" border="0" src="https://freight.cargo.site/w/1000/i/7d1549268ed6f46217e2c2a358dcf40ea592abe0f17b23a4d28e25a2a87cf8af/Screen-Shot-2013-07-27-at-1.32.33-AM.png" /> <img width="2880" height="1524" width_o="2880" height_o="1524" data-src="https://freight.cargo.site/t/original/i/ac5b47ad32eb1e56b54ad21f697d8c6c1047abd09cd4a2e0d3a6d90d0cbd1f29/Screen-Shot-2020-05-09-at-9.03.47-PM.png" data-mid="79677079" border="0" src="https://freight.cargo.site/w/1000/i/ac5b47ad32eb1e56b54ad21f697d8c6c1047abd09cd4a2e0d3a6d90d0cbd1f29/Screen-Shot-2020-05-09-at-9.03.47-PM.png" /> Prototype HUD application for situational awareness scenarios. UI on the right is used to control the graphics treatment in realtime. https://timstutts.cargo.site/Oblong-Airborne-Beats Wed, 12 Aug 2020 01:45:54 +0000 Tim Stutts Emerging Product Design https://timstutts.cargo.site/Oblong-Airborne-Beats Oblong Airborne Beats Prototype Company: Oblong Industries Provided: interaction design, UI design, prototyping, development, sound Date: 2012 Oblong is a company known for pioneering the technology in the film ‘Minority Report,’ and later evolving it into enterprise applications. I designed and prototyped Airborne Beats as a live music sequencer application that is operable entirely by hand gesturing in front of a screen. Users are able to grab, drag, and release audio samples onto a grid. They can also draw automation curves across a track to control audio volume over time. There are a number of gestures for play, pause, and volume control that can be performed at any point in the experience. Airborne Beats was programmed in C++ using Oblong's g-speak platform and the creative coding library, Cinder, with the help of several Oblong engineers. As for hardware, we pulled together one screen equipped with an IR sensor, a computer, and speakers. The prototype application had its public debut in a solo show hosted at Bar Mitte in Barcelona. <img width="1280" height="720" width_o="1280" height_o="720" data-src="https://freight.cargo.site/t/original/i/df0b67a06ed4d90f47d208e6fe9abecfcbb699818a9975089b6009e03fa22ee3/P1070491_o.jpg" data-mid="79677097" border="0" src="https://freight.cargo.site/w/1000/i/df0b67a06ed4d90f47d208e6fe9abecfcbb699818a9975089b6009e03fa22ee3/P1070491_o.jpg" /> <img width="1280" height="720" width_o="1280" height_o="720" data-src="https://freight.cargo.site/t/original/i/d0a63fa1ec995c92ba566e6b4275a10c0a4e13373325085917d5ef49ccbda1e3/P1060958_o.jpg" data-mid="79677094" border="0" src="https://freight.cargo.site/w/1000/i/d0a63fa1ec995c92ba566e6b4275a10c0a4e13373325085917d5ef49ccbda1e3/P1060958_o.jpg" /> <img width="1280" height="720" width_o="1280" height_o="720" data-src="https://freight.cargo.site/t/original/i/95e0784701e8360f02ed08ef60d21848a5f577cf47c02f6c084cee61fad8961b/P1060917_o.jpg" data-mid="79677090" border="0" src="https://freight.cargo.site/w/1000/i/95e0784701e8360f02ed08ef60d21848a5f577cf47c02f6c084cee61fad8961b/P1060917_o.jpg" /> <img width="1280" height="720" width_o="1280" height_o="720" data-src="https://freight.cargo.site/t/original/i/d1453aaccef089f88934e71a74591d6b44f790ce3c2ab42023d10da19adcbd7d/P1060934_o.jpg" data-mid="79677092" border="0" src="https://freight.cargo.site/w/1000/i/d1453aaccef089f88934e71a74591d6b44f790ce3c2ab42023d10da19adcbd7d/P1060934_o.jpg" /> <img width="1280" height="720" width_o="1280" height_o="720" data-src="https://freight.cargo.site/t/original/i/88ad9feb2b98b228666ce8f490153d44d955f93be26e82d2e1059f31eac951e9/P1060946_o.jpg" data-mid="79677096" border="0" src="https://freight.cargo.site/w/1000/i/88ad9feb2b98b228666ce8f490153d44d955f93be26e82d2e1059f31eac951e9/P1060946_o.jpg" />Various shots of the prototype application in action