Upcoming: Augmented UX
Jan 10, 2024

For decades, we've been accustomed to interacting with technology through screens, a breakthrough primarily developed by Xerox at PARC in 1973. This innovation moved us from coding-based interactions to a visual and intuitive interface, marking the advent of the "Mouse revolution." Fast forward to 2007, Apple's iPhone launch heralded the "Finger revolution," transforming human interaction with technology. Despite earlier attempts by others, Apple's success was unparalleled. As we evolve, we stand on the brink of the "Augmented revolution," suggesting a shift beyond current interfaces, potentially challenging even the most advanced contenders like the Vision Pro.
What is Augmented UX?
Honestly, it's challenging to pinpoint precisely because it's still an emerging concept. However, we do have a few examples hinting at its potential, involving attempts to weave it into our daily lives. This technology needs to seamlessly integrate with and respond to real-time contexts, something current applications have yet to fully achieve, making AI a vital component of Augmented UX.
Attempting a definition: Augmented UX represents a method of interacting with and being assisted by technology within a live environment, not necessarily tied to a traditional screen. It proposes guidance over active searching. While this might sound abstract, everyday examples, though not yet perfect, offer glimpses into how brands are experimenting with this idea.
Why AI is related to (true) Augmented UX?
AI's integration is crucial for realizing the full potential of Augmented UX, transcending mere interaction within a predefined space. Without AI, Augmented UX might not go beyond being an advanced AR, limiting its scope to merely augmenting reality in a 3D space. AI enriches this experience, enabling a dynamic, context-aware interaction that significantly enhances the human-technology interface beyond current capabilities.
The trials (non-exhaustive list)

The HUD (Head-Up Display), reminiscent of "Iron Man" tech, shows information like speed in a driver's direct line of sight, enhancing the driving experience by keeping focus on the road. It might seem like just another gadget, but it's a significant step forward in driving UX, simplifying the process of staying informed while driving. Tesla's Autopilot is a leading example of HUD's evolution, integrating traffic, speed, and other contextual data, making it a cutting-edge instance of augmented UX available for real-world testing as of 2024.

Voice Recognition
It is my favorite, as it aligns with the natural human inclination to communicate verbally. This technology, developed by giants like Amazon, Google, and Apple, currently facilitates straightforward tasks through direct commands. It's a simple yet profound interaction: we speak, and the device responds. I classify this under Augmented UX because it already enhances the user experience significantly. Voice is pivotal for Augmented UX, poised to be the next evolution in interfacing with AI. Products like AI Pin or Rabbit are gaining interest for making voice interaction with technology non-intrusive and more natural. However, speaking to devices in public remains awkward, prompting companies to refine their systems to predict user needs based on past interactions, thereby minimizing potentially awkward moments.

Wearable Device
The Vision Pro, as a wearable device, represents Apple's foray into Augmented UX, leveraging their extensive experience with wearable technology from the Apple Watch and insights from over a decade with the iPhone. It's seen as a potential step forward in integrating technology more closely with daily human activities, directly linking to our movements and health. Despite Apple's mixed history with new ventures, the Vision Pro and similar devices are pivotal in advancing Augmented UX by blending technology seamlessly with our physical selves.
What to expect from Augmented UX
From Augmented UX, we should anticipate an enhancement in how we interact with the world, making us feel empowered. Live translation is a prime example, predicting a near future where instant linguistic conversion is seamlessly integrated into our auditory experience, minimizing delays. Surprisingly, companies like Apple haven't fully capitalized on their ecosystem to deliver this level of Augmented UX without significant effort.
Envision the synergy between the Apple Watch, AirPods, and proprietary AI seamlessly facilitating our daily tasks. It's not just about personal convenience; the potential extends to solving pressing global issues in education, social systems, and climate change.
The real value of Augmented UX lies in its ability to enrich our lives in profound ways, urging tech giants to pivot from enhancing what's already there to innovating for the greater good. The future beckons a shift towards meaningful augmentation, where technology serves as a bridge to a better understanding and interaction with the world around us.
There are countless opportunities to harness Augmented UX for meaningful purposes; the key is shifting our focus from seeking fame to prioritizing utility.