Branching out of the UI-verse

Published in

UX Collective

10 min readJul 16, 2023

User experience design will evolve in the coming years. As we continue our disciplines as design practitioners, we should keep an eye out as pioneers of newer user interfaces. Because, as the saying goes: If you can’t see the forest for the trees, you can’t see the whole situation clearly.

Branching is such a great concept. Originating from continuous integration among developers, we started seeing it in design tools such as Abstract and Figma.

Branching

Here’s how branching works: There could be multiple designers working on a core flow. Rather than relying on autosave, branching allows each designer to safely work on new screens without making any alterations to the main or existing files. When ready, changes to the work can then be merged upon review. This can be very helpful if there is some maintenance to the design library or if a particular part of the flow is worth discussing, testing, or performing QA. All as an extension before merging back into the main stem. (For more information, check out Figma’s documentation on branching.)

But that’s what we may want to hear as UX designers. As a way of working in the current product teams, we are accustomed to the language of our fellow developers. Yet the term “branch” holds a lot more meaning.

To the anthropologist, a branch will mean a conceptual subdivision of a family, subject, or group of languages.
To the manager of a large organization, a branch will mean a division or office of a large business or organization, operating locally or having a particular function.
To the geologist or cartographer, a branch will mean a part of a river or road that leaves the main part.
To the doctor, a branch will mean a smaller blood vessel or nerve that grows out of the main part.
And finally, to the gardener or arborist, a branch will mean one of the parts of a tree that grows out from the main trunk.

How is the word “branch” associated with six and potentially more meanings? Through my personal research and experience, I have landed on the term semantics, which is a “branch” of linguistics commonly associated with meaning. A further branching leads us to lexical semantics, which is the study of the actual meanings of words.

User Experience

Let’s try another set of words: how about user experience? To start, here is the definition of user experience from The International Organization for Standardization (ISO):

“A person’s perceptions and responses that result from the use or anticipated use of a product, system, or service”
— ISO 9241–210, Ergonomics of human-system Interaction, Part 210: Human-centered design for interactive Systems

The Interaction Design Foundation gave a great rundown of user experience, which has deep roots in human-computer interactions (HCI) and graphical user interfaces (GUI). Even so, there’s more than graphics with branding, packaging, services, support systems, hardware, and the environment. Additionally, user experience is seen both as a noun and a verb; an object and an activity. If we refer back to semantics and branching, we find ourselves in the same situation of seeing user experiences with similar yet different meanings. It’s like the famous Spider-Man meme of pointing at each other.

If we refer back to semantics and branching, we find ourselves in the same situation of seeing user experiences with similar yet different meanings. It’s like the famous Spider-Man meme of pointing at each other: User Experience. Are we the same?

Speaking of Spider-Man, did you see the latest box office sensation, Spider-Man: Across the Spider-verse? Besides the stunning animations and art styles, the movie captures an excellent narrative, with the hero meeting multiple versions of himself across different universes. Each variant has a different personality and twist, but they generally share a similar noun and verb.

Each variant has a different personality and twist, but they generally share a similar noun and verb. User experience isn’t too far off from this analogy. It too has a different personality and twist, but shares a similar definition. In 2023, we will see variants branching out from this core flow. (source: Sony Pictures) — Each variant has a different personality and twist, but they generally share a similar noun and verb. User experience isn’t too far off from this analogy. It too has a different personality and twist, but shares a similar definition. In 2023, we will see variants branching out from this core flow. (source: *Sony Pictures)*

User experience isn’t too far off from this analogy. It too has a different personality and twist, but shares a similar definition. In 2023, we will see variants branching out from this core flow.

Here are at least three variants:

1. Command-Line Interface (CLI)

We should at least recognize the predecessor of the GUI, also known as the Command-Line Interface (CLI). The Matrix will be an appropriate movie reference where users are exposed to lines of code and text. Despite a few of us who are still familiar with CMD.exe and Telex (airlines still use Telex, and the three-letter airport codes are a byproduct of that generation), the majority of us are more accustomed to GUIs, thanks to Apple’s founding members. (also check out the history of GUIs)

So one would have thought we would see the end of the command lines.

Until ChatGPT arrived. In this branch of an alternate UIverse, the interface goes back to a simple, plain interface with a textbox for prompts. (source: Fast Company)

Until ChatGPT arrived. In this branch of an alternate UIverse, the interface goes back to a simple, plain interface with a textbox for prompts. Some CLI resemblances are kept, such as block cursors, but where the experience of the user lies is in the humanness of the machine’s response due to large language models and artificial intelligence. For once, people can actually have a conversation with software without layering syntax and abstract keywords. The best part is that the machine understands and responds accordingly. Intuitive and interpersonal, unlike any other digital experience a person has felt thus far. Could this be User Experience?

2. Ambient computing

On June 30, 2023, over in Vancouver, former Apple design director Imran Chaudhri unveiled a new product in a TED talk to a live audience. He wore the device near his left breast pocket. At first, it was hard to tell what it could do, given its overall black appearance, similar to that of an iPhone screen. Chaudhri then received a call from his wife. He could tell it was her through the projection flashing on his palm. Soon, the device started speaking to him about his preferences, his health choices, and his translated words. It could do so with its camera, sensors, and light indicators. It was Chaudhri’s wearable personal assistant, Humane AI Pin, and it will launch this year.

In this alternate UIverse, artificial intelligence is screenless, seamless, and sensing.

In this alternate UIverse, artificial intelligence is screenless, seamless, and sensing. It takes the form of ambient computing, which is a broad term used to describe a setting where smart devices, AI, machine learning (ML), data, and human activity all come together to produce a result without the need for human command or interaction.

This user experience wants you to explore the surroundings and let the product melt away or disappear. Instead of pulling your attention, the product encourages you to go about your daily life while the AI continues to see and hear what the user perceives. All without a screen.

3. Spatial Computing

According to NYU Prof. Scott Galloway, human beings will shun anything that covers our faces due to our evolutionary makeup of acquiring dominance, attracting mates, and making social connections.

But in this alternate UIverse, human beings embrace the headgear. After all, we need to look beyond the stereotypical Homo Sapiens or Vitruvian Man. For instance, various ethnic groups would wear head scarves and face coverings based on their culture and beliefs, or for practical reasons like shielding themselves from harsh weather conditions. There are also users with eyewear for sports, transportation, and disabilities. Even users will take pride in wearing large, chunky headphones that can add weight, but are often ignored. We may gawk at someone wearing a Daft Punk helmet, but there are also Stormtroopers, Mandolorians, and Darth Vaders in our natural environment, leading us to wonder how we can accept the various tribes among human society.

But in this alternate UIverse, human beings embrace the headgear. We may gawk at someone wearing a Daft Punk helmet, but there are also Stormtroopers, Mandolorians, and Darth Vaders in our natural environment, leading us to wonder how we can accept the various tribes among human society.(source: Los Angeles Times) — But in this alternate UIverse, human beings embrace the headgear. We may gawk at someone wearing a Daft Punk helmet, but there are also Stormtroopers, Mandolorians, and Darth Vaders in our natural environment, leading us to wonder how we can accept the various tribes among human society. (source: Los Angeles Times)

The headgear will evolve, along with the complementary software that provides an alternate mixed reality. The famous tip of the UX iceberg comes to mind when what is described is only the surface. The skeleton, structure, scope, and strategy are where the long-term user experience lies with spatial computing. VisionOS is the tip of the iceberg, but it is not the first. With new experiences such as spatial audio, hand gestures, ornaments, and spatial user interfaces, not to mention future iterations of the Vision Pro headset design, the entire user experience is yet to be fully developed.

VisionOS is the tip of the iceberg, but it is not the first. With new experiences such as spatial audio, hand gestures, ornaments, and spatial user interfaces, not to mention future iterations of the Vision Pro headset design, the entire user experience is yet to be fully developed.

4. Everything?

Hey Chad G, I am feeling a little worn out from work today. I’m on my way back, and I am looking forward to a warm, cozy evening.

As soon as the phone hangs up, the apartment comes to life. Based on the recent physiological readings and other supporting parameters, Chad G is able to determine the right atmosphere and sequence to generate a conducive evening experience. When the user arrives at the doorstep, she sees her comfort food that Chad G has already ordered from a restaurant. As she goes in, a self-composed lo-fi soundtrack greets her. The curtain blinds and wall show a coordinated display of calming visuals, while the scent of the night is a slight variation of spices familiar to her. She settles down and takes a mocktail at the intelligent bar counter. She notices the special mocktail recipe created by Chad G. Once she finished her meal, she laid back on her self-reclining chair according to her optimal posture. Finally, she wears her digital eye mask and slowly relaxes with a combination of spatial audio, haptic massaging and generative video content …

Several branches of user experience have merged without any conflicts in this UIverse. At the same time, this has brought about a strong association between UX/AI and other technologies in a suite of products in a person’s home. It has become a multimodal user experience that may not constitute a graphical user interface at all. (source: her 2013)

From the above narrative, not only was there an intelligent digital assistant orchestrating various activities, but also the correspondence of various household objects making use of generative AI (gAI). Several branches of user experience have merged without any conflicts in this UIverse. At the same time, this has brought about a strong association between UX/AI and other technologies in a suite of products in a person’s home. It has become a multimodal user experience that may not constitute a graphical user interface at all. In fact, it evolved from some of the earliest graphical user interfaces made by the earlier pioneers — General Magic, Commodore International, and Apple. They were the first to associate objects with functionality. And they probably would have created the actual appliance to interact with their operating systems if the infrastructure had been made possible.

The UI is based on a “rooms” metaphor; for example, e-mail and an address book can be found in the office, and games might be found in a living room. (source: Fast Company)

Branching is such a great concept, and it does not need to be limited to continuous integration among developers or as a process in designing screens. A design practitioner can perform branching at a broader level, such that we can go beyond screens. Interestingly, this relationship is similar to Atomic Design, where components, screens, and products can be organized with branches as the connectors. The beauty of Nature is that it shows us this approach with its anatomy at different levels.

Here is an attempt to classify various kinds of branching:

Twigs: The smallest branches of a given tree that have leaves, flowers, and fruit. They represent the features and components of the product line or business

Bough: The main branch of the tree. They represent the actual products of the business

Branches: The common part of the tree that links the twigs with the boughs. They represent the multiple frames of usage of the product

Branching is such a great concept, and it does not need to be limited to continuous integration among developers or as a process in designing screens. A design practitioner can perform branching at a broader level, such that we can go beyond screens.

Could we continue to build our lexicon (also known as a branch of knowledge) around the idea of a tree? The answer is yes. Here are more entries:

Fruits, flowers: the payoff. It could come as a form of utility, such as completing a ride, or getting a cup of coffee

Grafting: To create a new business outside of the core competency. Requires short-term attention and continuous monitoring to determine if the business is self-sustaining

Pruning: To remove unnecessary features and products from the business in order to increase focus and growth.

Roots: The strategy and purpose of an organization and the underlying motivation with people (both customers and employees)

Sapling: A new idea or concept. Requires long-term attention and reviews to test the viability of the solution for the business

Soil/Earth: The voices and behaviors of the customers that act as nourishment for the business

Trunk/stem: The main product line of key development and operational activities

User experience design will evolve in the coming years. It is up to us as designers to change the narrative for ourselves. For starters, we could shift our focus away from a shrinking UX iceberg, and cast our gaze at the growth of a living UX tree. And as we continue our discipline as design practitioners, we should keep an eye out as pioneers of newer user experiences. Because, as the saying goes:

If you can’t see the forest for the trees, you can’t see the whole situation clearly because you’re looking too closely at small details.