The Problem

Nearly all mainstream apps and websites rely heavily on the use of text to provide their users with context, onboarding, and notifications. But text-heavy user interfaces (UIs) exclude many user groups from engaging with them, including people who are functionally illiterate, severely dyslexic, and people with visual impairments.

Research

A few studies have looked at text-free user interfaces, though they did not include publicly available wireframes or UI elements. I relied on some of the key takeaways from those studies when designing my text-free UI kit:

• Non-abstracted icons and semi-abstract icons are easier to understand than abstract icons, especially without the benefit of text labels

•  Speech playback should be provided wherever possible

The Solution: A Voice-First UI Kit

I designed an alternative to text-dependent GUIs. Using my Text-Free UI Kit for Adobe XD, designers have the ability to create their own accessible experiences. The aim of the UI kit was to provide a blueprint for designers who wanted to design beyond the screen, while also emphasizing that a text-free experience could be intuitive and engaging.

My Text-Free UI Kit consists of two concepts for text-free experiences, both of which make use of voice cues and AR elements. The first concept, Polaris, is a mobile navigation app that helps users find their way to their destination through the combination of voice commands and AR directions.

The second concept, ARtie (pronounced “Artie”) is a virtual assistant for mobile phones that helps users identify unfamiliar items and locations and solve common problems they may encounter in their day-to-day lives.

There is also a library of distinct icons and components to help designers get started creating their own voice and AR experiences–loading screens, listening screens, and symbols to get started building menus.

With the proliferation of tools like voice and AR, designers can begin to create experiences that are more inclusive and accessible, while pushing the boundaries of traditional UI. Not only will this mean groups of people that were previously excluded can become part of the user base, but it will also provide a more varied and flexible experience for all users. This UI kit leads by example in showing two experiences that go beyond the screen, thereby providing a more inclusive UI for those who cannot interact with text-based UIs.