Maptic

Tactile Navigation for the Visually Impaired

Being told that you have a lifelong, incurable, eyesight problem is a terrifying prospect; one that is very difficult to come to terms with.

Maptic is a system of wearable sensory devices for the visually impaired, consisting of a visual sensor and vibrating feedback units. These customisable, personalisable modules can be worn without attracting the stigma that current assistive products harbour, while still accurately detecting objects in the visual field and transmitting them into intuitive vibrations on the body.

Maptic won the James Dyson Foundation Scholarship, for innovation in design solutions.

See Maptic at the Cooper Hewitt Smithsonian Design Museum in New York, USA.

Maptic at the Cooper Hewitt Design Museum New York

Maptic at the Cooper Hewitt Smithsonian Design Museum in New York, USA.

Visually Impaired man using Maptic system
The problem

The Problem

Quality of life visual impairment affects approximately 1 in 28, people over 40 with 2 million people in the UK living with sight loss. Contrary to popular belief, full blindness is relatively uncommon, with 18% (360,000) of visually impaired people registered as legally blind, and the remaining 1.64 million retaining partial sight.

For the visually impaired, retaining independence in day-to-day life is important. However, navigation can be a long-winded, potentially unsafe process, especially in new environments or at night.

Simple tasks like travelling to work can become arduous and time consuming and more often than not, need planning beforehand.

While interviewing and observing those with visual impairments provides a good basis for research, to get a true feel of feeling partially sighted, simulation glasses were constructed and tested with for extended periods of time.

blind glasses
tunnel vision glasses
macular degeneration glasses
cateracts glasses
the problem

Existing Products

Hearing becomes the dominant sense for detecting immediate dangers and unfortunately, most current devices utilise purely audio based feedback for operation.

While visually impaired people may not feel as handicapped and believe it doesn’t hinder them in most tasks, the general public often have incorrect assumptions about the visually impaired. There is often a feeling of pity that comes with blindness, and one that is unwelcome to partially sighted people.

Current assistive products tend to look overly medical, with emphasis on function rather than aesthetics or ergonomics. Touchpoints cater to any remaining eyesight and tend to be high contrast, vibrant colours - but often garish and even ugly.

Technological Discontinuance

As the number of assistive products and technology breakthroughs increase, as does product discontinuance. 29.3% of all visual impairment devices used are abandoned. It is up to the user to decide to stop using a product, and user experience can be a major factor of this.

While interviewing users of visually impaired products, they expressed a dislike that most products are unattractive, both via tactile feeling and remaining sight. Many complain of undesirability and feeling self-conscious when using the products, especially if they looked medical.

A good example of an assistive product done right is the Bradley watch by Eone. It has become so desirable in fact, that what was initially designed for partially sighted people has become fully taken up by people with full sight, and was even available on the Dezeen Watch Store

talking watch

Xinjia talking watch

Bradley watch

Eone Bradley watch

A discreet solution, not a medical one

With stigma as a focal point, the initial design stage incorporated designing concepts that would be invisible or concealed to the public.

Along with aesthetics, key points involved intuitiveness, ease of use and adequate feedback, and were investigated through journey maps.

Initial sketches
Development sketch
Sensor sketch
Development

Prototyping

A major part of the project was developing the effectiveness of hazard perception and the intuitiveness of tactile feedback. This was tackled through iterative electronics design prototyping and sensor testing.

This was as much an exercise into electronics learning as it was for design prototyping, and over the course of 30+ prototypes, the complexity of the electronics grew.

prototype 4

Prototype 4

prototype 12

Prototype 12

prototype 26

Prototype 26

Sensor Tech

Current assistive devices and sensing products (think parking sensors) detect via ultrasonic sensors - sounds is pinged out, reflected off an object and returns to the sensor as a signal. These components are cheap, however, they tend to be bulky and can often be unreliable.

Initial prototyping and testing commenced with ultrasonic sensors but during the project, a new form of sensor was released: the long-range, time-of-flight sensor. This sensor is a fraction of the size of an ultrasonic sensor, and is much more reliable.

The smaller sensor allowed for a drastically smaller design form factor, allowing the design to look even less cumbersome and in the long run, less like an assistive product.

ultrasonic sensor
time-of-flight sensor

Haptic Feedback

As the design incorporates a sensor and feedback devices, ensuring that the user gets good quality, intuitive haptics is important.

Prototype testing involved designs such as inflation bands and vibrating insoles, but it was discovered that ticking vibrations (similar to sonar) provided the best response for detecting distances, which were prototyped via mini vibration motors and specialised haptic microchips.

inflation feedback
inflation feedback testing
insole haptics
insole haptics feedback
microcontrolled vibrations
microcontrolled vibrations testing

Outcome

Through iteratively prototyping and designing hand in hand, the project ended up as a series of wearable units, consisting of a central sensor unit worn on the chest, and feedback units worn on the left and right sides of the body.

All interactions with the units have been taken with touch into consideration. At any given point, by running a finger down the device, the user can detect the state of the system, whether it's on or off, indoors or outdoors setting, or which orientation the sensor is. Different profiles were given to the sensor (circle), left (square) and right (triangle) units, for the user to immediately tell what they're touching.

The units are versatile, and by unclipping the top section, allows the user to choose an attachment that suits their needs and style.

Charged with a simple 3.3V headphone jack on a custom dock, the units can plug into themselves, creating bracelet or necklace appearances.

'Maptic' (a play on map and haptic) was chosen as the brand name, one that doesn't have immediate medical connotations and would be more closely linked to a lifestyle brand.

Maptic system
Close up of Maptic sensor
Close up of Maptic feedback unit
Final prototype

Final Prototype

Final prototype testing
Final prototype testing
Testing the final prototype at New Designers

Testing the final prototype at New Designers

Render of internal electronics
Exploded render
Charging dock

Charging Dock

Storyboard
Storyboard

Turn by Turn Navigation

A major part of the project is turn by turn navigation, where the user can be directed to a destination via vibrations, not spoken word as is current.

Instead of using an in-built GPS module into the circuitry, increasing the size of the units while decreasing battery life, it was chosen to link the Maptic units to a smartphone, using the current GPS capabilities of the phone and Google Maps API to provide the data for navigation.

While the function is already part of the phone, the interaction is limited to voice input and output. To combat this, a custom app was built with high-contrast colours and shapes, allowing the user to simply tap to go home, or a couple of swipes to a chosen destination. The app also allows the user to check on the status of the units, and if they are paired correctly.

These high contrast colours and geometric shapes ultimately dictated the design language of the branding of the project.

Click here to see the prototype for the Maptic app.

App home screen
Navigate home
Navigate to destination
Pairing devices
Settings