Dylan Garrett
VP Consumer & Industrial Business

Oops! Something went wrong! Please try again!

[Watch] Why Your Smart Home Isn’t Truly Smart...Yet

Smart speakers have taken us a huge step forward in human-digital interactions, but the user experience must become more intuitive to deliver on the promise of a smart home.

As these devices become more and more ubiquitous they are giving easy access to digital information in the cloud, with 90% of people using them for music and 80% for real-time information like weather and traffic. At the same time, there has been an increase in the number of other smart devices available for the home, with everything from toilets to ovens having an internet connection. Smart devices have the potential to improve productivity, safety, and enjoyment in our lives, but using a voice user interface for interacting with these physical devices is still a frustrating experience.

One reason is that VUI today lacks much of the richness that we take for granted in everyday interactions with other people. An improved UI would understand context, such as our gestures, body language, facial expressions, and physical surroundings. It would go beyond speech to text and understand meaning from our voice, including things like emotion and identity. The ultimate goal, really, is "Zero UI" or an interface so natural you don't realize it's an interface.

The ultimate goal, really, is "Zero UI" or an interface so natural you don't realize it's an interface

We've been developing solutions to this, incorporating different sensor technologies and more capable artificial intelligence to make human-digital interactions more intuitive, both for our clients and through technology demonstrations. One example is a home assistant we call Gerard. Gerard has integrated machine vision, voice and gesture recognition, and 3D mapping capabilities which give it the ability to understand much more than the words you say. For example, Gerard knows if you are looking at it when you talk, so an awkward wake word is not necessary. Gerard also understands what objects are around you, where you are, and where it is, so that you can gesture to objects and say things like "turn on that light," or even ask "where did I leave my keys?"

It's possible now to bring interactions like these to many devices around the home beyond smart speakers. Nest executed this nicely with their thermostat, which "wakes up" when you approach it, without requiring any touch or voice to do so; but, the company has also seen challenges with Zero UI—their first generation smoke and CO2 detector had a gesture interface to silence the alarm, which was buggy and was eventually disabled. This shows how solving these problems isn't as easy as just adding sensors to a device. It requires a full system approach, which, in Nest’s case, meant algorithms that worked reliably in a challenging environment. We have experience developing gesture-based algorithms and know how hard it can be to get them to work reliably for diverse populations and use cases.

A system engineering approach is what Synapse and Cambridge Consultants specialize in, and developing a device that benefits from natural interactions like this can leverage many of our technical capabilities. If integrating natural UI is on your product roadmap, or you’d like to discuss advances in intuitive user interfaces, please get in touch!


See what else is new...

June 18, 2020

Embrace Ambiguity to Expose Winning Product Architectures

Architecture development for innovative products is exciting because options abound and we can exercise our creativity. At the same time, uncertainty lurks in the user experience, business case, and technical realms. Learn how we navigate this challenging terrain to help our clients deliver world-class products to market.

June 15, 2020

[Download] Do Better. Sustainable Product Design Ebook

As a product development consulting company, we are in a unique position to drive sustainable design across industries—and we don’t intend to stop there. Instead, we are sharing our work to help others design more sustainable products and systems. This ebook abstracts our sustainable design process into easy-to-use tools, which can be applied to any hardware product development.

See what else is new...

December 4, 2019

[Watch] Stop Yelling at Alexa, She Doesn’t Get You…Yet

The recent success of smart speakers has been a great leap in human-digital interaction, but there’s still a lot of space for developers and companies to cover to create smart devices and environments with truly engaging and intuitive interfaces. While voice command technology can handle simple tasks, the interaction can fall short because it has modest understanding of human intent.