Affectiva and Nuance to Bring Emotional Intelligence to AI-Powered Automotive Assistants

Affectiva, the global leader in Artificial Emotional Intelligence (Emotion AI), and Nuance Communications, Inc.  (NASDAQ: NUAN), the leader in conversational AI innovations, today announced their work together to further humanize automotive assistants and in-car experiences. Affectiva Automotive AI, the first multi-modal in-cabin AI sensing solution, will be integrated with Nuance’s conversational AI-powered Dragon Drive  automotive assistant platform. The integrated solution will deliver the industry’s first interactive automotive assistant that understands drivers’ and passengers’ complex cognitive and emotional states from face and voice and adapts behavior accordingly.

The integration of Affectiva’s technology with Dragon Drive will expand the breadth and depth of contextual, emotional and cognitive data that automotive assistants can detect and account for. Affectiva Automotive AI measures facial expressions and emotions such as joy, anger and surprise, as well as vocal expressions of anger, engagement and laughter, in real-time. Affectiva Automotive AI also provides key indicators of drowsiness such as yawning, eye closure and blink rates, as well as physical distraction or mental distraction from cognitive load or anger.

Nuance’s Dragon Drive powers more than 200 million cars on the road today across more than 40 languages, creating highly customized, fully branded experiences for Audi, BMW, Daimler, Fiat, Ford, GM, Hyundai, SAIC, Toyota, and more. Powered by conversational AI, Dragon Drive enables the in-car assistant to interact with passengers based on verbal and non-verbal modalities, including gesture, touch, gaze detection, voice recognition powered by natural language understanding (NLU), and now, through its work with Affectiva, emotion and cognitive state detection.

“As our OEM partners look to build the next generation of automotive assistants for the future of connected and autonomous cars, integration of additional modes of interaction will be essential not just for effectiveness and efficiency, but also safety,” said Stefan Ortmanns, executive vice president and general manager, Nuance Automotive. “Leveraging Affectiva’s technology to recognize and analyze the driver’s emotional state will further humanize the automotive assistant experience, transforming the in-car HMI and forging a stronger connection between the driver and the OEM’s brand.”

“We’re seeing a significant shift in the way that people today want to interact with technology, whether that’s a virtual assistant in their homes, or an assistant in their cars,” said Dr. Rana el Kaliouby, CEO and co-founder of Affectiva. “OEMs and Tier 1 suppliers can now address that desire by deploying automotive assistants that are highly relatable, intelligent and able to emulate the way that people interact with one another. This presents a significant opportunity for them to differentiate their offerings from the competition in the short-term, and plan for consumer expectations that will continue to shift over time. We’re thrilled to be partnering with Nuance to build the next-generation of HMIs and conversational assistants that will have significant impacts on road safety and the transportation experience in the years to come.”

In the near-term, Affectiva and Nuance’s integrated solution will enable the automotive assistant to further learn and understand driver and passenger emotion and behavior, as shown through speech incidents or facial expressions of emotion. For example, if an automotive assistant detects that a driver is happy based on their tone of voice, it can mirror that emotional state in its responses and recommendations.

In the future, the solutions are anticipated to address safety-related use cases, particularly in cars across the autonomous vehicle spectrum. Using Affectiva’s and Nuance’s technologies, automotive assistants could detect unsafe driver states like drowsiness or distraction and respond accordingly. In semi-autonomous vehicles, the assistant may take action by taking over control of the vehicle if a driver is exhibiting signs of physical or mental distraction.

About Affectiva

Affectiva, an MIT Media Lab spin-off, is the leading provider of AI software that detects complex and nuanced human emotions and cognitive states from face and voice. Its patented Emotion AI technology uses machine learning, deep learning, computer vision and speech science. Affectiva has built the world’s largest emotion data repository with over 7 million faces analyzed in 87 countries. Used by 25% of the Fortune Global 500 companies to test consumer engagement with ads, videos and TV programming, Affectiva is now working with leading OEMs, Tier 1s and technology providers on next generation multi-modal driver state monitoring and in-cabin mood sensing.

About Nuance Communications, Inc.

Nuance Communications (NASDAQ: NUAN) is the pioneer and leader in conversational AI innovations that bring intelligence to everyday work and life. The company delivers solutions that can understand, analyze and respond to human language to increase productivity and amplify human intelligence. With decades of domain and artificial intelligence expertise, Nuance works with thousands of organizations – in global industries that include healthcare, telecommunications, automotive, financial services, and retail – to create stronger relationships and better experiences for their customers and workforce. For more information, please visit www.nuance.com