Japanese automotive electronics solution provider and semiconductor giant Renesas Electronics Corporation, today announced that it has developed a development kit for its R-Car that takes advantage of “emotion engine”, an artificial sensibility and intelligence technology pioneered by cocoro SB Corp., a SoftBank Group company.
It enables cars with the sensibility to read the driver’s emotions and optimally respond to the driver’s needs based on their emotional state.
The service kit includes cocoro SB’s emotion engine, which was developed leveraging its sensibility technology to recognize emotional states such as confidence or uncertainty based on the speech of the driver.
The car’s response to the driver’s emotional state is displayed by a new driver-concerning user interface (UI) implemented in the Renesas R-Car system-on-chip (SoC).
As it is possible for the car to understand the driver’s words and emotional state, it can provide the appropriate response that ensures optimal driver safety. As this technology is linked to artificial intelligence (AI) based machine learning, it is possible for the car to learn from conversations with the driver, enabling it to transform into a car that is capable of providing the best response to the driver.
Renesas considers the driver’s emotional state, facial expression and eyesight direction as key information that combines with the driver’s vital signs to improve the car and driver interface, placing drivers closer to the era of self-driving cars.
Once the car can recognize the driver is experiencing an uneasy emotional state, even if he or she has verbally accepted the switch to hands free autonomous-driving mode, it is possible for the car to ask the driver “would you prefer to continue driving and not switch to autonomous-driving mode for now?”
Moreover understanding the driver’s emotions enables the car to control vehicle speed according to how the driver is feeling while driving at night in autonomous-driving mode. By providing carmakers and IT companies with the development kit that takes advantage of this emotion engine.
Renesas will show case its connected car simulator incorporating the new development kit based on cocoro SB’s emotion engine at the SoftBank World 2017 event, to be held by SoftBank Corp. from July 20 to 21 at the Prince Park Tower Tokyo.