December 14, 2021 07:13 ET | Source: Research and Market Research and Market
Dublin, December 14, 2021 (Global News Agency)-The report "Research Report on the Development of Multimodal Interactions in China's Automobiles in 2021" has been added to the product of ResearchAndMarkets.com.
This report summarizes the interactive models of mainstream auto brands.
The current automotive human-machine interaction (HMI) has the following characteristics:
In terms of interaction methods, in addition to the traditional interactive methods such as touch, buttons, and knobs, voice and mobile phones have also become the first choice for in-vehicle HMI. In addition, faces, gestures, and car lights have become popular interaction options. Some brands have even begun to try new interactive methods, such as eye tracking, voiceprints, fingerprints, etc. In terms of layout, the joint venture brand maintains a conservative approach to interaction. Except for voice and mobile phones, they rarely use new interactive methods. However, luxury brands are the pioneers of multimodal interaction. An example is Mercedes-Benz, which has equipped its new generation MBUX system with a variety of new interaction methods such as face, gestures, eyes and fingerprints. In contrast, China's leading brands are more active in new interactive modes, such as Changan Automobile's awakening of vision and Great Wall Motor's voiceprint recognition.
Voice provides functional improvements as a traditional interactive mode.
In addition to the original voice interaction capabilities, functions such as continuous dialogue, voice area locking, tone switching, and custom voice have also become the next direction of mainstream brands.
Gestures have become the third new interactive method after voice and face. Gesture interaction judges the gesture through the on-board camera, and sends the data to the on-board system control unit, and the on-board system control unit calls the function corresponding to the gesture. Gesture control is more accurate, faster and easier to operate than voice control. Brands that use gesture interaction include BMW, Mercedes-Benz, Changan, Great Wall, SAIC Roewe, GAC Trumpchi, VOYAH, R Car, BAIC ARCFOX, Xiaopeng, and Great Wall and Xiaopeng support gesture recognition outside the car. WEY Mocha-Enables gesture controls for ignition, forward/backward movement, suspension and flameout outside the car. Changan Ford EVOS-a new generation of SYNC+ 2.0, which can realize gesture control such as mute, music playback, interface split, return to the homepage, etc. Brands such as Mercedes-Benz, HiPhi, IM Motors, etc. can realize light interaction. Light interaction sends information through flash, light projection and combined headlights. Optical interaction provides a communication channel with traffic participants outside the vehicle, enabling autonomous vehicles to communicate with the surrounding environment while achieving autonomous driving. Brands such as Mercedes-Benz, Audi, Volkswagen, Great Wall, BYD, Hipi, IM, and Xiaopeng have now packaged this interactive mode. Mercedes-Benz-projector headlights project warning signs, auxiliary signs and other information related to driving assistance systems onto the road ahead. IM L7-Projection headlights can project interactive warnings, navigation, vehicle information, etc., and provide lane-level guidance with high-definition maps. The combined headlights provide multiple modes to display the status of the user in the cockpit; the interactive taillights can display text and emoticons as well as information, such as thanks, pedestrian warning and charging status. In addition to the combination of headlights, some brands such as BAIC and Samsung are also trying to add displays on the front and rear of the body to send messages to pedestrians. BAIC Lite 300-The LED display on the front and back of the fuselage displays text, expressions, animations, charging status, etc. Multimodal fusion is the future trend. Single-mode interaction has a limited role in enhancing the interactive experience. Multimodal fusion is obviously a viable and effective choice for a better interactive experience in the future. Brands that are developing this feature include Mercedes-Benz, BMW, Huawei and Changan.
The voice interaction showed little ability to recognize vague pronouns like "this" and "that". In this case, adding eye tracking and voice commands to lock the direction can make the response to the command faster. Mercedes-Benz MBUX travel knowledge-the driver looks at a building and says "I want to know the purpose of this building", and he/she will get the relevant information. Cerence Look provides technical support.
Obtaining commands accurately is a key step in the voice interaction process. The cockpit environment is complex, noisy, high density of personnel, and speech recognition is more difficult. The recently added new voice area lock function is a solution to this problem. However, due to its limitations, single-mode voice interaction technology has limited effects in enhancing the interactive experience. Combined with lip movement recognition, voice recognition is more accurate in voice interaction. Lip movements vary from language to language. In a noisy cockpit environment, combined with lip movements, the system can ensure high voice recognition accuracy, even if the voice sounds very low.
Key topics covered: 1 Overview of Multimodal Interaction 1.1 Definition of Multimodal Interaction 1.2 Development Process of Multimodal Interaction in Automotive Scenes 1.3 Application of Mainstream Brand Interaction Methods 1.4 Touch Interaction 1.5 Voice Interaction 1.6 Voice Interaction Development Trend 1.7 People Face Interaction 1.1.8 Gesture Interaction Light Interaction 1.10 Biometrics 1.11 Other Interaction Modes 1.12 Development Trend 2 Joint Venture Car Brand Multi-mode Interaction 2.1 BMW 2.2 Mercedes-Benz 2.3 Audi 2.4 Volkswagen 2.5 Ford 2.6 Buick 2.7 Toyota 2.8 Nissan 2.9 Honda 2.103 Volvo Car Multi-mode 2.103 Volvo Car 3.2 Changan Automobile 3.3 Great Wall Motor 3.4 BYD 3.5 Chery 3.6 SAIC 3.7 GAC 3.8 Voyah FREE Interactive Highlight 3.9 IM L7 Interactive Highlight 3.10 R Car Interactive Highlight 3.11 BAIC ARCFOX 4 Multi-mode Car Brand Emerson 4.4 Emerson Brand Interactive 4.4 4.4 Weltm Interactive Highlights eister W6 4.5 HiPhi X Interactive Highlights 4.6 NETA U Pro Interactive Highlights For more information on this report, please visit https://www.researchandmarkets.com/r/659jbg