Software-Defined Cars: NIO OS 3.0 & “Tree” Naming Scheme
By Master
Intro: The era of software-defined cars has arrived. Here, “software” is not just about driving assistance, but also includes in-car intelligent cockpit and infotainment. Therefore, we have launched a special column, “Micro Experience with Infotainment”, where we will choose a distinctive infotainment product for in-depth testing in every issue.
Recently, NIO has fully rolled out the latest version of its infotainment system, NIO OS 3.0, to all its vehicle models. This new version has been upgraded in many aspects for global users and different regional laws and driving customs, including UI interface, NIO Pilot, HUD, and more. By the way, the system also comes with a new name.
Aspen is the system name for the current ES8/ES6/EC6 models on the NT1 platform, while the ET7 and other subsequent models on the NT2 platform will be named Banyan. “No matter which version it is, it is a living tree that should grow. Therefore, we gave them different names, but it doesn’t mean we are abandoning one of the software versions,” says Li Tianshu, head of NIO product experience.
Today, let’s take a look at how this new software system performs.
Decent Hardware Configurations, But It’s Time to Upgrade
For our test drive this time, we chose the 2020 NIO EC6, equipped with NIO’s second-generation full LCD instrument panel, central control panel, HUD, facial recognition camera, and pioneering NOMI Mate, etc. It seems to have everything, but why do we still say that “it needs an upgrade”? Keep reading.
Instrument Panel
Currently, all NIO models come with this 9.8-inch rectangular instrument panel with a resolution of up to 1800×606 and only a 6mm narrow bezel. It runs smoothly on the QNX system, and the overall design is simple and easy to read, without too many fancy styles. (Currently, only black theme is available, and white theme will be added via OTA in the future.)
All driving-related information is fixed on the left side. By using the physical buttons on the steering wheel, you can quickly switch to display information on the right side, including energy consumption, tire pressure, and multimedia. The center displays navigation information and ADAS system simulation images. The NIO OS 3.0 system has further optimized the display effect, significantly reducing the display delay during vehicle travel.
HUD Head-up Display
HUD needs to be added as an option for all NIO models except the signature version. However, the price of 6,500 yuan is not expensive, and it can also be used to obtain the automatic anti-dazzle function of the exterior rearview mirror. I strongly recommend selecting this configuration.
The NIO OS 3.0 system has also upgraded the display information of the HUD, which can display more content. Road speed limit information, electronic eye information, and electronic eye distance will be displayed on the left side area, while the right side area adds simulated display of lane lines under navigation status. The dynamic display is provided for functions such as NOP active lane change, turn signal control lane change (ALC), lane keeping assist (LKA), and lane change assist (LCA).
Central Control Screen
The second-generation central control screen is 11.3 inches, which is not large compared to 2021, but its narrowest bezel is only 7.8 mm, and the resolution is 1400×1600. The actual display effect is still very delicate.
However, since NIO’s models were finalized as early as 2016, the strongest NVIDIA X1 car chip at that time is indeed somewhat insufficient today. NIO is aware of this and has revealed plans to upgrade intelligent hardware. For vehicles that have already been delivered, NIO will provide paid upgrade plans for intelligent cabins and overall intelligent hardware in the next lifecycle, including Qualcomm Snapdragon 8155 chips, 5G networks, and DVR dash cameras. After the upgrade, functions such as network speed, APP operation, operating fluency, and NOMI recognition rate will be significantly improved.
Face Recognition CameraMost other models choose to design the facial recognition camera on the steering column or at the bottom of the A-pillar, which always looks like an aftermarket modification. However, NIO’s entire line of models hides the camera within the rearview mirror, avoiding a break in the interior design and achieving a “seamless” look.
When using the Navigation-assisted Pilot (NOP) function, the driver’s control ability over the vehicle is jointly monitored with the torque sensor on the steering wheel. If it is continuously detected that the driver cannot effectively control the vehicle, the newly added driver emergency assistance (EDA) function will be automatically activated:
- Continuously warn the driver through instrument panel pop-ups, warning sounds, etc.;
- Try to wake up the driver through braking and other methods;
- Turn on the hazard lights;
- Gradually reduce speed and eventually slow down to a stop within the lane;
- Automatically dial the 400 hotline for rescue;
- Automatically unlock the doors after the vehicle stops.
Clear logic for human-vehicle interaction, major audio system upgrade
The NIO OS 3.0 system has been comprehensively upgraded in terms of UI and function layout on the vehicle unit, with significant improvements in both appearance and ease of use.
The homepage still consists of a navigation map and two custom cards. The map interface has added a collection entrance and a group travel button. The left card below is the multimedia source, which can switch between NIO Radio, QQ Music, Himalaya, radio, Bluetooth, and USB.
When opening a multimedia application by clicking on a card, it will only take up half of the screen by default to minimize the obstruction of navigation information.
The right side contains five custom cards for vehicle status, energy consumption, tire pressure, devices, and weather, which can be switched left and right by swiping. You can also click to enter a more detailed settings interface.
The temperature/fan adjustment of the air conditioning system has also added a more convenient method. You can directly adjust it by swiping left and right while holding down the temperature/fan button on the homepage, without relying on tapping or entering a secondary menu.
Click on the “car” icon in the lower left corner to directly enter the vehicle settings interface. The operation logic is exactly the same as the previous version. The left side is the main category and the right side is the specific option, with pictures and text, and there is basically no difficulty in getting started.
You can also set frequently used functions as shortcuts on the negative screen. Swipe from the left edge of the screen to the right to open it, and the number is enough to meet daily use.
NIO OS 3.0 also made a major upgrade to NOMI. In the previous version of the system, the default wake-up word could only be “Hi NOMI”, which is very easy to confuse with “Hey NOMI”. Now, both calling methods can wake up NOMI.
And now the continuous conversation function is also available. After each conversation command is completed, MOMI will continue to remain idle for 20 seconds, and during this period, it will only receive instructions from the previous sound area.
In a continuous conversation, not only can multiple functions be adjusted separately, but it also supports context-based semantic inheritance. For example, after lowering the air conditioning temperature with NOMI, saying “lower a bit more”, NOMI will judge and execute based on the context of the language.
In actual testing, although its voice system still does not reach the level of XPeng’s “full-scene voice”, the recognition ability and execution of fuzzy instructions of this system are already quite good, and most common functions can be completely controlled by voice.
Entertainment: Newly added National K Song
NIO’s performance in the aspect of vehicle entertainment is relatively average, with basic entertainment software available. The music APP is fixed as QQ Music and Ximalaya, and the video APP is iQiyi. Currently, application expansion is not supported, but the applications that have been installed are custom versions exclusively designed for deep integration with the in-vehicle system, and the overall user experience is very good.
We will not introduce the APPs that were already available in the previous version. NIO OS 3.0 has added a new app called “全民 K 歌” (QMK), which has a completely unified UI style with other APPs, and allows users to jump to the song selection page directly from the full-screen interface of QQ Music, as well as to scan and select songs with their phones.
In conjunction with the wireless dynamic microphone released by NIO Life, excellent reverberation and ear-back effects can be achieved. The microphone kit can be purchased in the NIO APP Store for ¥399 or 3990 points.
In addition, a new app – “Tide” has also been added, providing three modes of “nap”, “meditation” and “breathing” for users. By integrating immersive background music (supporting 5.1 channel sound) with the linkage of seats, air conditioning, lighting, and sound equipment, it creates a more comfortable and enjoyable in-car space for users.
Summary
In summary, although it is limited by the current computing power and memory bottleneck of the chip, NIO has made several efforts to create a good in-car user experience. With well-crafted software optimization and UI design, it can still basically meet the expectations of users. Even compared to all new energy vehicles in 2021, it remains competitive. This also makes me look forward even more to the new system that will be equipped with the Snapdragon 8155 platform in the future.
This article is a translation by ChatGPT of a Chinese report from 42HOW. If you have any questions about it, please email bd@42how.com.