sensetime's full-cabin facial sensing technology creates exclusive care for every user
2024-09-23
한어Русский языкEnglishFrançaisIndonesianSanskrit日本語DeutschPortuguêsΕλληνικάespañolItalianoSuomalainenLatina
photo provided by the interviewee
at the launch of ledao l60, the scene demonstration video of "little le knows people" received unanimous praise from the audience on site and online. taking the initiative to play the peking opera that the second uncle likes and massaging the grandfather's waist to relieve fatigue are all considerate care for each user.
behind this, the oms function provided by sensetime jueying, especially the full-cabin face sensing technology, helps ledao l60 recognize and remember every passenger in the car, and can remember up to 20 accounts - a family of three generations living together, aunts and uncles can all be remembered, and xiao le can call them all by name. based on this capability, ledao automobile can synchronize the personalized data of each passenger, such as seat position, music account, etc., to achieve a personalized experience, making users feel more intimate, natural, and warm.
at present, the face model commonly used in the industry has the problem of key point occlusion and inaccurate prediction of key parts in special scenarios. this time, sensetime jueying uses a single oms camera to achieve full cabin five-seat face recognition, overcoming many unfavorable factors in practical applications such as large-angle facial imaging of front passengers and poor facial information (pixel value, lighting) of rear passengers.
"first, in the construction of the face model, sensetime jueying focused on optimizing the facial area and reconstructing the face model. secondly, in terms of the number of parameters in the face id training set, compared with general industry data, face id has increased by 160% and face data has increased by 200%." the r&d staff introduced, "the number of parameters in the deployment model has been further optimized, and the speed has increased by 10%. this effectively improves the product performance in a variety of actual generalized scenarios such as large angles, blur, distortion, and occlusion of the face, and truly achieves accurate recognition in multiple scenarios."
the reporter learned that through the multi-modal perception capabilities of sensetime jueying and ledao and the portrait information of the full-cabin account system, ledao automobile's interaction is free from stiff words such as "main driver" and "co-driver", and users can be addressed more intimately and send more intimate greetings. while enjoying the convenience, users do not have to worry about privacy. sensetime jueying attaches great importance to personal data security and privacy protection, has built a comprehensive and reliable data privacy protection management system, and has obtained certification from authoritative organizations. the data is not uploaded to the cloud or out of the car, and is stored on the end side, maximizing the protection of driving privacy and giving users greater peace of mind.
at present, sensetime jueying smart cockpit product solutions have been installed in 30 domestic and foreign oems, covering more than 80 models, protecting users' travel safety.
xinmin evening news reporter gao yang
