Google is bringing its Project Gameface technology, which it first introduced last year and turns your face into a mouse, to Android. Developers will also be able to develop applications that incorporate this technology.
Google presented the technology called “Project Gameface” at last year’s I/O event. Introduced for desktop devices, this system allowed you to control the mouse cursor with your face. At this year’s I/O event, it was announced that “Project Gameface” will come to Android. At last night’s event, Google announced that Project Gameface will become open source for Android developers. This means that Project Gameface can be integrated into apps and users will soon be able to control it with just their face without any contact.
Project Gameface uses a database of facial expressions from the device’s camera and MediaPipe’s Face Landmarks Detection API to provide this feature. After face and head movements are detected, they are converted into cursor movements and face control is provided. The Gameface project was originally introduced as an accessibility feature for gamers, but it can also help people with limited mobility.
Last year, Google said that this technology can detect 468 points on the face and assign different actions to each facial expression. For example, actions such as laugh for right click or wink for left click can be defined. In the future, Android developers will be able to make these come to apps on smartphones.