Technology that allows you to use applications on your phone without touching it.
Google is bringing "Project Gameface," the technology that turns your face into a mouse, to Android, which it first introduced last year.
Google officially kicked off this year’s developer conference, I/O, on May 14th. The focus of the event was on artificial intelligence announcements, with Gemini being the centerpiece. In addition to that, other interesting announcements were made. Last year, the tech giant introduced a technology called “Project Gameface” at I/O. This system, unveiled for desktop devices, allowed you to control the cursor by turning your face into a mouse. At this year’s I/O, it was announced that Project Gameface is coming to Android.
You'll be able to control Android apps with your face
Google announced at its new event that Project Gameface will be open-source for Android developers. This means it can be integrated into applications, allowing users to control them solely with their faces without the need for any physical contact.
Project Gameface uses the device’s camera and a database of facial expressions obtained from MediaPipe’s Face Landmarks Detection API to provide this functionality. After detecting facial and head movements, it translates them into cursor movements, allowing control with the face. Initially introduced as an accessibility feature for gamers, the Gameface project also has the potential to assist individuals with limited mobility.
Google mentioned last year that the technology can detect 468 points on the face and assign different actions to each facial expression. For example, smiling could be assigned for right-clicking, or winking could be assigned for left-clicking. Android developers will be able to implement these actions into applications on phones.
