Sensing Force-Based Gestures on the Pixel 4

From Google on finger pressure detection:

https://ai.googleblog.com/2020/06/sensing-force-based-gestures-on-pixel-4.html

Google is working on new gestures that require an “Aware” sensor, possibly for the Pixel 4

In summary, Google is working on a pair of new gestures in Android Q. The two new gestures are called “Skip” and “Silence” and they’re likely controls for media playback, although the gestures are far from complete so there’s no way to activate them to test for ourselves. Furthermore, the new gestures require a new “aware” sensor that isn’t defined on any current Google Pixel device, so it’s possible that the new gestures will debut on the Pixel 4 if it has this “aware” sensor. Given what we know of Project Soli, it’s possible that the Soli radar chip will provide this new “aware” capability.

XDA-developers report.

Project Soli

Project Soli for Google. Really nice video on the front page.

Project Jacquard

Project Jacquard:

Project Jacquard makes it possible to weave touch and gesture interactivity into any textile using standard, industrial looms. Everyday objects such as clothes and furniture can be transformed into interactive surfaces.

'via Blog this'

ATAP’s ‘Soli’ Radar-Based Gesture Control Could Be The Perfect Wearable Interface | TechCrunch

ATAP’s ‘Soli’ Radar-Based Gesture Control Could Be The Perfect Wearable Interface | TechCrunch:

Google’s ATAP Project Soli is an attempt to harness the power of hand and finger manipulation to make it easier to interact with ever-smaller devices and screens. It posits that instead of using tools, we should use our “hand motion vocabulary” to control devices, even when the devices aren’t present.

'via Blog this'

"Google" Gesture concept (sign language real time translation)

This does not seems to be an official Google product, but still this is a nice idea, presented well:

Google Gesture from August Östberg on Vimeo.

GestKeyboard: Enabling Gesture-Based Interaction on Ordinary Physical Ke...

"At CHI 2014, National University of Singapore PhD Candidate Haimo Zhang and Google Research Scientist Yang Li presented GestKeyboard, a novel technique for gesturing on an ordinary, unmodified physical keyboard."



Read more at Research at Google blog.

Augmented Reality For Glass » Gesture Interaction with Glass

Folks from Hit Lab NZ in New Zeland started to experiment with using Google Glass for gesture recognition. From brief description in Augmented Reality For Glass » Gesture Interaction with Glass I understand they execute Computer Vision algorithms on PC and using Glass as a camera and display.

This is consistent with slow frame rates I've seen when running simple OpenCV demos on the glass. However this is still very exiting and important as a prototype exploring new gesture interaction scenarios using this novel device.

Google applies for patent on gesture-based car controls

Engadget reports: Google applies for patent on gesture-based car controls.

I happen to know that researches at CMU were experimenting with something similar. I wonder if it might constitute prior art.

GreenTouch: data capture, curation, and analysis via a multi-touch tabletop interface

Research at Google is featuring today one of recipients of Google App Engine Education Award - GreenTouch. It is interesting to see people working on using touch interfaces in education.

Google Acquires YC-Backed Flutter, A Gesture Recognition Technology Startup, For Around $40M

TechCrunch reports that Google Acquires YC-Backed Flutter, A Gesture Recognition Technology Startup, For Around $40M.  Flutter works on gesture recognition using Web Cam.