marketplace.jpg
Logo_ntu_new.png
10 OCT

Technology Overview

Microwave Contactless Gesture Recognition Interface Devices

a) Introduction Input devices are critical factors that determines how a user interacts with a particular computing technology. Some of the breakthroughs in computing technology have been facilitated by innovative and disruptive user input devices. Some examples of disruptive input devices include remote control for TVs, mouse for computers, joysticks...

Logo_ntu_new.png

Technology Overview

a) Introduction Input devices are critical factors that determines how a user interacts with a particular computing technology. Some of the breakthroughs in computing technology have been facilitated by innovative and disruptive user input devices. Some examples of disruptive input devices include remote control for TVs, mouse for computers, joysticks for gaming consoles, click wheel used in the iPod, multi-touch capacitive technology used for the touch panels of smartphones (tablets and tablet PCs as well), trackpads for laptops, digital crown for smartwatches etc. Some of the pain points that exist in current technologies include non-ergonomically designed user input devices (eg. Optical mouse), lack of material compatibility (eg. IR based input devices such as Kinect and Leap motion cannot be integrated behind optically opaque materials) and lack of 3D sensing. b) Basic Functionality The basic functionality of our proposed technology is to detect 3D hand gestures of the user and enable interaction with the computing device. The computing device can be a laptop, tablet PC, gaming console, Augmented Reality (AR) and Virtual Reality (VR) consoles. c) How do we achieve the functionality? Our technology uses a Continuous Wave (CW) Interferometric Radar transceiver that overcomes the phase ambiguity problem and achieves beamforming by employing a special arrangement of microwave Substrate Integrated Waveguide (SIW) based six port receivers and leaky wave antennas (Provisional Patent reference ID: 10201806351Y). Machine learning algorithms are used to identify gestures and take appropriate actions.


Technology Features & Specifications

Key Features


1. 3D sensing with sub-mm accuracy is achieved using six port receivers and leaky wave antennas. This paves the way for implementing a multitude of versatile gestures making it more intuitive than conventional input devices.


2. Microwaves can penetrate through optically opaque materials such as opaque glass, ceramics, etc. Hence, they can be easily integrated behind optically opaque materials. IR based gesture recognition devices cannot be integrated behind optically opaque materials (eg. Kinect, Leap Motion).


3. Leaky wave antennas help in the scanning the entire area of the hand in 2D dimensions. Six port receivers help in the sensing of depth (the third dimension).


4. Machine learning algorithms are used for tracking the motion of the hand and recognize the gestures.
 


Potential Applications

  1. Intuitive input devices for portable computing devices such as laptops, tablets, smart watches.
  2. Control of smart home appliances.
  3. Gaming consoles involving Virtual Reality (VR) and Augmented Reality (AR)
  4. Sign language recognition systems

Market Trends and Opportunities

_


Customer Benefits

  1. Ergonomics: One-size fits all approach overcomes the pain points of non-ergonomically designed input devices (eg. Optical mouse)
  2. 3D sensing: 3D sensing capabilities leading to the possibility of a wide array of versatile gestures and a flatter learning curve for the consumer.
  3. Material compatibility: Integration behind optically opaque materials such as opaque glass, ceramics, polymers, etc. is possible unlike IR based devices (eg. Leap Motion, Kinect).