How Goggle plans to reinvent user interface
Published: 04:03 PM, 13 January 2019 Updated: 04:03 PM, 13 January 2019
Daily Bangladesh Desk
When the late Apple CEO Steve Jobs introduced the iPhone 12 years ago, he also introduced to many the concept of the multitouch user interface. He emphasized the benefit of using “the pointing device we were all born with”: our fingers.
But there’s one thing even more natural than physically poking something with our fingers: in-the-air hand gestures. All humans use hand gestures to communicate to other people.
Now Google wants you to use them to communicate with all your electronics.
Our new gaming site is live! Gamestar covers games, gaming gadgets and gear. Subscribe to our newsletter and we’ll email our best stuff right to your inbox. Learn more here.
Google is working on something it calls Project Soli, which uses radar to control electronics with in-the-air hand gestures.
Soli is quite amazing, actually
Announced in spring of 2015, Soli enables in-the-air gestures to control smart phones, computers, wearable devices and even cars. The project is in the news this week because the FCC just granted a request by Google to operate Soli radar sensors at higher powers than currently allowed in the U.S. It also gave permission for using Soli devices on airplanes.
Soli emerged from Google’s Advanced Technology and Projects group (ATAP), which itself was created inside Motorola Mobility by former DARPA director Regina Dugan. Google acquired ATAP when it bought Motorola in 2012, but kept it when it sold the company to Lenovo two years later.
Research labs are a dime a dozen in Silicon Valley, throughout the tech industry and in universities everywhere. They’re great at producing great technology that never makes it into real products.
ATAP is different in that all projects are expected to move from conception to shipping product in two years. (It often misses that target, but the point is to move aggressively toward productization).
Commenters are comparing the technology to Minority Report, which was a good movie from 17 years ago, or Replicas, which is a bad movie currently in theaters. (Here’s the trailer for Replicas, which shows the in-the-air UI).
Those Hollywood user interfaces involve large, conspicuous and sweeping movements of the arms and hands, whereas Soli enables interaction with slight finger movements. For example, rubbing fingers together (the international hand gesture for “money”) can direct a smartwatch to rotate, or a Smartphone to cycle through a series of screens.
Soli works with the use of a special and tiny solid-state chip (8mm x 10mm) that captures 3D motion using radar, then processes it with machine-learning algorithms. The radar passes through fabric, so you could interact with a phone in your pocket or a smartwatch while wearing gloves.
ATAP is the research division that brought us Tango, Ara, Spotlight Stories, Jacquard, Abacus, Vault and others. All these projects, by the way, were either canceled or failed after being brought to market.
The difference with Soli is that all previous failed or canceled ATP projects aimed to create an entirely new kind of product, or a new, untested platform. For example, Jacquard, which emerged as a fabric UI for the clumsily named Levi’s Commuter Trucker Jacket with Jacquard by Google, failed not because of the horrible name or because the technology was bad, but because the public didn’t take to the untested idea of using a sleeve as a user interface. Or, at least, the public didn’t want to pay a $260 premium for sleeve-based Smartphone control.
Soli, however, is likely to show up on platforms that are already popular, such as Smartphone’s and laptops, with a significant rise in price. If users don’t take to it right away, the products that support Soli will still probably succeed in the market, anyway.
Stated another way, it’s likely that Jacquard would be considered a success if it had been simply added it to the existing $90 Trucker jacket instead of being available only in a special $350 version.
Soli may end up being more similar to Google Assistant, which can be baked into all kinds of things — especially Internet of Things things.
In-the-air gesture support means that random appliances and sensors don’t need screens or buttons, and could be designed with natural, intuitive hand-gesture controls. Imagine an alarm clock that gave you a number of minutes snooze time based on how many fingers you held up, or Smartphone notifications that go away when you make a natural “dismiss” hand gesture.
One application nobody is talking about is the possibility of interaction with augmented reality objects. For example, a thermostat could show a virtual dial suspended in the air, then detect when you turn the dial to the right or left (thereby adjusting the temperature).
Soli Virtual Tool Gestures already developed include buttons, dials, sliders and others.
Imagine factory workers with augmented reality safety glasses that could conjure all kinds of virtual controls, then use Soli technology to manipulate those controls in the air.
I believe Soli is coming to real products, real soon. Google is working with LG, Qualcomm, JBL and others to build Soli into shipping products. The Soli SDK could be used by device makers of all kinds, as long as those devices are based on Android, Chrome or Google’s next-generation OS, called Fuschia.
Researchers are using Soli, too.
University of St Andrews researchers in Scotland published a paper in December detailing their work exploring the possibilities of Soli hardware. They demonstrated with their “RadarCat” project that Soli is so precise it can accurately count the number of playing cards in a deck, figure out compass orientation and map out the exact configuration of LEGO bricks.
Soli can identify objects or materials. The researchers showed how Soli could identify apples, oranges and hard drives. It could also figure out if objects were made out of glass, copper or steel, or what kind of beverage is poured into a glass. (Expect Soli-based coasters in bars).
It can even tell how you’re holding a smartphone, or what part of your body you touch your phone to.
Google gets great feedback
Movement in the Solisphere overshadowed news that Google announced last week a multiyear deal with haptics leader Immersion Corp.
Immersion is the leading independent company that enables game controllers and smartphones to buzz, shake and rumble to give touchy-feeling feedback to users.
The deal gives Google the right to use or be protected by any or all of Immersion’s 3,000 or so patents.
This matters, because Motorola/Google lost a patent infringement lawsuit against Immersion seven years ago, and that lawsuit centered on “Basic Haptics,” which is mostly simple buzzing. (Immersion also won patent lawsuits against Apple, Microsoft, Samsung, Sony, Fitbit and others).
The Motorola/Google lawsuit covered only Motorola-branded phones, not Pixel or Android phones, or any of the hardware products Google currently makes.
I think a deal licensing all Immersion patents must have been extremely expensive for Google (terms of the deal were not disclosed).
And I think the deal is related to Soli.
Haptic feedback is a necessary feature of Soli, because in-the-air gestures otherwise don’t provide the psychologically necessary “feedback” that something has actually happened on the device. For example, while turning an imaginary dial in space, you need a clicking sensation on the smartwatch to feel like something is really happening.
The Soli news plus the Immersion news add up to aggressive moves by Google to reinvent the “touch” user interface by taking the touch out of the equation.
Major user interface change is in the air.
- Dustbin at hospital’s entrance
- Rifat’s body on way to Barguna
- HM declares stern action against Rifat’s killers
- ‘Bangabandhu struggled whole life for two purposes’
- Those who stood, mainly blocked our way: Rifat’s wife
- Issue alert on boarder: HC to IGP
- Rohit falls early as India bat first
- Hackers steal data from telecoms: cyber firm
- Rural women making own fortune in Rangpur region
- Temperature may fall further
- New Silex malware bricks 2000 plus IoT devices
- Deputy Attorney Generals appointed before 2017 asked to resign
- Barguna murder: HC seeks info about ‘action’ taken within noon
- Rape accused killed in Sitakunda gunfight
- 1 held over brutal murder of Barguna man
- Mahbubur to die for killing Ranada Prasad Shaha
- How US aggressively flexed its cyber warfare powers under Trump
- US carried out cyberattacks on Iran: reports
- UN warns of telecom blackout cover for Myanmar military abuses
- Verdict on Ranada Prasad Shaha murder case today
- Say Alhamdulillah
- Young hacked to death for a hundred bucks
- Clean tech fair begins promoting environment friendly metals
- Balakot air strikes planner new R&AW chief now
- Gayle confirms retirement plans are on hold
- Democrats seeks $4.5bn aid for boarder migrants
- Nusrat murder case: Death threat to witnesses
- Two youth electrocuted in Bogura
- Expatriate to jail praying bail
- Trump warns any conflict with Iran `wouldn`t last long`
- All News »
- General Aziz - A Dedicated Golfer Army Chief
- Sarafa Infotech’s new director Soroj Mehedi
- AL to make it`s 70th anniversary memorable
- Mushfiqur`s ton in vain as Bangladesh lost to Australia
- ‘No Dorai’: Surfing base film with Chatgaiya language
- No exempt, although it is MP-Minister’s house: Rezaul
- PM inaugurates environment fair, tree plantation campaign & tree fair
- Say Alhamdulillah
- 3 farmers killed in Natore road crash
- Hajj cost in Bangladesh less than India: Minister
- 2 female RMG workers’ bodies recovered in Ashulia
- Happy birthday to football magician Messi
- Boat capsizes at Sadarghat: two minors’ body recovered
- Take development schemes protecting environment: PM
- Arrest warrant against Pran’s MD
- Female UP member hacked to death in N’ganj
- Williamson ton, Grandhomme power New Zealand in thriller
- Malaysia calls for ‘justice’ for Rohingyas
- Gold, Diamond, Silver gets validation in fair
- Fire at Cumilla EPZ
- PM’s China visit in July; plan to boost bilateral ties
- UN praises Bangladesh peacekeepers
- Primary recruit exam: 6 held over fake question trafficking
- ‘King of Pop’ Michael’s 10th death anniv today
- Habiganj municipality by-election underway
- Birth anniversary of poet Sufia Kamal today
- Argentina and Qatar set for crucial Copa America match
- Kulaura train crash: Three deceased identified
- Rail communication to be normal by evening: Secy
- Heartbreaking photo of dead migrants stirs outrage