FB researchers using Maths for better translations
Published: 10:58 PM, 13 October 2019
Designers of machine translation tools still mostly rely on dictionaries to make a foreign language understandable. But now there is a new way, numbers.
Facebook researchers said, rendering words into figures and exploiting mathematical similarities between languages is a promising avenue, even if a universal communicator a la Star Trek remains a distant dream. –reports AFP.
Powerful automatic translation is a big priority for internet giants. Allowing as many people as possible worldwide to communicate is not just an altruistic goal, but also good business.
Facebook, Google, and Microsoft as well as Russia's Yandex, China's Baidu and others are constantly seeking to improve their translation tools.
Facebook has artificial intelligence experts on the job at one of its research labs in Paris.
Up to 200 languages are currently used on Facebook, said Antoine Bordes, European co-director of fundamental AI research for the social network.
Automatic translation is currently based on having large databases of identical texts in both languages to work from. But for many language pairs there just aren't enough such parallel texts.
That's why researchers have been looking for another method, like the system developed by Facebook which creates a mathematical representation for words.
Each word becomes a "vector" in a space of several hundred dimensions. Words that have close associations in the spoken language also find themselves close to each other in this vector space.
"For example, if you take the words 'cat' and 'dog', semantically, they are words that describe a similar thing, so they will be extremely close together physically" in the vector space, said Guillaume Lample, one of the system's designers.
"If you take words like Madrid, London, Paris, which are European capital cities, it's the same idea."
These language maps can then be linked to one another using algorithms -- at first roughly, but eventually becoming more refined, until entire phrases can be matched without too many errors.
Lample said results are already promising. For the language pair of English-Romanian, Facebook's current machine translation system is "equal or maybe a bit worse" than the word vector system, said Lample.
But for the rarer language pair of English-Urdu, where Facebook's traditional system doesn't have many bilingual texts to reference, the word vector system is already superior, he said.
But could the method allow translation from, say, Basque into the language of an Amazonian tribe?
In theory, yes, said Lample, but in practice, a large body of written texts is needed to map the language, something lacking in Amazonian tribal languages.
"If you have just tens of thousands of phrases, it won't work. You need several hundreds of thousands," he said.
Experts at France's CNRS national scientific center said the approach Lample has taken for Facebook could produce useful results, even if it doesn't result in perfect translations.’
Thierry Poibeau of CNRS's Lattice laboratory, which also does research into machine translation, called the word vector approach "a conceptual revolution".
He said "translating without parallel data" -- dictionaries or versions of the same documents in both languages -- "is something of the Holy Grail" of machine translation.
"But the question is what level of performance can be expected" from the word vector method, said Poibeau.
The method "can give an idea of the original text" but the capability for a good translation every time remains unproven.
Francois Yvon, a researcher at CNRS's Computer Science Laboratory for Mechanics and Engineering Sciences, said "the linking of languages is much more difficult" when they are far removed from one another.
"The manner of denoting concepts in Chinese is completely different from French," he added.
However even imperfect translations can be useful, said Yvon, and could prove sufficient to track hate speech, a major priority for Facebook.
- Woman held with drugs in Noakhali
- 3 fake RAB detained by RAB
- Bollywood singer Papon calls off Delhi concert
- Sports journo Arnab Majumder passes away
- Man detained with free textbooks in Faridpur
- Int’l confce on SDGs at RU Dec 18
- UN concerned over India’s ‘discriminatory’ citizenship act
- 31 Banks’ ATM service halted till Sat morning
- Find out birthplace of Prophets
- Foam factory catches fire in Badda
- ‘Battle for cleanliness’ begins in city
- Air ticket at Tk 16 on Dec 16!
- 15 killed in Pakistan van-bus collision
- Graves of freedom fighters covered by National Flag
- GRP solution to automate offices
- DU Chalk out programs on Martyred Intellectuals Day
- 10 killed in Afghanistan Roadside bomb blast
- Alia Bhatt alleged for ‘award fixing’
- Eggs Halwa
- Bus kills Nushrat in Noakhali
- Immigration through Tamabil border suspended
- Mahmudullah ready to change Chattogram’s fate
- Royals beat Thunder by 8 wickets
- Apex court’s new judges paid tribute to Bangabandhu
- Cumilla opt to bowl against Dhaka
- Over 22 Bangladeshi companies to participate in JITF ‘19
- Human chain protesting poor road construction
- ‘Bangabandhu’s actual history was barred to know till ’96’
- 2 ministers defer India visit for state bustle
- Martyred Intellectuals’ Day tomorrow
- All News »
- Salman-Katrina arrive Dhaka
- Bangladeshi student secures top position in Bar at law
- Tahsan marry to Shaon!
- Srijit-Mithila’s wedding today
- Three TV channels to broadcast BPL opening ceremony live
- Mithila’s name changed after wedding
- Salman-Katrina to inebriate BPL stage
- Myanmar state counselor titles ‘Rohingya genocide’ as minor issue
- Srijit-Mithila’s honeymoon picture goes viral
- Mithila tie knot with Srijit
- Rumpa’s ‘boyfriend’ Saikat on 4-day remand
- 4 killed in Florida police shootout over armed robbery
- Miss South Africa crowns Miss Universe 2019
- Rohingyas’ acute detest on Myanmar
- Myanmar admits the army used excessive force on Rohingya
- Rights groups call for Myanmar boycott
- Salman pays tributes to Bangabandhu
- Mithila-Srijit’s honeymoon to Switzerland
- ‘Brutal massacre of Myanmar against Rohingya should be stopped’
- Just 3 days ‘Tui Ki Amar Hobi Re’ crossed 1 million
- North Korea conducts ‘very important test’
- Ethiopian PM Abiy Ahmed receives Nobel Peace Prize
- 3 of same family incl couple killed in Tangail road crash
- Polio returns to haunt Malaysia after 27 yrs
- Pele’s last Brazil jersey sells for 30,000 euros in Italy
- US tightens sanctions on Myanmar army chief
- Myanmar army chief’s Facebook account suspended
- Chattogram Challengers unveiled Jersey
- 500-yr-old eggs found unbroken in Chinese tomb
- Chile military plane disappears with 38 aboard