Translation - art & business » AI for translators and interpreters »
1 Day conference on the state of MT and LLM, reality check
Thread poster: Philippe Locquet
Philippe Locquet
Philippe Locquet  Identity Verified
Portugal
Local time: 15:35
English to French
+ ...
Nov 10, 2023

So, after attending a highly relevant one day online event, here’s the skinny:

LLM are performing on par or worse that state of the art MT for big languages.
Once you leave big languages (En, Es, Fr, De and maybe one or two more) the quality of LLM output drops tremendously.
LLM have some flexibility to perform tasks that are harder for MT (gender style, applying a glossary with correct agreement).
So, on translation tasks, in Q4 2023 we can still consider LLM to... See more
So, after attending a highly relevant one day online event, here’s the skinny:

LLM are performing on par or worse that state of the art MT for big languages.
Once you leave big languages (En, Es, Fr, De and maybe one or two more) the quality of LLM output drops tremendously.
LLM have some flexibility to perform tasks that are harder for MT (gender style, applying a glossary with correct agreement).
So, on translation tasks, in Q4 2023 we can still consider LLM to be the same as a new MT provider. Relevance depends on language pair and pricing policy.

If you don’t use MT in your translation pipeline, this information is irrelevant to you.

Some information will be presented in an upcoming video, a lot more will come out around the time of Wordfast Forward 24 (I’ll do a full presentation there).
Hope this is useful.

Event links:
https://amtaweb.org/generative-ai-and-the-future-of-machine-translation/
https://slator.com/event/generative-ai-and-the-future-of-machine-translation/
https://amtaweb.org/program-for-generative-ai-and-the-future-of-machine-translation/ ▲ Collapse


Lieven Malaise
Dan Lucas
Giovanni Milone
 
Dan Lucas
Dan Lucas  Identity Verified
United Kingdom
Local time: 15:35
Member (2014)
Japanese to English
It is Nov 10, 2023

Philippe Locquet wrote:
Hope this is useful.

I don't/can't use MT, but it's an interesting perspective.

Thank you
Dan

Philippe Locquet
Michele Fauble
 
Neirda
Neirda  Identity Verified
China
Local time: 22:35
Chinese to French
+ ...
I mostly agree Jan 11

Having tested extensively the quality between LLMs and MT, I could never notice a huge difference in quality when the game is equal (just prompting the LLM to translate with no extra fluff).
The advantage of LLMs really relies on the ability to provide context.

I remember a paper from Tencent claiming they managed to improve the quality of a translation by prompting the LLM to refine its own work, but I could never replicate this.
 


There is no moderator assigned specifically to this forum.
To report site rules violations or get help, please contact site staff »


1 Day conference on the state of MT and LLM, reality check







Anycount & Translation Office 3000
Translation Office 3000

Translation Office 3000 is an advanced accounting tool for freelance translators and small agencies. TO3000 easily and seamlessly integrates with the business life of professional freelance translators.

More info »
Protemos translation business management system
Create your account in minutes, and start working! 3-month trial for agencies, and free for freelancers!

The system lets you keep client/vendor database, with contacts and rates, manage projects and assign jobs to vendors, issue invoices, track payments, store and manage project files, generate business reports on turnover profit per client/manager etc.

More info »