Translation memory

From Wikipedia, the free encyclopedia

You have new messages (last change).

A translation memory, or TM, is a type of database that is used in software programs designed to aid human translators.

Some software programs that use translation memories are known as translation memory managers (TMM).

Translation memories are typically used in conjunction with a dedicated computer assisted translation (CAT) tool, word processing program, terminology management systems, multilingual dictionary, or even raw machine translation output.

A translation memory consists of text segments in a source language and their translations into one or more target languages. These segments can be blocks, paragraphs, sentences, or phrases. Individual words are handled by terminology bases and are not within the domain of TM.

Research indicates that many companies producing multilingual documentation are using translation memory systems.

Contents

[edit] Using translation memories

A translator first supplies a source text (that is, a text to be translated) to the translation memory. The program will then scan the text, trying to find segments in its database that it will use to generate a partly translated output text. This text is presented to the translator for review. The translator can accept the suggestion, reject it or make modifications and use the modified version. In this case, the modified version is recorded and saved in the database.

Some translation memories systems attempt only literal matching, that is to say that they can only retrieve segments of text that match entries in the database exactly, while others employ fuzzy matching algorithms to retrieve similar segments, which are presented to the translator with differences flagged.

The flexibility and robustness of the matching algorithm largely determine the performance of the translation memory, although for some applications the recall rate of exact matches can be high enough to justify the literal approach.

Segments where no match is found will have to be translated by the translator manually. These new segments are stored in the database where they can be used for future translations.

Translation memories work best on texts which are highly repetitive, such as technical manuals. They are also helpful for making incremental changes to texts, corresponding, for example, to minor product changes. Traditionally, translation memories have not been considered appropriate for literary or creative texts, for the simple reason that there is so little repetition in the language used. However, others find them of value even for non-repetitive texts, because the database resources created have value for concordance searches to determine appropriate usage of terms.

If a translation memory system is used consistently on appropriate texts over a period of time, it can save translators considerable work.

[edit] Main benefits

Translation memory managers are most suitable for translating technical documentation and documents containing specialized vocabularies. Their benefits include:

  • Ensuring that the translated documents are consistent, including common definitions, phrasings and terminology. This is important when different translators are working on a single project.
  • Accelerating the overall translation process; since translation memories "remember" previously translated material, translators have to translate it only once.
  • Reducing costs of long-term translation projects; for example the text of manuals, warning messages or series of documents needs to be translated only once and can be used several times.
  • For large documentation projects, savings (in time or money) thanks to the use of a TM package may already be apparent even for the first translation of a new project, but normally such savings are only apparent when translating subsequent versions of a project that was translated before using translation memory.

[edit] Main obstacles

The main problems hindering wider use of translation memory managers include:

  • The concept of "translation memories" is based on the premise that sentences used in previous translations can be "recycled". However, a guiding principle of translation is that the translator must translate the message of the text, and not its component sentences.
  • Translation memory managers do not easily fit into existing translation or localization processes. In order to take advantages of TM technology, the translation processes must be redesigned.
  • Translation memory managers do not presently support all documentation formats, and filters may not exist to support all file types.
  • There is a learning curve associated with using translation memory managers, and the programs must be customized for greatest effectiveness.
  • In cases where all or part of the translation process is outsourced or handled by freelance translators working off-site, the off-site workers require special tools to be able to work with the texts generated by the translation memory manager.
  • Full versions of many translation memory managers can cost from US$500 to US$2,500 per seat, which can represent a considerable investment (although lower cost programs are also available). However, some developers produce free or low-cost versions of their tools with reduced feature sets that individual translators can use to work on projects set up with full versions of those tools. (Note that there are freeware and shareware TM packages available, but none of these has yet gained a large market share.)
  • The costs involved in importing the user's past translations into the translation memory database, training, as well as any add-on products may also represent a considerable investment.
  • Maintenance of translation memory databases still tends to be a manual process in most cases, and failure to maintain them can result in significantly decreased usability and quality of TM matches.
  • As stated previously, translation memory managers may not be suitable for text that lacks internal repetition or which does not contain unchanged portions between revisions. Technical text is generally best suited for translation memory, while marketing or creative texts will be less suitable.
  • The quality of the text recorded in the translation memory is not guaranteed; if the translation for particular segment is incorrect, it is in fact more likely that the incorrect translation will be reused the next time the same source text, or a similar source text, is translated, thereby perpetuating the error.
  • There is also a potential, and, if present, probably an unconscious effect on the translated text. Different languages use different sequences for the logical elements within a sentence and a translator presented with a multiple clause sentence that is half translated is less likely to completely rebuild a sentence.
  • Translation memories also raise certain industrial relations issues as they make exploitation of human translators easier.

[edit] Functions of a translation memory

The following is a summary of the main functions of a Translation Memory, as described on Design and function of translation memory.

[edit] Off-line functions

[edit] Import

This function is used to transfer a text and its translation from a text file to the TM. Import can be done from a raw format, in which an external source text is available for importing into a TM along with its translation. Sometimes the texts have to be reprocessed by the user. There is another format that can be used to import: the native format. This format is the one that uses the TM to save translation memories in a file.

[edit] Analysis

The process of analysis is developed through the following steps:

Textual parsing
It is very important to recognize punctuation in order to distinguish for example the end of sentence from abbreviation. Thus, mark-up is a kind of pre-editing. Usually, the materials which have been processed through translators' aid programs contain mark-up, as the translation stage is embedded in a multilingual document production line. Other special text elements may be set off by mark-up. There are special elements which do not need to be translated, such as proper names and codes, while others may need to be converted to native format.
Linguistic parsing
The base form reduction is used to prepare lists of words and a text for automatic retrieval of terms from a term bank. On the other hand, syntactic parsing may be used to extract multi-word terms or phraseology from a source text. So parsing is used to normalise word order variation of phraseology, this is which words can form a phrase.
Segmentation
Its purpose is to choose the most useful translation units. Segmentation is like a type of parsing. It is done monolingually using superficial parsing and alignment is based on segmentation. If the translators correct the segmentations manually, later versions of the document will not find matches against the TM based on the corrected segmentation because the program will repeat its own errors. Translators usually proceed sentence by sentence, although the translation of one sentence may depend on the translation of the surrounding ones.
Alignment
It is the task of defining translation correspondences between source and target texts. There should be feedback from alignment to segmentation and a good alignment algorithm should be able to correct initial segmentation.
Term extraction
It can have as input a previous dictionary. Moreover, when extracting unknown terms, it can use parsing based on text statistics. These are used to estimate the amount of work involved in a translation job. This is very useful for planning and scheduling the work. Translation statistics usually count the words and estimate the amount of repetition in the text.

[edit] Export

Export transfers the text from the TM into an external text file. Import and export should be inverses.

[edit] Online functions

When translating, one of the main purposes of the TM is to retrieve the most useful correspondences in the memory so that the translator can choose the best one. The TM must show both the source and target text pointing out the identities and differences.

[edit] Retrieval

It is possible to retrieve from the TM one or more matching correspondences.

Exact match
Exact matches appear when the match between the current source segment and the stored one has been a character by character match. When translating a sentence, an exact match means the same sentence has been translated before. Exact matches are also called "100% matches".
In Context Exact (ICE) match
An ICE match is an exact match that occurs in exactly the same context, that is, the same location in a paragraph. Context is often defined by the surrounding sentences and attributes such as document file name, date, and permissions.
Fuzzy match
When the match has not been exact, it is a "fuzzy" match. Some systems assign percentages to these kinds of matches, in which case a fuzzy match is greater than 0% and less than 100%. Those figures are not comparable across systems unless the method of scoring is specified.

[edit] Updating

A TM is updated with a new translation when it has been accepted by the translator. As always in updating a database, there is the question what to do with the previous contents of the database. A TM can be modified by changing or deleting entries in the TM.

[edit] Automatic translation

Translation memories can do retrieval and substitution automatically without the help of the translator.

Automatic retrieval
A TM features automatic retrieval and evaluation of translation correspondences in a translator's workbench.
Automatic substitution
Exact matches come up in translating new versions of a document. When you translate automatically, you cannot check the translation against the original, so if there are any mistakes in the original, they will carry over.

[edit] Networking

When networking during the translation it is possible to translate a text efficiently together with a group of translators. This way, the translations entered by one translator are available to the others. Moreover, if translation memories are shared before the final translation, the mistakes made by one translator will easily be corrected.

[edit] Text memory

Text memory is a radical innovation in the field of translation memory. Text memory comprises author memory and translation memory. This concept is the basis of the proposed Lisa OSCAR xml:tm standard.

[edit] Author memory

A unique identifier is maintained for each text unit within a document during the authoring cycle. A text unit is a subdivision of text into individual sentence, or the text of a document element if no subdivision is possible.

[edit] Translation memory

The unique identifiers are remembered during translation so that the target language document is 'exactly' aligned at the text unit level. If the source document is subsequently modified, then those text units that have not changed can be directly transferred to the new target version of the document without the need for any translator interaction. This introduces the concept of 'exact' or 'perfect' matching to the translation memory. This improves on the traditional 'leveraged' matching concept of translation memory. xml:tm can also be used for much more focused translation memory matching by providing mechanisms for in-document leveraged and fuzzy matching.

[edit] History of translation memories

The concept behind translation memories is not recent — university research into the concept began in the late 1970s, and the earliest commercializations became available in the late 1980s — but they became commercially viable only in the late 1990s. Originally translation memory systems stored aligned source and target sentences in a database, from which they could be recalled during translation. The problem with this 'leveraged' approach is that there is no guarantee if the new source language sentence is from the same context as the original database sentence. Therefore all 'leveraged' matches require that a translator reviews the memory match for relevance in the new document. Although cheaper than outright translation, this review still carries a cost.

[edit] Recent trends

One recent important innovation is the concept of 'text memory' rather than just translation memory (see Translating XML Documents with xml:tm). This is also the basis of the proposed LISA OSCAR xml:tm standard. Text memory within xml:tm comprises 'author memory' and 'translation memory'. Author memory is used to keep track of changes during the authoring cycle. Translation memory uses the information from author memory to implement much more focused and cost effective translation memory matching. Although primarily targeted at XML documents, xml:tm can be used on any document that can be converted to XLIFF format.

[edit] Second generation translation memories

Much more powerful than first-generation TMs, they include a linguistic analysis engine, use chunk technology to break down segments into intelligent terminological groups, and automatically generate specific glossaries.

[edit] Translation memory and related standards

[edit] TMX

Translation Memory Exchange format. This standard enables the interchange of translation memories between translation suppliers. TMX has been adopted by the translation community as the best way of importing and exporting translation memories. The current version is 1.4b - it allows for the recreation of the original source and target documents from the TMX data.

[edit] TBX

Termbase Exchange format. This standard allows for the interchange of terminology data including detailed lexical information. The framework for TBX is provided by two ISO 12620, ISO 12200 and ISO Committee Draft 16642, known as TMF or Terminological Markup Framework. ISO 12620 provides an inventory of well-defined “data categories” with standardized names that function as data element types or as predefined values. ISO 12200 (also known as MARTIF) provides the basis for the core structure of TBX. TMF includes a structural metamodel for Terminology Markup Languages in general, regardless of which XML style of representation is used.

[edit] SRX

Segmentation Rules Exchange format. SRX is intended to enhance the TMX standard so that translation memory data that is exchanged between applications can be used more effectively. The ability to specify the segmentation rules that were used in the previous translation increases the leveraging that can be achieved.

[edit] GMX

GILT Metrics. GILT stands for (Globalization, Internationalization, Localization, and Translation). The GILT Metrics standard comprises three parts: GMX-V for volume metrics, GMX-C for complexity metrics and GMX-Q for quality metrics. The proposed GILT Metrics standard is tasked with quantifying the workload and quality requirements for any given GILT task.

[edit] OLIF

Open Lexicon Interchange Format. OLIF is an open, XML-compliant standard for the exchange of terminological and lexical data. Although originally intended as a means for the exchange of lexical data between proprietary machine translation lexicons, it has evolved into a more general standard for terminology exchange.

[edit] XLIFF

XML Localisation Interchange File Format. It is intended to provide a single interchange file format that can be understood by any localization provider. XLIFF is the preferred way of exchanging data in XML format in the translation industry.

[edit] TransWS

Translation Web Services. TransWS specifies the calls needed to use Web services for the submission and retrieval of files and messages relating to localization projects. It is intended as a detailed framework for the automation of much of the current localization process by the use of Web Services.

[edit] xml:tm

xml:tm This is a radical new approach to translation memory based on the concept of text memory which comprises author and translation memory. One of the first significant advances in translation memory technology since its inception. xml:tm has been donated to Lisa OSCAR by XML-INTL.

[edit] See also

[edit] Desktop translation memory software

Desktop translation memory tools are typically what individual translators use to complete translations. They are a specialized tool for translation in the same way that a word processor is a specialized tool for writing.

[edit] Free and Open Source Software (FOSS)

  • [OmegaT+], cross-platform computer assisted translation tool suite. No language limitation (source and target), directly supports MS Office 2007 formats in newer version, OpenOffice.org formats, OpenDocument Format, DocBook XML, (X)HTML, HTML Help Compiler files, plain text, java .properties, PO. License: GPL. Suite includes other tools: bi-text aligner/converter into TMX, TMXValidator. Requires: Java JRE
  • OmegaT, multiplatform computer aided translation tool. No language limitation (source and target), supports directly MS Office 2007 formats, OpenOffice.org formats, OpenDocument Format, DocBook XML, (X)HTML, HTML Help Compiler files, plain text, java .properties, PO. License: GPL. Requires: Java JRE
  • Open Language Tools, multiplatform computer aided translation tool. No language limitation (source and target), works with its own format (compressed XLIFF 1.0), round trip convertion provided from HTML, DocBook SGML, JSP, XML (needs configuration file), OpenOffice.org formats, Open Document Format, plain text, PO, java .properties, Java RessourceBundle, Mozilla .DTD ressource files. License: CDDL. Requires Java JRE
  • Transolution, multiplatform computer aided translation tool. No language limitation (source and target), supports XLIFF files, license: GPL, requires: Python

[edit] Freeware

  • AidTrans Studio Basic, Windows computer aided translation tool. No language limitations (source and target). Supports Ms Word 2003 Xml and OpenOffice.ord Writer files (.odt). Free of charge version (limited in function) available. No access to source. Requires .NET
  • Appletrans, Mac OSX computer aided translation tool. No language limitations (source and target). Supports RTF, HTML, XML. No access to source.
  • MemoQ 4Free, Windows computer aided translation tool. Some languages not supported in source (including Japanese, Chinese, Korean). Supports MS formats (.dc, .xls, .ppt, .rtf), HTML, plain text, TTX, Framemaker .mif files. Free of charge version available, no access to source. Requires .NET 2.0

[edit] Non-freeware

[edit] Centralized translation memory -- Commercial

Centralized translation memory systems store TM on a central server. They work together with desktop TM and can increase TM match rates by 30-60% more than the TM leverage attained by desktop TM alone. They export prebuilt "translation kits" or "t-kits" to desktop TM tools. A t-kit contains content to be translated pre-segmented on the central server and a subset of the TM containing all applicable TM matches. Centralized TM is usually part of a globalization management system (GMS), which may also include a centralized terminology database (or glossary), a workflow engine, cost estimation, and other tools.

[edit] References and interesting links

Retrieved from "http://en.wikipedia.org../../../t/r/a/Translation_memory.html"