AI Quality Evaluation
- Vishnuvardhan Kanagaraj
Guide to Using AI Quality Evaluation for Translation Evaluation
Overview
AI Quality Evaluation is an AI-powered tool designed to help businesses quickly and accurately assess the quality of their translations and other content. By combining AI efficiency with human expertise, we ensure your content consistently meets the highest standards. This tool evaluates uploaded content, speeds up the process, and guarantees accuracy while reducing costs.
Purpose
The primary function of AI Quality Evaluation is to serve as a quality checker for translations within your project workflow. Once a document is uploaded and translated, the tool evaluates the content using AI tokens, which are consumed during the process. Based on the quality score and the types of content evaluated, users can determine whether additional human review is necessary.
Features
AI Quality Evaluation can be integrated as a step in your project workflow templates or added to existing projects.
Users can purchase AI Quality Evaluation jobs based on the token costs required to evaluate the content.
Quality evaluation results gives a preview of the segments categorised by the AI system.
AI Quality Evaluation provides support for 156 languages on the Enterprise platform.
Supported Languages: https://lingotek.atlassian.net/wiki/x/BgCdwg
Supported File Formats: https://lingotek.atlassian.net/wiki/x/BoCgwg
Steps to Use AI Quality Evaluation
1. Creating Project Workflow Templates with AI Quality Evaluation
a) AI Quality Evaluation is a system phase. You need a workflow template with this phase step to use the feature.
b) Go to Templates → Workflow Templates to create a new workflow template by selecting the ‘+’ icon.
c) We recommend placing the AI Quality Evaluation phase after a Leverage TM and/or Machine Translate phase.
d) Alternatively, you can add the AI Quality Evaluation phase as a custom phase to an existing project workflow.
2. Create and Upload the Document
a) Create a new project using a workflow template that includes AI Quality Evaluation as a system phase step.
b) Upload a document that meets the supported file type requirements, or input the content which is converted and processed text file (.txt).
c) Select the target language(s) supported by AI Quality Evaluation.
3. Quality Evaluation Purchase and Process
a) The uploaded content will undergo the Leverage TM and/or Machine Translate phases according to the project workflow.
b) Once translated, the content is sent to AI Quality Evaluation for an automated review. The system will generate a token cost.
c) The token balance is associated with the Community and can be viewed in the Document Summary section.
d) The token cost is displayed in the Resources column for the AI Quality Evaluation phase, alongside the target language.
e) To proceed with the quality evaluation, click the Purchase AI Quality Evaluation action.
f) After purchasing, the quality evaluation process starts. Once complete, the quality score will be displayed as a percentage in the Resources column.
g) Clicking the score will display a breakdown of segments evaluated by the AI, categorised as:
Best
Good
Acceptable
Bad
No Score
Untranslated
h) Depending on the quality evaluation results, users can configure further human review phases as and when required.
By following these steps, you can seamlessly integrate AI Quality Evaluation into your translation workflow, ensuring fast, accurate content reviews and improved translation quality management.
AI Quality Evaluation Setup
AI Quality Evaluation Document Upload and Process
