Scoring Configuration

Overview

In the Scoring Configuration step, you can create and modify the following:

  • Scoring Settings – Determine the pass or fail threshold for the selected quality program.

  • Scorecards – Define how types of translation errors are scored based on document metadata values. 

Scoring Settings

You can set up your scoring configuration with the following options:

  • Document Field - This is the metadata field that will be evaluated when the Workbench chooses which scorecard to use for the current document.

  • Calculate Based On - select from the following options:

    • Source Word Count - the system calculates the scoring according to the source word count.

    • Target Weighted Word Count - the system calculates the scoring according to the target weighted word count.

  • Points Method - select from the following options:

    • Weighted takes into account the weight given for each error type.

    • Total disregards the weights assigned to error types. 

  • Standard Word Count - This is used with your Passing Score to calculate how many error points (weighted or total) are allowed on a document before it fails. 

    A Standard Word Count of 1,000 words and a Passing Score of 95 would mean that a document could have up to 50 total error points before it fails the quality threshold. 

  • Minimum Word Count - Enter the minimum word count for a document.
    A Standard Word Count of 1,000 words and a Passing Score of 95 would mean that a document could have up to 50 total error points before it fails the quality threshold. 

  • Passing Score - Enter the passing score for your quality program.

Scorecards

Scorecards in TMS show reviewers how documents and projects are scored according to document metadata values.

To create a scorecard, follow these steps:

  1. Click the Add symbol, and when an empty scorecard board opens, click the pencil symbol to rename the scorecard.

  2. In the Document Field section, enter the document metadata that will be evaluated when choosing scorecards. For each scorecard, choose the values that need to be matched on the document to use that scorecard. 

  3. Using the grid, assign the number of points that should be docked for each error type and severity combination.

    1. Each row in the grid is an Error Type. 

    2. There is a column for each severity as well as a column for the Weight that should be assigned to the error type. 

    3. Enter the number of points that should be docked for each error type and severity. If the same number of points should be docked for every error type and severity, use the copy-down icon to push the points down the column. 

  4. If you are using the Weighted points method, assign a weight to each error Type in order to make the Error Type more or less important. It is calculated in percentages. The copy-down icon can also be used for this column. 

    1. If a low severity locale violation penalizes one point on errors and has a weight of two (200%) then any errors will be penalized two points. (1 x 200% = 2)

    2. If a high severity Terminology violation penalizes four points and has a weight of 0.5 (50%) then any errors will penalize two points. (4 x 50% = 2)

  5. Click SAVE to save the details of your quality program.
    Saving will not make the quality program accessible to Reviewers in the Workbench. The quality program has to be published first.

If you create multiple scorecards, select the Default Scorecard checkbox to set any of them as the default. The selected scorecard is used if the metadata value of the document doesn't match any of the metadata values specified in your scorecards.

On this page:

Need Support?

Visit the Lingotek Support Center.