Quality Reports

Overview

The Quality Report export (and Excel file) provides one way to look at and analyze the quality data that is being generated throughout the LQE process. The data in the quality report is incredibly valuable for showing trends and increasing quality over time.

The data within the quality report can be sensitive data, so the quality report is what we call "Vendor Aware". This means that in order to see certain parts of the data, it requires that you be a certain role within the community and a certain role within the project from which you're generating the report.

Running a Quality Report

As Project/Quality Manager

Project List

Project managers can run Quality Reports across multiple projects at once by selecting multiple projects and running a quality report from the bulk action menu on the project list. 

To run a quality report, follow these steps:

  1. From the Project List, select the desired projects manually or in bulk using the smart selector. Optionally, you can run the quality report without selecting any projects and all feedback across all projects will be included in the report for the date range you select.

  2. Open the Bulk Actions drop-down on the Project List and select Run Quality Report

  3. Give the report a File Name.

  4. Choose a date range for the report.  

  5. Select Run Report.

  6. A .xlsx file will download with three tabs (Document, Target, and Feedback).

  7. Check the Process Queue to view or access the report.  

Document List

Project and/or Quality Managers can run Quality Reports for all documents in a project by selecting the Run Quality Report from the Actions list in the Project Summary table or in the Document Actions list. 

To run a report, follow these steps:

  1. For specific documents, select the desired documents and then run the quality report using the Document Actions list. 

  2. When either of these options is selected a pop-up will appear. The user needs to select a time frame for the report if they have not selected specific documents before using the Document Actions list.  

  3. Give the report a File Name.

  4. Select Run.
    A .xlsx file is automatically downloaded with three tabs (Document, Target, and Feedback). 

  5. Check the Process Queue to view or access the report. 

As a Linguist

Linguists can run Quality Reports to see the evaluations they received over a period of time in order to review errors, comments, and severities in order to improve in the future. 

To generate a report, follow these steps:

  1. Linguists can run reports on all Tasks assigned to them or select specific tasks. 

  2. Using the Bulk Action menu, select Run Quality Report.

  3. The user must select a time frame for the report if they have not selected specific tasks. 

  4. Give the report a File Name.

  5. Click Run.
    A .xlsx file is automatically downloaded, and it contains one tab (Feedback). 

  6. Check the Process Queue to view or access the report. 

Quality Report Data Access

The following logic defines who has access to the tabs and data within the Quality Report:

Feature

Community Admin

Project Owner

Shared User

Guest Shared User

Community Member (Linguist)

Documents Tab + All Completed Documents

X

X

X

 

 

Targets Tab + All Completed Targets

X

X

X

 

 

Targets Tab + Vendor Organization Specific Completed Targets

X

X

X

X

 

Feedback Tab + All Feedback from Completed Targets

X

X

X

 

 

Feedback Tab + Vendor Organization Feedback from Completed Targets

X

X

X

X

X

Quality Report Contents

The following describes the behavior of the report when the user generating the Quality Report has access to the specific tab in the report, but:

  1. There are no completed Documents or Targets that were completed within the specified date range.

  2. There are completed Documents or Targets that were completed within the specified date range, but the user does not have access to those documents or targets.

Report Tab

Report Message

Document

For the specified report criteria, there are no completed documents that can be included in the report.

Target

For the specified report criteria, there are no completed targets that can be included in the report.

Feedback

For the specified report criteria, there are no completed targets, therefore there is no feedback to be displayed.

Some data in the Document and Target tabs of the report will have more than one data point within a single cell. Especially if more than one person is leaving quality feedback, creating translations, or you have multiple LQE phases. 

Using Data for 3rd Party Analytics

The quality report was designed to be easily imported into 3rd party business intelligence applications. Using the data from the Quality Report in 3rd party applications, you can build reports that show quality scores and grades over time, do trending, etc.

Using Microsoft Power BI as an example, to create a Quality Dashboard you simply download a Quality Report using the steps described above, then:

  1. Open Microsoft Power BI

  2. In the Ribbon, click Get Data, then select Excel.

  3. Select the previously downloaded quality report, and then click Open.

  4. When the navigator window appears, select which tabs of the Quality Report you want to import.

    • As described above, the Quality Report consists of different tabs of Quality-related data, specific to Documents, Targets, and the Quality Feedback itself.

    • Microsoft Power BI recognizes the Document, Target, and Feedback worksheets and prompts you as to which sheets of data you want to import

  5. Click Load.

  6. Once it has completed loading, you're ready to start creating your Quality Dashboard.

Dashboard & Reporting Recommendations

Below are some recommendations for tracking and reporting on translation quality, all of which can be provided using the Quality Report:

  1. Quality Scores and Grades

    • Average Quality Score

    • Average Quality Score, by Document Meta (e.g. Content-Type)

    • Average Quality Score, by Vendor

    • Pass/Fail Count

    • Count of Quality Grade, by Document Meta (e.g. Content-Type)

  2. Quality Feedback

    • Count of Feedback

      • by Feedback Category

      • by Feedback Type

      • by Target Locale

      • by Severity

      • by Evaluated Vendor