At CLEAR Global / Translators without Borders we assess quality using the harmonized Dynamic Quality Framework - Multidimensional Quality Metrics (DQF-MQM) error typology.
We use a simplified version of this error typology with five error categories. Each category includes specific issues that should be considered when we work on a project.
Find below more information on how we score for terminology.
Terminology. We want to make sure that the keywords and phrases are translated accurately and consistently.
Here are some of the most relevant terminology issues:
- incorrect terminology for a given domain or context
- glossary or termbase entries are not followed
- inconsistent terminology used for one term throughout the text
How to score terminology?
Make sure you are classifying the issues in the correct category and consider the impact those issues have on the target text. Are they significant? How do they impact the understanding by the target audience?
Keep in mind you are scoring your colleague’s whole chunk or translation. It is important to provide a fair assessment of the complete work.
Make sure you praise exceptional work! 
It is also important to leave a comment about the category together with the score, so your peer can understand the feedback. This is particularly vital when leaving low scores. If you were to receive that score yourself, you would surely appreciate a colleague who also took the time to be helpful!
We know this is not easy, so we put together a few ideas on what each level might mean to guide you on how to decide on a score:
5 Stars: Excellent. There might be a minor slip or two, but no major issues with terminology choices and meaning, consistency, or adherence to the glossary.
4 Stars: Good. Overall, terminology was consistent and adhered to the glossary. Just some minor slips, and the occasional issues with terminology choices and meaning.
3 Stars: Satisfactory. The translation followed the correct terminology for the most part but there were a few issues. Usage of terms was not always consistent, and some glossary entries were not used.
2 Stars: Needs work. There were numerous issues with terminology that impacted the target translation. Terms were not always consistent, and some glossary entries were not used.
1 Star: Poor. The appropriate target terms were not used. There were different translations for the same term across the document. The glossary provided was not used.
This is meant as guidance, and there will be situations where not all conditions apply. You should always look at the specific case in front of you to decide!