The rater is usually trained in applying the scale before they rate real samples of language.
Example
The IELTS exam is an example of an exam that uses a rating scale.
In the classroom
Developing - or adapting- a good rating scale can improve evaluation of learners by providing clear and consistent criteria. These can also be communicated to the learners themselves and form part of a syllabus structure or portfolio. Learners can rate their own, or a classmate's work against a rating scale to help them become more aware of what is important to work on.
Further links:
https://www.teachingenglish.org.uk/article/kishore-roy-ielts-speaking-test
https://www.teachingenglish.org.uk/article/evaluating-speaking-ielts-speaking-test
https://www.teachingenglish.org.uk/article/developing-efficient-reading-skills-ielts