How does Avodah provide Quality Assurance?

Avodah provides quality assurance by incorporating the following practices into our process:

  • The teams compare multiple versions of the same translation to determine the best of several AI-trained models to produce a machine translation
  • We ask our teams to rate each new machine translation and compare earlier ratings with later ratings, tracking improvements in quality
  • We measure the Translation Edit Rate in each machine translation and compare them
  • Team members perform peer review of each other's translation or editing work
  • Certified Bible Translation Consultants meet with the teams quarterly to assess the quality of the machine translation and also to provide some coaching in translation principles and exegesis
  • The drafts are taken through a Community Check process
  • The drafts are taken through a Consultant Check process