Skip to content

Quality Metrics

Evaluate translation quality independently of the translation endpoints—useful for QA pipelines or scoring translations produced outside Algebras. Algebras offers four complementary evaluation methods across three focused pages, each measuring different aspects of translation excellence.

Fluency Evaluation

Three methods to assess how naturally a translation reads in the target language: dimension-based scoring, batch processing, and MQM-style error evaluation.

Best for: Naturalness, readability, language quality across five dimensions (idiomatic, collocational, discourse, pragmatic, calque).

GEMBA Quality Scoring

Scores meaning preservation and grammatical correctness on a 0-100 scale, optionally calibrated with a human reference.

Best for: Overall translation quality assessment when you need a single 0-100 score.

Multi-Metric Evaluation

Run up to five standard MT quality metrics in one call: GEMBA-MQM, GEMBA-ESA, chrF, BLEU, and COMET—each with its own scale and methodology.

Best for: Comprehensive QA when you need multiple perspectives, research, or specific metric requirements.

Method Endpoint Single Item Batch Reference Needed Scale Best For
Fluency /fluency-score ✓ — no 1-10 / dimensions Readability assessment
Fluency Batch /fluency-batch — ✓ (20 max) no 1-10 / dimensions Bulk fluency checks
Fluency (MQM) /fluency-mqm ✓ — no 0-100 Detailed error analysis
GEMBA /gemba ✓ — optional 0-100 Single quality score
Multi-Metric /metrics ✓ — optional varies Multiple perspectives

For complete QA coverage, pair these metrics with the Term Counter:

  • Metrics endpoints → Evaluate translation quality (naturalness, fluency, accuracy)
  • Term Counter → Validate translation consistency with your glossary

Together they ensure translations are both high-quality AND follow your terminology standards.

  1. Start simple: Try Fluency Evaluation with /fluency-score for a quick quality check
  2. Scale up: Use Fluency Batch with /fluency-batch for bulk processing
  3. Deep analysis: Explore Multi-Metric Evaluation with /metrics for research or detailed QA
  4. Calibrated scoring: Use GEMBA Quality Scoring with a reference translation for the most accurate 0-100 score

All endpoints charge a flat 10 words per call (or per metric in multi-metric mode).