COMET: High-quality Machine Translation Evaluation

What is COMET

COMET is an open-source framework for MT evaluation that can be used for two purposes:

• To evaluate MT systems with our currently available high-performing metrics (check: COMET Metrics).
• To train and develop new metrics.

Contents:

• Installation
• Running COMET
  • Command Line Interface
  • Using Python
• COMET Metrics
• Train your own Metric
  • Data Format
  • Training flags

License

Free software: Apache License 2.0

Citation

If you use COMET to evaluate your MT system or to develop new metrics please cite the following paper: COMET: A Neural Framework for MT Evaluation

Library Reference

• Library Reference
  • Multilingual Encoders
  • Model Base
  • Estimators
  • Translation Ranking Model
  • Auxiliar Modules