Example-based models

Definition
Metrics

Metric: The developer should provide a description of the theory and method of translation used by the system. -- Method: The developer should provide white-papers and supporting documentation. -- Measurement: Confirmation of method by study of documentation.

Metric: Size of parallel corpus -- Method: Developer report of parallel corpus size -- Measurement: Size can be reported in terms of bytes, sentence pairs or words per language.

Metric: Accessibility of example corpus -- Method: Specification by developer of corpus accessibility -- Measurement: Yes or no: Corpus is accessible

Metric: Form of examples -- Method: Specification by developer of example formats -- Measurement: Confirmation of example format specifications

Metric: Number of examples -- Method: Counting of examples -- Measurement: Number of examples in corpus

Metric: Source language matching technique -- Method: Specification of source language matching technique and parameters -- Measurement: Yes or no: is specification provided. Also, can use test suite to test coverage and flexiblity of source language technique.

Metric: Ease of extending / adding examples -- Method: Test corpus -- Measurement: Percentage test items that can be added.

References

Hutchins and Somers, 1992.

Somers, 2000

Arnold et al., 1994.

Notes

See also ease of update in section 2.2.5.2.4


View or add comments (409)