Direct MT

Definition

The simplest MT systems perform direct replacement of terms and phrases in the source language with target language equivalents. In addition, rudimentary word order changes may often be performed.

Metrics

Metric: The developer should provide a description of the theory and method of translation used by the system. -- Method: Receipt and review of the specification of method. -- Measurement: Yes or no: Is the system a direct translation system?

Metric: The form and number of substitutions -- Method: Receipt and review of the form and number of substitutions -- Measurement: 1) Yes or no: Does the description of the substitution forms exist? 2) What are the number of substitution rules?

Metric: Number of reordering operations -- Method: Receipt and review of the reordering operations list -- Measurement: Yes or no: Description of reordering operations exists?

Metric: Types of reordering operations -- Method: Receipt and review of the reordering operations list -- Measurement: Count number of reordering operations possible

Metric: Coverage of reordering operations -- Method: Test suite application -- Measurement: Number of advertised reordering operations that are carried out successfully.

Metric: Relaxation capacity or wildcard processing -- Method: Test suite application -- Measurement: Number of test suite items that are processed successfully

Metric: Ease of adding or changing substitutions -- Method: -- Measurement:

References

Notes

Note that the test suite methods mentioned here test whether the system process a particular rule, combination without measuring or addressing the overall quality as defined in section 2.2