Publications

Optimizing grid-based workflow execution

Abstract

Large-scale applications can be expressed as a set of tasks with data dependencies between them, also known as application workflows. Due to the scale and data processing requirements of these applications, they require Grid computing and storage resources. So far, the focus has been on developing easy to use interfaces for composing these workflows and finding an optimal mapping of tasks in the workflow to the Grid resources in order to minimize the completion time of the application. After this mapping is done, a workflow execution engine is required to run the workflow over the mapped resources. In this paper, we show that the performance of the workflow execution engine in executing the workflow can also be a critical factor in determining the workflow completion time. Using Condor as the workflow execution engine, we examine the various factors that affect the completion time of a fine …

Date
January 1, 1970
Authors
Gurmeet Singh, Carl Kesselman, Ewa Deelman
Journal
Journal of Grid Computing
Volume
3
Pages
201-219
Publisher
Springer Netherlands