Publications

Data Grid tools: enabling science on big distributed data

Abstract

A particularly demanding and important challenge that we face as we attempt to construct the distributed computing machinery required to support SciDAC goals is the efficient, high-performance, reliable, secure, and policy-aware management of large-scale data movement. This problem is fundamental to diverse application domains including experimental physics (high energy physics, nuclear physics, light sources), simulation science (climate, computational chemistry, fusion, astrophysics), and large-scale collaboration. In each case, highly distributed user communities require high-speed access to valuable data, whether for visualization or analysis. The quantities of data involved (terabytes to petabytes), the scale of the demand (hundreds or thousands of users, data-intensive analyses, real-time constraints), and the complexity of the infrastructure that must be managed (networks, tertiary storage systems …

Date
December 17, 2025
Authors
Bill Allcock, Ann Chervenak, Ian Foster, Carl Kesselman, Miron Livny
Journal
Journal of Physics: Conference Series
Volume
16
Issue
1
Pages
571
Publisher
IOP Publishing