Publications
Data Grid tools: enabling science on big distributed data
Abstract
A particularly demanding and important challenge that we face as we attempt to construct the distributed computing machinery required to support SciDAC goals is the efficient, high-performance, reliable, secure, and policy-aware management of large-scale data movement. This problem is fundamental to diverse application domains including experimental physics (high energy physics, nuclear physics, light sources), simulation science (climate, computational chemistry, fusion, astrophysics), and large-scale collaboration. In each case, highly distributed user communities require high-speed access to valuable data, whether for visualization or analysis. The quantities of data involved (terabytes to petabytes), the scale of the demand (hundreds or thousands of users, data-intensive analyses, real-time constraints), and the complexity of the infrastructure that must be managed (networks, tertiary storage systems …
- Date
- December 17, 2025
- Authors
- Bill Allcock, Ann Chervenak, Ian Foster, Carl Kesselman, Miron Livny
- Journal
- Journal of Physics: Conference Series
- Volume
- 16
- Issue
- 1
- Pages
- 571
- Publisher
- IOP Publishing