Abstract

Leveraging Dynamic Resource Provisioning and In-network Processing for Scientific Workflows Operating on Huge Data (Presentation Page 1 Leveraging Dynamic Resource Provisioning and In-network Processing for Scientific Workflows Operating on Huge Data Funded by the National Science Foundation Grant #1826997 Anirban Mandal, Cong Wang, Paul Ruth, Komal Thareja (RENCI, UNC – Chapel Hill) Ewa Deelman, George Papadimitriou (USC/ISI) Michael Zink, Eric Lyons (UMass Amherst) Page 2 Extreme Weather Events Cause Severe Property Damage and Life Loss Page 3 CASA DFW Radar Network • > 7M people, >100K businesses, >1500 Corporate HQs Page 4 Major challenges: • distributed repositories • data movement across diverse infrastructure • complex workflows • near real-time time constraints • elastic application compute/storage/network requirements Challenges Page 5 DyNamo Platform …

Date

2020

Authors

Anirban Mandal, Cong Wang, Paul Ruth, Komal Thareja, Ewa Deelman, George Papadimitriou, Michael Zink, Eric Lyons