TY - GEN
T1 - Exploring the optimal strategy for large-scale data movement in high-performance networks
AU - Brown, Patrick
AU - Zhu, Mengxia
AU - Wu, Qishi
AU - Yun, Daqing
AU - Zurawski, Jason
PY - 2012
Y1 - 2012
N2 - Advanced networking technologies and services have been rapidly developed and deployed to facilitate bulk data transfer so as to support next-generation eScience applications. However, these technologies and services have not been fully utilized due to the knowledge lack of scientific domain experts. By leveraging the functionalities of an existing data movement advising utility, we propose a new Workflow-based Intelligent Network Data Movement Advisor (WINDMA) with end-to-end performance optimization. WINDMA provides a web interface and interacts with existing data/space management and discovery services such as Storage Resource Management, transport methods such as GridFTP and GlobusOnline, and network resource provisioning brokers such as ION and OSCARS. Efficacy of WINDMA has been demonstrated in several use cases based on its implementation and deployment in wide-area networks.
AB - Advanced networking technologies and services have been rapidly developed and deployed to facilitate bulk data transfer so as to support next-generation eScience applications. However, these technologies and services have not been fully utilized due to the knowledge lack of scientific domain experts. By leveraging the functionalities of an existing data movement advising utility, we propose a new Workflow-based Intelligent Network Data Movement Advisor (WINDMA) with end-to-end performance optimization. WINDMA provides a web interface and interacts with existing data/space management and discovery services such as Storage Resource Management, transport methods such as GridFTP and GlobusOnline, and network resource provisioning brokers such as ION and OSCARS. Efficacy of WINDMA has been demonstrated in several use cases based on its implementation and deployment in wide-area networks.
KW - High-performance networks
KW - eScience applications
KW - large data transfer
UR - http://www.scopus.com/inward/record.url?scp=84874305124&partnerID=8YFLogxK
U2 - 10.1109/PCCC.2012.6407676
DO - 10.1109/PCCC.2012.6407676
M3 - Conference contribution
AN - SCOPUS:84874305124
SN - 9781467348812
T3 - 2012 IEEE 31st International Performance Computing and Communications Conference, IPCCC 2012
SP - 181
EP - 182
BT - 2012 IEEE 31st International Performance Computing and Communications Conference, IPCCC 2012
T2 - 2012 IEEE 31st International Performance Computing and Communications Conference, IPCCC 2012
Y2 - 1 December 2012 through 3 December 2012
ER -