Speaker
Description
The efficiency of high energy physics workflows relies on the ability to rapidly transfer data among the sites where the data is processed and analysed. The best data transfer tools should provide a simple and reliable solution for local, regional, national and in some cases intercontinental data transfers. This work outlines the results of data transfer tool tests using internal and external (simulated latency and packet loss) in 100 Gbps testbeds and compares the results among the existing solutions, while also treating the issue of tuning parameters and methods to help optimize the rates of transfers. Many tools have been developed to facilitate data transfers over wide area networks. However, few studies have shown the tools' requirements, use cases, and reliability through comparative measurements. In this paper, we will evaluate a variety of high-performance data transfer tools used today in the LHC and other scientific communities, such as FDT, WDT, XRootD, GridFTP, mdtm FTP, and NDN in different environments.Furthermore, this paper will use real-world data transfer examples to analyse each tool's strengths and weaknesses. We will test the fault tolerance of the tools when we have partial packet loss. By comparing the tools in a controlled environment, we can shed light on the tool's relative reliability and usability for academia and industry. Also, this paper will highlight the best tuning parameters for WAN and LAN transfers for maximum performance, in several cases.
| Consider for long presentation | No |
|---|
