Please visit Jefferson Lab Event Policies and Guidance before planning your next event: https://www.jlab.org/conference_planning.

May 8 – 12, 2023
Norfolk Waterside Marriott
US/Eastern timezone

Identifying and Understanding Scientific Network Flows

May 8, 2023, 3:00 PM
15m
Norfolk Ballroom III-V (Norfolk Waterside Marriott)

Norfolk Ballroom III-V

Norfolk Waterside Marriott

235 East Main Street Norfolk, VA 23510
Oral Track 1 - Data and Metadata Organization, Management and Access Track 1 - Data and Metadata Organization, Management and Access

Speaker

McKee, Shawn (University of Michigan Physics)

Description

The High-Energy Physics (HEP) and Worldwide LHC Computing Grid (WLCG) communities have faced significant challenges in understanding their global network flows across the world’s research and education (R&E) networks. When critical links, such as transatlantic or transpacific connections, experience high traffic or saturation, it is very challenging to clearly identify which collaborations are generating the traffic and what activity that traffic represents. Without knowing the owner and the purpose of the traffic, we are unable to alert them or mitigate the issue. In general, the HEP and WLCG communities found they have insufficient visibility into which experiments are creating the flows and their purpose. Having such visibility also allows new understanding of scientific workflows and their associated resource use, and allows organizations and network providers to demonstrate the value of their participation

The Research Networking Technical Working Group was formed in the spring of 2020, partially in response to this challenge. The first of its three working areas concerns network visibility; specifically, the use of packet marking or flow marking to identify the owner and associated activity of network traffic. The SciTags initiative was created to push this into production, not just for HEP/WLCG, but for any global users of R&E networks.

We will describe the status of the work to date, including the evolving architecture and tools, as well as our plans to get this capability into production before the next WLCG Network Data Challenge in early 2024.

Consider for long presentation Yes

Primary authors

McKee, Shawn (University of Michigan Physics) Babik, Marian (CERN) Chown, Tim (Jisc) Hanushevsky, Andrew (SLAC National Accelerator Laboratory) Dr Sullivan, Tristan (University of Victoria) Hoeft, Bruno (Karlsruhe Institute of Technology (KIT)) Letts, James (University of California, San Diego) Carder, Dale (ESnet) Attebury, Garhan (University of Nebraska) Lambert, Michael (Pittsburgh Supercomputing Center) Newell, Karl (Internet2)

Presentation materials

Peer reviewing

Paper