Published July 2022 | Version Published
Conference Paper Open

Integrating End-to-End Exascale SDN into the LHC Data Distribution Cyberinfrastructure

Abstract

The Compact Muon Solenoid (CMS) experiment at the CERN Large Hadron Collider (LHC) distributes its data by leveraging a diverse array of National Research and Education Networks (NRENs), which CMS is forced to treat as an opaque resource. Consequently, CMS sees highly variable performance that already poses a challenge for operators coordinating the movement of petabytes around the globe. This kind of unpredictability, however, threatens CMS with a logistical nightmare as it barrels towards the High Luminosity LHC (HL-LHC) era in 2030, which is expected to produce roughly 0.5 exabytes of data per year. This paper explores one potential solution to this issue: software-defined networking (SDN). In particular, the prototypical interoperation of SENSE, an SDN product developed by the Energy Sciences Network, with Rucio, the data management software used by the LHC, is outlined. In addition, this paper presents the current progress in bringing these technologies together.

Additional Information

© 2022 Owner/Author. This work is licensed under a Creative Commons Attribution International 4.0 License. Online: 8 July 2022. This ongoing work is partially supported by the US National Science Foundation (NSF) Grants OAC-2030508, OAC-1841530, OAC-1836650, MPS-1148698, and PHY-1624356. In addition, the development of SENSE is supported by the US Department of Energy (DOE) Grants DE-SC0015527, DE-SC0015528, DE-SC0016585, and FP-00002494. Finally, this work would not be possible without the significant contributions of collaborators at ESNet, Caltech, and SDSC.

Attached Files

Published - 3491418.3535134.pdf

Files

3491418.3535134.pdf

Files (1.0 MB)

Name Size
md5:b7e49433d3d3becfe75576ede44b3f00
1.0 MB Preview Download

Additional details

Identifiers

Eprint ID
115470
Resolver ID
CaltechAUTHORS:20220711-653044000

Funding

NSF
OAC-2030508
NSF
OAC-1841530
NSF
OAC-1836650
NSF
MPS-1148698
NSF
PHY-1624356
Department of Energy (DOE)
DE-SC0015527
Department of Energy (DOE)
DE-SC0015528
Department of Energy (DOE)
DE-SC0016585
Department of Energy (DOE)
FP-00002494

Dates

Created
2022-07-12
Created from EPrint's datestamp field
Updated
2022-07-12
Created from EPrint's last_modified field

Caltech Custom Metadata

Caltech groups
CMS@Caltech