Asset Details
Do you wish to reserve the book?
PRIME: Pseudo-Random Integrated Multi-Part Entropy for Adaptive Packet Spraying in AI/ML Data centers
Hey, we have placed the reservation for you!
By the way, why not check out events that you can attend while you pick your title.
Oops! Something went wrong.
Looks like we were not able to place the reservation. Kindly try again later.
Are you sure you want to remove the book from the shelf?
PRIME: Pseudo-Random Integrated Multi-Part Entropy for Adaptive Packet Spraying in AI/ML Data centers
Do you wish to request the book?
PRIME: Pseudo-Random Integrated Multi-Part Entropy for Adaptive Packet Spraying in AI/ML Data centers
Please be aware that the book you have requested cannot be checked out. If you would like to checkout this book, you can reserve another copy
We have requested the book for you!
Your request is successful and it will be processed during the Library working hours. Please check the status of your request in My Requests.
Oops! Something went wrong.
Looks like we were not able to place your request. Kindly try again later.
Paper
PRIME: Pseudo-Random Integrated Multi-Part Entropy for Adaptive Packet Spraying in AI/ML Data centers
2025
Overview
Large-scale distributed training in production data centers place significant demands on network infrastructure. In particular, significant load balancing challenges arise when processing AI/ML workloads, consisting of low-entropy, bursty and long-lived flows. Existing solutions designed for Ethernet, such as Equal-Cost Multi-Path (ECMP) struggle to maintain high network utilization. While major industry players (e.g., Ultra Ethernet Consortium) and parts of academia have proposed packet spraying to enhance AI/ML workload performance, we argue that existing packet spraying solutions lead to buffer inflation over time, negatively affecting network performance. Specifically, when ACK coalescing is used, these solutions lead to stale information, degrading network performance. Additionally, in asymmetric network conditions- such as mix of ordered an unordered traffic, or link degradation and failures- existing packet spraying solutions often lead to increased tail latency. In this paper, we present the design and evaluation of PRIME, a pseudo-randomized round-robin approach to packet spraying that considers the network topology to optimize load distribution and performance. PRIME uses congestion as an indicator to re-balance the load. To this extent, PRIME takes into account various congestion signals, accounting for congestion severity, and their decay times to avoid network hotspots. We extensively evaluated PRIME using large-scale production-level simulator. Our results indicate that, compared to existing solutions, PRIME leads to up to 15% improvement for permutation traffic and up to 27% improvement in network degradation scenarios
Publisher
Cornell University Library, arXiv.org
Subject
