Asset Details
Do you wish to reserve the book?
A federated reinforcement learning framework for balancing rapidity and availability in deep space networks
Hey, we have placed the reservation for you!
By the way, why not check out events that you can attend while you pick your title.
Oops! Something went wrong.
Looks like we were not able to place the reservation. Kindly try again later.
Are you sure you want to remove the book from the shelf?
A federated reinforcement learning framework for balancing rapidity and availability in deep space networks
Do you wish to request the book?
A federated reinforcement learning framework for balancing rapidity and availability in deep space networks
Please be aware that the book you have requested cannot be checked out. If you would like to checkout this book, you can reserve another copy
We have requested the book for you!
Your request is successful and it will be processed during the Library working hours. Please check the status of your request in My Requests.
Oops! Something went wrong.
Looks like we were not able to place your request. Kindly try again later.
Journal Article
A federated reinforcement learning framework for balancing rapidity and availability in deep space networks
2026
Overview
Efficient task scheduling is essential for the success of deep space exploration missions, where communication delays, dynamic link availability, and limited on-board resources pose significant challenges. However, existing deep-space scheduling frameworks cannot effectively coordinate multi-agent decisions across interplanetary regions due to long delays, dynamic link conditions, and highly unbalanced resources, resulting in inefficient and unstable task allocation. To address these issues, we propose Fed-ASTRA, a novel scheduling framework that integrates a hierarchical deep space network architecture with federated multi-agent reinforcement learning. In the proposed architecture, base stations such as Earth and Mars ground centers act as regional control centers, orbital satellites function as edge intelligence nodes, and rovers serve as terminal execution units, forming a three-tier collaborative system. This hierarchical organization enables both local autonomy and cross-domain coordination, effectively balancing real-time responsiveness and long-term availability. On the algorithmic side, we model the scheduling process as a multi-agent Markov decision process and design environment-constrained action pruning (ECAP) to filter out infeasible actions caused by link outages, energy thresholds, and deadline violations. In addition, a prioritized experience replay (PER) mechanism improves sample efficiency by emphasizing high-cost task experiences. These enhancements ensure that agents learn feasible and efficient scheduling strategies under severe environmental constraints. We evaluate Fed-ASTRA using a high-fidelity deep space network simulator driven by real orbital data. Experimental results demonstrate that our framework outperforms traditional optimization approaches, heuristic methods, and baseline MARL algorithms in terms of rapidity, availability, fairness, and real-time capability. Overall, this work highlights the potential of combining hierarchical network architectures and federated reinforcement learning to achieve robust and efficient task scheduling in future deep space missions.
Publisher
Springer International Publishing,Springer Nature B.V,Springer
