A Hierarchical Gradient Tracking Algorithm for Mitigating Subnet-Drift in Fog Learning Networks

A Hierarchical Gradient Tracking Algorithm for Mitigating Subnet-Drift in Fog Learning Networks

• Introduces SD‑GT, a semi‑decentralized gradient‑tracking method for fog‑based federated learning. • Eliminates gradient‑diversity assumptions, enabling robust training across hig

Ringleader ASGD: The First Asynchronous SGD with Optimal Time Complexity under Data Heterogeneity

Ringleader ASGD: The First Asynchronous SGD with Optimal Time Complexity under Data Heterogeneity

• Introduces Ringleader ASGD, the first asynchronous SGD achieving optimal time complexity under data heterogeneity. • Eliminates unrealistic similarity assumptions across workers'