Ringleader ASGD: The First Asynchronous SGD with Optimal Time Complexity under Data Heterogeneity
• Introduces Ringleader ASGD, the first asynchronous SGD achieving optimal time complexity under data heterogeneity. • Eliminates unrealistic similarity assumptions across workers'