Projects per year
Federated Edge Learning (FEL) enables a massive number of edge devices (e.g. smart phones) to train machine learning models collaboratively. Due to the inherent unreliability of participating edge devices and the unpredictable network conditions, the final model accuracy is largely determined by the communication time between edge devices and the parameter server (PS). However, there exists very limited work to quantify the influence of the communication time in FEL and show how to minimize its negative impacts from a theoretic perspective. In this paper, we are among the first to develop a formal model of the communication time in FEL and its influence on the final model accuracy. In our work, the set of edge devices involved in each global iteration is defined as the ECP (Engaged Client Pool). We model the communication time cost as a function with respect to the response time distribution of individual devices and the ECP size. By incorporating communication time cost into the convergence rate analysis, we propose the ECPA and H-ECPA algorithms to automatically adjust the size of the ECP so as to maximize the model accuracy in both homogeneous and heterogeneous networks. We also analyze how the tail shape of response time affects the convergence rate, and prove that the heavy tail shape can significantly lower the model accuracy. Finally, we conduct extensive experiments with real datasets, and the results confirm the correctness of our analysis and demonstrate the superiority of our proposed algorithms.
|Number of pages||14|
|Journal||IEEE Transactions on Vehicular Technology|
|Early online date||20 Jan 2022|
|Publication status||Published - Mar 2022|
- Analytical models
- communication time
- Computational modeling
- Federated edge learning
- model accuracy
- response time
- Time factors
FingerprintDive into the research topics of 'The role of communication time in the convergence of federated edge learning'. Together they form a unique fingerprint.
UNSW led : Robust Preference Inference from Spatial-Temporal Interaction Networks
Yao, L., Sheng, M. & Benatallah, B.
1/04/21 → 31/03/24
Building Intelligence into Online Video Services by Learning User Interests
29/06/18 → 28/06/21