TY - JOUR
T1 - Multi-attribute auction-based grouped federated learning
AU - Lu, Renhao
AU - Yang, Hongwei
AU - Wang, Yan
AU - He, Hui
AU - Li, Qiong
AU - Zhong, Xiaoxiong
AU - Zhang, Weizhe
PY - 2024
Y1 - 2024
N2 - Federated Learning empowers data owners to collectively train an artificial intelligence model without exposing data. However, the heterogeneous resources and the self-interested users bring new challenges hindering the development of federated learning. To this end, we propose a Multi-attribute Auction-based Grouped Federated Learning scheme, called MAGFL, comprising a grouped federated learning framework and a multi-attribute auction-based group selection strategy. Initially, our grouped federated learning framework clusters clients into groups according to local characteristics. Then, we propose a quality assessment method to assess the quality of each group based on a fuzzy approach. Furthermore, the FL server distributes economic rewards to training clients to motivate more clients to join the FL system, which is likened to a multi-attribute auction market where each group agent bids for training opportunities. Moreover, we design a novel global model update method with added Adam (i.e., Adaptive Moment Estimation) operations into the global update stage, which can fully utilize the local and global update direction to accelerate the convergence rate of scheme MGAFL. Extensive experiments on real-world datasets demonstrate that the proposed scheme outperforms representative federated learning schemes (i.e., FedAvg, FedProx, and FedAvg-Adam) regarding the model's convergence rate and capacity to deal with heterogeneous systems.
AB - Federated Learning empowers data owners to collectively train an artificial intelligence model without exposing data. However, the heterogeneous resources and the self-interested users bring new challenges hindering the development of federated learning. To this end, we propose a Multi-attribute Auction-based Grouped Federated Learning scheme, called MAGFL, comprising a grouped federated learning framework and a multi-attribute auction-based group selection strategy. Initially, our grouped federated learning framework clusters clients into groups according to local characteristics. Then, we propose a quality assessment method to assess the quality of each group based on a fuzzy approach. Furthermore, the FL server distributes economic rewards to training clients to motivate more clients to join the FL system, which is likened to a multi-attribute auction market where each group agent bids for training opportunities. Moreover, we design a novel global model update method with added Adam (i.e., Adaptive Moment Estimation) operations into the global update stage, which can fully utilize the local and global update direction to accelerate the convergence rate of scheme MGAFL. Extensive experiments on real-world datasets demonstrate that the proposed scheme outperforms representative federated learning schemes (i.e., FedAvg, FedProx, and FedAvg-Adam) regarding the model's convergence rate and capacity to deal with heterogeneous systems.
UR - http://www.scopus.com/inward/record.url?scp=85190333679&partnerID=8YFLogxK
U2 - 10.1109/TSC.2024.3387734
DO - 10.1109/TSC.2024.3387734
M3 - Article
AN - SCOPUS:85190333679
SN - 1939-1374
VL - 17
SP - 1056
EP - 1071
JO - IEEE Transactions on Services Computing
JF - IEEE Transactions on Services Computing
IS - 3
ER -