abstract
- Authors:
- Tianyue Chu IMDEA Networks Institute & University Carlos III of Madrid, Madrid, Spain
IMDEA Networks Institute & University Carlos III of Madrid, Madrid, Spain
Search about this author
- Nikolaos Laoutaris IMDEA Networks Institute, Madrid, Spain
ACM SIGMETRICS Performance Evaluation ReviewVolume 52Issue 1June 2024pp 91–92https://doi.org/10.1145/3673660.3655055
- 0citation
- 2
- Downloads
Metrics
Total Citations0Total Downloads2Last 12 Months2
Last 6 weeks2
- Get Citation Alerts
New Citation Alert added!
This alert has been successfully added and will be sent to:
You will be notified whenever a record that you have chosen has been cited.
To manage your alert preferences, click on the button below.
Manage my Alerts
New Citation Alert!
Please log in to your account
- Publisher Site
- Get Access
ACM SIGMETRICS Performance Evaluation Review
Volume 52, Issue 1
PreviousArticleNextArticle
Abstract
Federated Learning (FL) permits different parties to collaboratively train a global model without disclosing their respective local labels. A crucial step of FL, that of aggregating local models to produce the global one, shares many similarities with public decision-making, and elections in particular. In that context, a major weakness of FL, namely its vulnerability to poisoning attacks, can be interpreted as a consequence of the one person one vote (henceforth 1p1v) principle that underpins most contemporary aggregation rules.
In this paper, we introduce FedQV, a novel aggregation algorithm built upon the quadratic voting, recently proposed as a better alternative to 1p1v-based elections. Our theoretical analysis establishes that FedQV is a truthful mechanism in which bidding according to one's true valuation is a dominant strategy that achieves a convergence rate matching that of state-of-the-art methods. Furthermore, our empirical analysis using multiple real-world datasets validates the superior performance of FedQV against poisoning attacks. It also shows that combining FedQV with unequal voting "budgets'' according to a reputation score increases its performance benefits even further. Finally, we show that FedQV can be easily combined with Byzantine-robust privacy-preserving mechanisms to enhance its robustness against both poisoning and privacy attacks. This extended abstract is an abridged version of [3].
References
- Peva Blanchard, El Mahdi El Mhamdi, Rachid Guerraoui, and Julien Stainer. 2017. Machine Learning with Adversaries: Byzantine Tolerant Gradient Descent. In Advances in Neural Information Processing Systems, I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.), Vol. 30. Long Beach, CA, USA, 119--129.Google Scholar
- Tianyue Chu, Á lvaro Garc'i a-Recuero, Costas Iordanou, Georgios Smaragdakis, and Nikolaos Laoutaris. 2023. Securing Federated Sensitive Topic Classification against Poisoning Attacks. In 30th Annual Network and Distributed System Security Symposium, NDSS 2023. San Diego, California, USA.Google Scholar
Cross Ref
- Tianyue Chu and Nikolaos Laoutaris. 2024. FedQV: Leveraging Quadratic Voting in Federated Learning. Proceedings of the ACM on Measurement and Analysis of Computing Systems, Vol. 8, 2 (2024).Google Scholar
Digital Library
- Andrew Hard, Kanishka Rao, Rajiv Mathews, Francc oise Beaufays, Sean Augenstein, Hubert Eichner, Chloé Kiddon, and Daniel Ramage. [n.,d.]. Federated Learning for Mobile Keyboard Prediction. ( [n.,d.]). showeprint[arXiv]1811.03604 http://arxiv.org/abs/1811.03604Google Scholar
- Steven P Lalley and E Glen Weyl. 2018. Quadratic voting: How mechanism design can radicalize democracy. In AEA Papers and Proceedings, Vol. 108. 33--37.Google Scholar
Cross Ref
- Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas. 2017. Communication-efficient learning of deep networks from decentralized data. In Artificial intelligence and statistics. PMLR, 1273--1282.Google Scholar
- Eric A Posner and E Glen Weyl. 2015. Voting squared: Quadratic voting in democratic politics. Vand. L. Rev. , Vol. 68 (2015), 441.Google Scholar
- Swaroop Ramaswamy, Rajiv Mathews, Kanishka Rao, and Francc oise Beaufays. 2019. Federated learning for emoji prediction in a mobile keyboard. arXiv preprint arXiv:1906.04329 (2019).Google Scholar
- E Glen Weyl. 2017. The robustness of quadratic voting. Public choice, Vol. 172, 1 (2017), 75--107.Google Scholar
- Dong Yin, Yudong Chen, Ramchandran Kannan, and Peter Bartlett. 2018. Byzantine-robust distributed learning: Towards optimal statistical rates. In International Conference on Machine Learning. PMLR, 5650--5659.Google Scholar
Cited By
View all
Index Terms
FedQV: Leveraging Quadratic Voting in Federated Learning
Computing methodologies
Artificial intelligence
Distributed computing methodologies
Machine learning
Security and privacy
Network security
Theory of computation
Design and analysis of algorithms
Theory and algorithms for application domains
Recommendations
- FedQV: Leveraging Quadratic Voting in Federated Learning
POMACS
Federated Learning (FL) permits different parties to collaboratively train a global model without disclosing their respective local labels. A crucial step of FL, that of aggregating local models to produce the global one, shares many similarities with ...
Read More
- FedQV: Leveraging Quadratic Voting in Federated Learning
SIGMETRICS/PERFORMANCE '24: Abstracts of the 2024 ACM SIGMETRICS/IFIP PERFORMANCE Joint International Conference on Measurement and Modeling of Computer Systems
Federated Learning (FL) permits different parties to collaboratively train a global model without disclosing their respective local labels. A crucial step of FL, that of aggregating local models to produce the global one, shares many similarities with ...
Read More
- Survey on federated learning threats: Concepts, taxonomy on attacks and defences, experimental study and challenges
Abstract
Federated learning is a machine learning paradigm that emerges as a solution to the privacy-preservation demands in artificial intelligence. As machine learning, federated learning is threatened by adversarial attacks against the ...
Highlights
- We claim that adversarial attacks are a significant challenge in federated learning.
Read More
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in
Full Access
Get this Article
- Information
- Contributors
Published in
ACM SIGMETRICS Performance Evaluation Review Volume 52, Issue 1
SIGMETRICS '24
June 2024
104 pages
ISSN:0163-5999
DOI:10.1145/3673660
- Editor:
- Bo Ji
Virginia Tech
Issue’s Table of Contents
SIGMETRICS/PERFORMANCE '24: Abstracts of the 2024 ACM SIGMETRICS/IFIP PERFORMANCE Joint International Conference on Measurement and Modeling of Computer Systems
June 2024
120 pages
ISBN:9798400706240
DOI:10.1145/3652963
- General Chairs:
- Michele Garetto
Università di Torino, Italy
, - Andrea Marin
Università Ca' Foscari Venezia, Italy
, - Program Chairs:
- Florin Ciucu
University of Warwick, UK
, - Giulia Fanti
Carnegie Mellon University, USA
, - Rhonda Righter
University of California, Berkeley, USA
Copyright © 2024 Owner/Author
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
- Published: 13 June 2024
Author Tags
- distributed training
- federated learning
Qualifiers
- abstract
Conference
Funding Sources
Other Metrics
View Article Metrics
- Bibliometrics
- Citations0
Article Metrics
- View Citations
Total Citations
2
Total Downloads
- Downloads (Last 12 months)2
- Downloads (Last 6 weeks)2
Other Metrics
View Author Metrics
Cited By
This publication has not been cited yet
PDF Format
View or Download as a PDF file.
eReader
View online with eReader.
eReader
Digital Edition
View this article in digital edition.
View Digital Edition
- Figures
- Other
Close Figure Viewer
Browse AllReturn
Caption
View Issue’s Table of Contents