FedQV: Leveraging Quadratic Voting in Federated Learning (2024)

abstract

  • Authors:
  • Tianyue Chu IMDEA Networks Institute & University Carlos III of Madrid, Madrid, Spain

    IMDEA Networks Institute & University Carlos III of Madrid, Madrid, Spain

    FedQV: Leveraging Quadratic Voting in Federated Learning (1)0000-0003-2178-840X

    Search about this author

    ,
  • Nikolaos Laoutaris IMDEA Networks Institute, Madrid, Spain

    IMDEA Networks Institute, Madrid, Spain

    FedQV: Leveraging Quadratic Voting in Federated Learning (2)0000-0002-7361-106X

    Search about this author

ACM SIGMETRICS Performance Evaluation ReviewVolume 52Issue 1June 2024pp 91–92https://doi.org/10.1145/3673660.3655055

Published:13 June 2024Publication HistoryFedQV: Leveraging Quadratic Voting in Federated Learning (3)

  • 0citation
  • 2
  • Downloads

Metrics

Total Citations0Total Downloads2

Last 12 Months2

Last 6 weeks2

  • Get Citation Alerts

    New Citation Alert added!

    This alert has been successfully added and will be sent to:

    You will be notified whenever a record that you have chosen has been cited.

    To manage your alert preferences, click on the button below.

    Manage my Alerts

    New Citation Alert!

    Please log in to your account

  • Publisher Site
  • Get Access

ACM SIGMETRICS Performance Evaluation Review

Volume 52, Issue 1

PreviousArticleNextArticle

FedQV: Leveraging Quadratic Voting in Federated Learning (4)

Skip Abstract Section

Abstract

Federated Learning (FL) permits different parties to collaboratively train a global model without disclosing their respective local labels. A crucial step of FL, that of aggregating local models to produce the global one, shares many similarities with public decision-making, and elections in particular. In that context, a major weakness of FL, namely its vulnerability to poisoning attacks, can be interpreted as a consequence of the one person one vote (henceforth 1p1v) principle that underpins most contemporary aggregation rules.

In this paper, we introduce FedQV, a novel aggregation algorithm built upon the quadratic voting, recently proposed as a better alternative to 1p1v-based elections. Our theoretical analysis establishes that FedQV is a truthful mechanism in which bidding according to one's true valuation is a dominant strategy that achieves a convergence rate matching that of state-of-the-art methods. Furthermore, our empirical analysis using multiple real-world datasets validates the superior performance of FedQV against poisoning attacks. It also shows that combining FedQV with unequal voting "budgets'' according to a reputation score increases its performance benefits even further. Finally, we show that FedQV can be easily combined with Byzantine-robust privacy-preserving mechanisms to enhance its robustness against both poisoning and privacy attacks. This extended abstract is an abridged version of [3].

References

  1. Peva Blanchard, El Mahdi El Mhamdi, Rachid Guerraoui, and Julien Stainer. 2017. Machine Learning with Adversaries: Byzantine Tolerant Gradient Descent. In Advances in Neural Information Processing Systems, I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.), Vol. 30. Long Beach, CA, USA, 119--129.Google ScholarFedQV: Leveraging Quadratic Voting in Federated Learning (5)
  2. Tianyue Chu, Á lvaro Garc'i a-Recuero, Costas Iordanou, Georgios Smaragdakis, and Nikolaos Laoutaris. 2023. Securing Federated Sensitive Topic Classification against Poisoning Attacks. In 30th Annual Network and Distributed System Security Symposium, NDSS 2023. San Diego, California, USA.Google ScholarFedQV: Leveraging Quadratic Voting in Federated Learning (6)Cross Ref
  3. Tianyue Chu and Nikolaos Laoutaris. 2024. FedQV: Leveraging Quadratic Voting in Federated Learning. Proceedings of the ACM on Measurement and Analysis of Computing Systems, Vol. 8, 2 (2024).Google ScholarFedQV: Leveraging Quadratic Voting in Federated Learning (8)Digital Library
  4. Andrew Hard, Kanishka Rao, Rajiv Mathews, Francc oise Beaufays, Sean Augenstein, Hubert Eichner, Chloé Kiddon, and Daniel Ramage. [n.,d.]. Federated Learning for Mobile Keyboard Prediction. ( [n.,d.]). showeprint[arXiv]1811.03604 http://arxiv.org/abs/1811.03604Google ScholarFedQV: Leveraging Quadratic Voting in Federated Learning (10)
  5. Steven P Lalley and E Glen Weyl. 2018. Quadratic voting: How mechanism design can radicalize democracy. In AEA Papers and Proceedings, Vol. 108. 33--37.Google ScholarFedQV: Leveraging Quadratic Voting in Federated Learning (11)Cross Ref
  6. Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas. 2017. Communication-efficient learning of deep networks from decentralized data. In Artificial intelligence and statistics. PMLR, 1273--1282.Google ScholarFedQV: Leveraging Quadratic Voting in Federated Learning (13)
  7. Eric A Posner and E Glen Weyl. 2015. Voting squared: Quadratic voting in democratic politics. Vand. L. Rev. , Vol. 68 (2015), 441.Google ScholarFedQV: Leveraging Quadratic Voting in Federated Learning (14)
  8. Swaroop Ramaswamy, Rajiv Mathews, Kanishka Rao, and Francc oise Beaufays. 2019. Federated learning for emoji prediction in a mobile keyboard. arXiv preprint arXiv:1906.04329 (2019).Google ScholarFedQV: Leveraging Quadratic Voting in Federated Learning (15)
  9. E Glen Weyl. 2017. The robustness of quadratic voting. Public choice, Vol. 172, 1 (2017), 75--107.Google ScholarFedQV: Leveraging Quadratic Voting in Federated Learning (16)
  10. Dong Yin, Yudong Chen, Ramchandran Kannan, and Peter Bartlett. 2018. Byzantine-robust distributed learning: Towards optimal statistical rates. In International Conference on Machine Learning. PMLR, 5650--5659.Google ScholarFedQV: Leveraging Quadratic Voting in Federated Learning (17)

Cited By

View all

FedQV: Leveraging Quadratic Voting in Federated Learning (18)

    Index Terms

    1. FedQV: Leveraging Quadratic Voting in Federated Learning

      1. Computing methodologies

        1. Artificial intelligence

          1. Distributed computing methodologies

            1. Machine learning

            2. Security and privacy

              1. Network security

              2. Theory of computation

                1. Design and analysis of algorithms

                  1. Theory and algorithms for application domains

                Recommendations

                • FedQV: Leveraging Quadratic Voting in Federated Learning

                  POMACS

                  Federated Learning (FL) permits different parties to collaboratively train a global model without disclosing their respective local labels. A crucial step of FL, that of aggregating local models to produce the global one, shares many similarities with ...

                  Read More

                • FedQV: Leveraging Quadratic Voting in Federated Learning

                  SIGMETRICS/PERFORMANCE '24: Abstracts of the 2024 ACM SIGMETRICS/IFIP PERFORMANCE Joint International Conference on Measurement and Modeling of Computer Systems

                  Federated Learning (FL) permits different parties to collaboratively train a global model without disclosing their respective local labels. A crucial step of FL, that of aggregating local models to produce the global one, shares many similarities with ...

                  Read More

                • Survey on federated learning threats: Concepts, taxonomy on attacks and defences, experimental study and challenges

                  Abstract

                  Federated learning is a machine learning paradigm that emerges as a solution to the privacy-preservation demands in artificial intelligence. As machine learning, federated learning is threatened by adversarial attacks against the ...

                  Highlights

                  • We claim that adversarial attacks are a significant challenge in federated learning.

                  Read More

                Login options

                Check if you have access through your login credentials or your institution to get full access on this article.

                Sign in

                Full Access

                Get this Article

                • Information
                • Contributors
                • Published in

                  FedQV: Leveraging Quadratic Voting in Federated Learning (19)

                  ACM SIGMETRICS Performance Evaluation Review Volume 52, Issue 1

                  SIGMETRICS '24

                  June 2024

                  104 pages

                  ISSN:0163-5999

                  DOI:10.1145/3673660

                  • Editor:
                  • Bo Ji

                    Virginia Tech

                  Issue’s Table of Contents

                  • FedQV: Leveraging Quadratic Voting in Federated Learning (20)

                    SIGMETRICS/PERFORMANCE '24: Abstracts of the 2024 ACM SIGMETRICS/IFIP PERFORMANCE Joint International Conference on Measurement and Modeling of Computer Systems

                    June 2024

                    120 pages

                    ISBN:9798400706240

                    DOI:10.1145/3652963

                    • General Chairs:
                    • Michele Garetto

                      Università di Torino, Italy

                      ,
                    • Andrea Marin

                      Università Ca' Foscari Venezia, Italy

                      ,
                    • Program Chairs:
                    • Florin Ciucu

                      University of Warwick, UK

                      ,
                    • Giulia Fanti

                      Carnegie Mellon University, USA

                      ,
                    • Rhonda Righter

                      University of California, Berkeley, USA

                  Copyright © 2024 Owner/Author

                  Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

                  Sponsors

                    In-Cooperation

                      Publisher

                      Association for Computing Machinery

                      New York, NY, United States

                      Publication History

                      • Published: 13 June 2024

                      Check for updates

                      FedQV: Leveraging Quadratic Voting in Federated Learning (21)

                      Author Tags

                      • distributed training
                      • federated learning

                      Qualifiers

                      • abstract

                      Conference

                      Funding Sources

                      • FedQV: Leveraging Quadratic Voting in Federated Learning (22)

                        Other Metrics

                        View Article Metrics

                      • Bibliometrics
                      • Citations0
                      • Article Metrics

                        • Total Citations

                          View Citations
                        • 2

                          Total Downloads

                        • Downloads (Last 12 months)2
                        • Downloads (Last 6 weeks)2

                        Other Metrics

                        View Author Metrics

                      • Cited By

                        This publication has not been cited yet

                      PDF Format

                      View or Download as a PDF file.

                      PDF

                      eReader

                      View online with eReader.

                      eReader

                      Digital Edition

                      View this article in digital edition.

                      View Digital Edition

                      • Figures
                      • Other

                        Close Figure Viewer

                        Browse AllReturn

                        Caption

                        View Issue’s Table of Contents

                        Export Citations

                          FedQV: Leveraging Quadratic Voting in Federated Learning (2024)
                          Top Articles
                          Latest Posts
                          Article information

                          Author: Chrissy Homenick

                          Last Updated:

                          Views: 5533

                          Rating: 4.3 / 5 (74 voted)

                          Reviews: 89% of readers found this page helpful

                          Author information

                          Name: Chrissy Homenick

                          Birthday: 2001-10-22

                          Address: 611 Kuhn Oval, Feltonbury, NY 02783-3818

                          Phone: +96619177651654

                          Job: Mining Representative

                          Hobby: amateur radio, Sculling, Knife making, Gardening, Watching movies, Gunsmithing, Video gaming

                          Introduction: My name is Chrissy Homenick, I am a tender, funny, determined, tender, glorious, fancy, enthusiastic person who loves writing and wants to share my knowledge and understanding with you.