We are very excited to join forces with MLCommons and OctoML.ai! Contact Grigori Fursin for more details!

Hierarchical Federated Learning Across Heterogeneous Cellular Networks

lib:40d6b402ce364d08 (v1.0.0)

Authors: Mehdi Salehi Heydar Abad,Emre Ozfatura,Deniz Gunduz,Ozgur Ercetin
ArXiv: 1909.02362
Document:  PDF  DOI 
Abstract URL: https://arxiv.org/abs/1909.02362v1


We study collaborative machine learning (ML) across wireless devices, each with its own local dataset. Offloading these datasets to a cloud or an edge server to implement powerful ML solutions is often not feasible due to latency, bandwidth and privacy constraints. Instead, we consider federated edge learning (FEEL), where the devices share local updates on the model parameters rather than their datasets. We consider a heterogeneous cellular network (HCN), where small cell base stations (SBSs) orchestrate FL among the mobile users (MUs) within their cells, and periodically exchange model updates with the macro base station (MBS) for global consensus. We employ gradient sparsification and periodic averaging to increase the communication efficiency of this hierarchical federated learning (FL) framework. We then show using CIFAR-10 dataset that the proposed hierarchical learning solution can significantly reduce the communication latency without sacrificing the model accuracy.

Relevant initiatives  

Related knowledge about this paper Reproduced results (crowd-benchmarking and competitions) Artifact and reproducibility checklists Common formats for research projects and shared artifacts Reproducibility initiatives

Comments  

Please log in to add your comments!
If you notice any inapropriate content that should not be here, please report us as soon as possible and we will try to remove it within 48 hours!