We are very excited to join forces with MLCommons and OctoML.ai! Contact Grigori Fursin for more details!

A Hybrid Solution to improve Iteration Efficiency in the Distributed Learning

lib:0bbfe47acac2ce95 (v1.0.0)

Authors: Junxiong Wang,Hongzhi Wang,Chenxu Zhao
ArXiv: 1411.6358
Document:  PDF  DOI 
Abstract URL: http://arxiv.org/abs/1411.6358v1


Currently, many machine learning algorithms contain lots of iterations. When it comes to existing large-scale distributed systems, some slave nodes may break down or have lower efficiency. Therefore traditional machine learning algorithm may fail because of the instability of distributed system.We presents a hybrid approach which not only own a high fault-tolerant but also achieve a balance of performance and efficiency.For each iteration, the result of slow machines will be abandoned. Then, we discuss the relationship between accuracy and abandon rate. Next we debate the convergence speed of this process. Finally, our experiments demonstrate our idea can dramatically reduce calculation time and be used in many platforms.

Relevant initiatives  

Related knowledge about this paper Reproduced results (crowd-benchmarking and competitions) Artifact and reproducibility checklists Common formats for research projects and shared artifacts Reproducibility initiatives

Comments  

Please log in to add your comments!
If you notice any inapropriate content that should not be here, please report us as soon as possible and we will try to remove it within 48 hours!