We are very excited to join forces with MLCommons and OctoML.ai! Contact Grigori Fursin for more details!

Consensus Monte Carlo for Random Subsets using Shared Anchors

lib:fe7ec5674584be46 (v1.0.0)

Authors: Yang Ni,Yuan Ji,Peter Mueller
ArXiv: 1906.12309
Document:  PDF  DOI 
Abstract URL: https://arxiv.org/abs/1906.12309v2


We present a consensus Monte Carlo algorithm that scales existing Bayesian nonparametric models for clustering and feature allocation to big data. The algorithm is valid for any prior on random subsets such as partitions and latent feature allocation, under essentially any sampling model. Motivated by three case studies, we focus on clustering induced by a Dirichlet process mixture sampling model, inference under an Indian buffet process prior with a binomial sampling model, and with a categorical sampling model. We assess the proposed algorithm with simulation studies and show results for inference with three datasets: an MNIST image dataset, a dataset of pancreatic cancer mutations, and a large set of electronic health records (EHR). Supplementary materials for this article are available online.

Relevant initiatives  

Related knowledge about this paper Reproduced results (crowd-benchmarking and competitions) Artifact and reproducibility checklists Common formats for research projects and shared artifacts Reproducibility initiatives

Comments  

Please log in to add your comments!
If you notice any inapropriate content that should not be here, please report us as soon as possible and we will try to remove it within 48 hours!