Imported from https://github.com/bcsaldias/yes-no-crowdsourcing