Imported from https://github.com/batra-mlp-lab/visdial-challenge-starter-pytorch