Imported from https://github.com/bryanyzhu/two-stream-pytorch