Imported from https://github.com/andrew-j-levy/Hierarchical-Actor-Critc-HAC-