Replication of UCB Exploration via Q-Ensembles An attempt to replicate https://openreview.net/pdf?id=H1cKvl-Rb. Most code from OpenAI Baselines (https://github.com/openai/baselines)