10.5281/zenodo.1938263
https://zenodo.org/records/1938263
oai:zenodo.org:1938263
Ivan Sosin
Ivan Sosin
JetBrains Research
Oleg Svidchenko
Oleg Svidchenko
JetBrains Research
Aleksandra Malysheva
Aleksandra Malysheva
JetBrains Research
Daniel Kudenko
Daniel Kudenko
JetBrains Research
Aleksei Shpilman
Aleksei Shpilman
JetBrains Research
Framework for Deep Reinforcement Learning with GPU-CPU Multiprocessing
Zenodo
2018
2018-12-04
https://github.com/iasawseen/MultiServerRL/tree/v1.0
10.5281/zenodo.1938262
v1.0
Other (Open)
One of the main challenges faced in Deep Reinforcement Learning is that running simulations may be CPU-heavy, while the optimal computing device for training neural networks is a GPU. One way to overcome this problem is building a custom machine with GPU to CPU proportions that avoid bottlenecking one or the other. Another is to have the GPU machine work together with the CPU machine and/or launching one or both via cloud computing service. We have designed a framework for such a tandem interaction.
Authors: Ivan Sosin, Oleg Svidchenko, Aleksandra Malysheva, Daniel Kudenko, Aleksei Shpilman.