How to use tensorflow.Estimator for reinforcement learning

Question

The tensorflow.Estimator seems to gear toward supervised learning but seems to difficult to adopt for other task even if only small changes are needed for the model or training. For example, in reinforcement learning, I would need to feed a reward value which is not part of the features.

Answer 1

Estimators were meant for good-old supervised learning. So, adopting them to reinforcement learning will likely feel awkward. Here is an RL library that might be useful: https://github.com/tensorflow/agents.