Invalid argument --model_config_file_poll_wait_seconds

Question

I'm trying to start tensorflow-serving with the following two options like on the documentation

docker run -t --rm -p 8501:8501 \
    -v "$(pwd)/models/:/models/" tensorflow/serving \
    --model_config_file=/models/models.config \
    --model_config_file_poll_wait_seconds=60

The container does not start because it does not recognize the argument --model_config_file_poll_wait_seconds.

unknown argument: --model_config_file_poll_wait_seconds=60
usage: tensorflow_model_server

I'm on the latest docker image, 1.14.0 and the line is taken straight from the documentation

https://www.tensorflow.org/tfx/serving/serving_config

Does this argument even work?

Many thanks.

Answer 1

It seems https://www.tensorflow.org/tfx/serving/serving_config is talking about code that has not been released as a new version yet, which is odd. I will ask about that.

That package is generated from this source: https://github.com/tensorflow/serving/blob/master/tensorflow_serving/g3doc/serving_config.md, it mentions the --model_config_file_poll_wait_seconds flag.

However, the same document for 1.14.0 has no mention of the flag: https://github.com/tensorflow/serving/blob/1.14.0/tensorflow_serving/g3doc/serving_config.md

Try using the nightly tensorflow serving image and see if it works.

docker run -t --rm -p 8501:8501 \
    -v "$(pwd)/models/:/models/" tensorflow/serving:nightly \
    --model_config_file=/models/models.config \
    --model_config_file_poll_wait_seconds=60