Is it possible to submit X separate jobs/pipelines using the DataflowPipelineRunner
runner (async), and have the jobs share the worker pool rather then spin up and tear down individual ones?
Not yet -- though it's on our radar as a useful feature. How useful would this be for you?
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With