I'm been reading creating-instance-with-custom-machine-type and It seems really interesting but I don't know how to set up a Dataflow streaming job with a custom machine (for example 8 CPUs and 15GB). Is it possible?
Dataflow now supports custom machine types, which can be specified like other machine types, with the --workerMachineType
flag.
A sample value is --workerMachineType=custom-8-7424
, which would correspond to 8 cores and 7424 MB of memory.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With