If I'd like to run a Flink app locally, directly from within Intellij but I need to specify config params (like fs.hdfs.hdfssite to set up S3 access), is there any other way to provide those config params apart from ExecutionEnvironment.createLocalEnvironment(conf)
? What if I want to use StreamExecutionEnvironment.getExecutionEnvironment
? Can I have a Flink config in my project and point the local app to it?
Is this the proper way to do it? Or would you set up your IDE to submit the app to a real local Flink instance?
To create a StreamExecutionEnvironment
with configuration options, use this call StreamExecutionEnvironment.createLocalEnvironment(int parallelism, Configuration configuration)
I could load the flink-conf.yaml file by providing the ENV_VAR FLINK_CONF_DIR in IntelliJ Run Configuration
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With