Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Memory limit in Azure Data Lake Analytics

I have implemented a custom extractor for NetCDF files and load the variables into arrays in memory before outputting them. Some arrays can be quite big, so I wonder what the memory limit is in ADLA. Is there some max amount of memory you can allocate?

like image 242
Magnus Johannesson Avatar asked Dec 19 '25 00:12

Magnus Johannesson


1 Answers

Each vertex has 6GB available. Keep in mind that this memory is shared between the OS, the U-SQL runtime, and the user code running on the vertex.

like image 130
saveenr Avatar answered Dec 21 '25 20:12

saveenr



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!