I am a little bit confused about the fact that we can just catch an OutOfMemoryException
using a try/catch block.
Given the following code:
Console.WriteLine("Starting"); for (int i = 0; i < 10; i++) { try { OutOfMemory(); } catch (Exception exception) { Console.WriteLine(exception.ToString()); } } try { StackOverflow(); } catch (Exception exception) { Console.WriteLine(exception.ToString()); } Console.WriteLine("Done");
The methods I used to create the OutOfMemory + StackOverflowException:
public static void OutOfMemory() { List<byte[]> data = new List<byte[]>(1500); while (true) { byte[] buffer = new byte[int.MaxValue / 2]; for (int i = 0; i < buffer.Length; i++) { buffer[i] = 255; } data.Add(buffer); } } static void StackOverflow() { StackOverflow(); }
It prints out the OutOfMemoryException
10 times and then terminates due to the StackOverflowException
, which it can't handle.
The RAM graph looks like that while executing the program:
My question now it why are we able to catch the OutOfMemoryException
? After catching it we can just go on execute any code we want. As proven by the RAM graph, there is memory released. How does the runtime know which objects it can GC and which are still required for further execution?
It is possible to catch an OutOfMemoryError (It's an Error , not an Exception ), but you should be aware, that there is no way to get a defined behaviour. You may even get another OutOfMemoryError while trying to catch it. So the better way is to create/use memory aware Caches.
When data structures or data sets that reside in memory become so large that the common language runtime is unable to allocate enough contiguous memory for them, an OutOfMemoryException exception results.
An OutOfMemoryException exception has two major causes: You are attempting to expand a StringBuilder object beyond the length defined by its StringBuilder. MaxCapacity property. The common language runtime cannot allocate enough contiguous memory to successfully perform an operation.
The GC makes an analysis on the references that are used in the program, and can throw away any object that isn't used anywhere.
An OutOfMemoryException
doesn't mean that the memory is completely depleted, it just means that a memory allocation failed. If you tried to allocate a large memory area at once, there may still be plenty of free memory left.
When there isn't enough free memory for an allocation, the system does a garbage collection to try to free up memory. If there still isn't enough memory for the allocation, it will throw the exception.
A StackOverflowException
is not possible to handle, because it means that the stack is full, and it's not possible to remove anything from it as it is with the heap. You would need more stack space to continue running the code that would handle the exception, but there is no more.
The OutOfMemoryException is quite possibly thrown because you are running a 32 bit program, with the memory graph you have not indicated how much ram the system has, so perhaps try building it as a 64 bit, and maybe use MemoryFailPoint to prevent this occurring anyway.
You could also let us know what is in the OutOfMemory() function for a clearer picture.
P.S. StackOverFlow is the only error which cannot be handled.
Edit: as mentioned above, and I thought it only logical and hence didn't mention it earlier, if you for example try to allocate more memory than you have 'spare' then it is not possible to do so and an exception occurs. As you are allocating large arrays with your data.Add() it falls over before the final 'illegal' add occurs, hence there is still free memory.
So I would assume that it is at this point data.Add(buffer); the issue occurs during the building of the array when you trip the 2GB process limit by adding a 400MB byte array to 'data', e.g. an array of around 1 billion objects at 4 bytes a piece I would expect to be around 400MB.
P.S. Up until .net 4.5 max process memory allocation is 2GB, after 4.5 larger are available.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With