What does timeit gain by turning off garbage collection?

Question

I was reading the code for the timeit module and I noticed this segment:

gcold = gc.isenabled()
gc.disable()
timing = self.inner(it, self.timer)
if gcold:
    gc.enable()

This just stores the state of garbage collection (on or off) and then turns it off. The function inner executes the statement being timed. It then reverts the garbage collector to its old state.

So I'm curious about what the point of this is. If the code being tested works the garbage collector, then shouldn't that be reflected in the testing? What am I missing?

Answer 1

The nature of garbage collection is that its frequency and duration is somewhat unpredictable. At least from the point of view of the performance of a specific chunk of code, the garbage collector just adds noise to the statistics.

From a whole-program point of view, you are correct in that if your program is running on a system where the garbage collector is exercised, then yes that should be taken into account when measuring the program performance. But it's not usually factored in for individual functions.

Answer 2

Surely that code should be written like this?

gcold = gc.isenabled()
gc.disable()
try:
    timing = self.inner(it, self.timer)
finally:
    if gcold:
        gc.enable()

Otherwise garbage collection will remain disabled if the timed code throws an exception.

I reported this on bugs.python.org, and it was fixed in Python 2.7.3 and 3.2.2.