Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Recurrence Relation: Solving Big O of T(n-1)

I'm solving some recurrence relation problems for Big O and so far up till this point have only encountered recurrence relations that involved this form:

T(n) = a*T(n/b) + f(n)

For the above, it's quite easy for me to find the Big O notation. But I was recently thrown a curve ball with the following equation:

T(n) = T(n-1) + 2

I'm not really sure how to go around solving this for Big O. I've actually tried plugging in the equation as what follows:

T(n) = T(n-1) + 2
T(n-1) = T(n-2)
T(n-2) = T(n-3)

I'm not entirely sure if this is correct, but I'm stuck and need some help. Thanks!

like image 520
Parth Avatar asked Jul 11 '10 18:07

Parth


2 Answers

Assuming T(1) = 0

T(n) = T(n-1) + 2
 = (T(n-2) + 2) + 2
 = T(n-2) + 4
 = (T(n-3) + 2) + 4
 = T(n-3) + 6
 = T(n-k) + 2k

Set k to n-1 and you have

T(n) = 2n - 2

Hence, it's O(n)

like image 124
Andreas Jansson Avatar answered Sep 24 '22 23:09

Andreas Jansson


Since the question is already answered, let me add some intuition behind how to find the complexity of the recurrence.

  • Master theorem applies only to the divide and conquer type recurrences, like T(n) = a*T(n/b) + f(n) where a is the number of subproblems and each of these subproblem's size is 1/b of the original problem. But recurrence T(n) = T(n-1) + 2 does not technically "divide" the problem into subproblems. so master theorem does not apply here.
  • If we closely look at the recurrence, it is pretty clear that it goes over n steps and each step takes constant time, which is 2 in this case. So the complexity would be O(n).

I especially found the second intuition very helpful for most of the recurrences (may be not all). As an example, you can try the same for a similar recurrence T(n) = T(n-1) + n, for which the complexity is, of course, O(n^2).

like image 36
Nasir Avatar answered Sep 21 '22 23:09

Nasir