Divide et Conquer vs Dynamic Programming

francofernando

Franco Fernando

Posted on November 29, 2021

Divide et Conquer vs Dynamic Programming

Divide and Conquer (D&C) and Dynamic Programming (DP) are two great algorithmic techniques. Both divide a given problem into subproblems and solve the subproblems.

How do you choose which one is better to use for solving a problem ?

To answer this question you need first to understand if the subproblems overlap or not. If they don't overlap you should use Divide at Conquer. If they overlap you should use Dynamic Programming.

Let's consider a problem P broken down into 2 smaller subproblems S1 and S2.

With Divide and Conquer you would:

  1. solve S1 and S2 separately
  2. combine their solutions in a certain way
  3. get the answer to P

A classic example is the mergesort algorithm, where you sort an array by:

  1. dividing it into 2 subarrays
  2. sorting the 2 subarrays independently
  3. merging the sorted subarrays to get the original one sorted

There is no inter-dependency between the 2 subarrays for finding the solution.

With DP the first thing you need to realize is that S1 and S2 overlap. What does it means ?
Basically that there is an inter-dependency between S1 and S2.

Let's suppose that S2 depends on S1. This means that S1 has to be solved before S2 can be solved. That's exactly what DP does when implemented in bottom up way.

How ?

  • solving S1 first and remembering the result.
  • solving S2 utilizing the remembered result for S1 (S2 depends on S1)
  • solving P using the solutions of S2 and S1.

All you need to do is start from bottom (S1) and move gradually (through S2) towards up (P).

A classic example is the Fibonacci sequence defined as f(n) = f(n-1) + f(n-2). Here the solution for f(n-1) depends on the solution for f(n-2). The DP approach:

  • solve the problem for the smaller number first
  • reuse this value to calculate the larger value
  • get the final value

Thank you for reading! I'm Franco Fernando, helping you to better understand algorithms and data structures.

If you liked this post, follow me here and on Twitter to get more related content daily!

💖 💪 🙅 🚩
francofernando
Franco Fernando

Posted on November 29, 2021

Join Our Newsletter. No Spam, Only the good stuff.

Sign up to receive the latest update from our blog.

Related

Divide et Conquer vs Dynamic Programming
algorithms Divide et Conquer vs Dynamic Programming

November 29, 2021

Dijkstra's shortest path algorithm
algorithms Dijkstra's shortest path algorithm

July 11, 2021