I was wondering when one should use Prim's algorithm and when Kruskal's to find the minimum spanning tree? They both have easy logics, same worst cases, and only difference is implementation which might involve a bit different data structures. So what is the deciding factor?
10 Answers
Use Prim's algorithm when you have a graph with lots of edges.
For a graph with V vertices E edges, Kruskal's algorithm runs in O(E log V) time and Prim's algorithm can run in O(E + V log V) amortized time, if you use a Fibonacci Heap.
Prim's algorithm is significantly faster in the limit when you've got a really dense graph with many more edges than vertices. Kruskal performs better in typical situations (sparse graphs) because it uses simpler data structures.
-
10I would say "typical situations" instead of average.. I think it's an obscure term to use, for example what is the "average size" of a hash table? no idea.– yairchuJul 29, 2009 at 11:28
-
3@SplittingField: I do believe you're comparing apples and oranges. Amortized analysis is simpy a way of getting a measurement of the function (so to speak) --- whether it is the worst case or average case is dependent on what you're proving. In fact (as I look it up now), the wiki article uses language that implies that its only used for worst-case analysis. Now, using such an analysis means that you can't make as strong promises about the cost of a particular operation, but by the time the algorithm is done, it will indeed by O(E+VlogV), even worst-case.– agorenstJul 30, 2009 at 16:49
-
17That sounds good in theory, but I bet few people can implement a Fibonacci heap Oct 29, 2009 at 20:04
-
3@tgamblin, there can be C(V,2) edges in worst case. So, doesn't the time compleixty of Prim's algorithm boils down to O(V^2 + VlogV) i.e. O(V^2) in case of fibonacci heap? Nov 9, 2012 at 5:40
-
11There is also another important factor: the output of Prims is a MST only if the graph is connected (output seems to me of no use otherwise), but the Kruskal's output is the Minimum Spanning forests (with some use).– V GOct 23, 2013 at 10:00
I found a very nice thread on the net that explains the difference in a very straightforward way : http://www.thestudentroom.co.uk/showthread.php?t=232168.
Kruskal's algorithm will grow a solution from the cheapest edge by adding the next cheapest edge, provided that it doesn't create a cycle.
Prim's algorithm will grow a solution from a random vertex by adding the next cheapest vertex, the vertex that is not currently in the solution but connected to it by the cheapest edge.
Here attached is an interesting sheet on that topic.
If you implement both Kruskal and Prim, in their optimal form : with a union find and a finbonacci heap respectively, then you will note how Kruskal is easy to implement compared to Prim.
Prim is harder with a fibonacci heap mainly because you have to maintain a book-keeping table to record the bi-directional link between graph nodes and heap nodes. With a Union Find, it's the opposite, the structure is simple and can even produce directly the mst at almost no additional cost.
-
4Nitpick: Last 'slide' in each should read "repeat until you have a spanning tree"; not until MST, which is something of a recursive task - how do I know it's minimal - that's why I'm following Prim's/Kruskal's to begin with!– OJFordJun 13, 2015 at 23:17
-
1@OllieFord I found this thread for having searched a simple illustration of Prim and Kruskal algorithms. The algorithms guarantee that you'll find a tree and that tree is a MST. And you know that you have found a tree when you have exactly
V-1
edges.– mikedu95Jan 20, 2016 at 21:16 -
@mikedu95 You're correct, making the same point as my earlier comment from a different angle.– OJFordJan 20, 2016 at 23:17
-
But isn't it a precondition that you have to only choose with a single weight between vertices, you cant choose weight 2 more than once from the above graph, you have to choose the next weight ex:3 @Snicolas Jul 21, 2017 at 10:47
I know that you did not ask for this, but if you have more processing units, you should always consider Borůvka's algorithm, because it might be easily parallelized - hence it has a performance advantage over Kruskal and Jarník-Prim algorithm.
Kruskal time complexity worst case is O(E log E),this because we need to sort the edges. Prim time complexity worst case is O(E log V) with priority queue or even better, O(E+V log V) with Fibonacci Heap. We should use Kruskal when the graph is sparse, i.e.small number of edges,like E=O(V),when the edges are already sorted or if we can sort them in linear time. We should use Prim when the graph is dense, i.e number of edges is high ,like E=O(V²).
-
1It looks to me that Prim is never worse than Kruskal speed-wise. Since E should be at least V-1 is there is a spanning tree. I think the reason we may prefer Kruskal for a sparse graph is that its data structure is way simple.– Yu GuOct 31, 2019 at 14:49
Kruskal can have better performance if the edges can be sorted in linear time, or are already sorted.
Prim's better if the number of edges to vertices is high.
If we stop the algorithm in middle prim's algorithm always generates connected tree, but kruskal on the other hand can give disconnected tree or forest
One important application of Kruskal's algorithm is in single link clustering.
Consider n vertices and you have a complete graph.To obtain a k clusters of those n points.Run Kruskal's algorithm over the first n-(k-1) edges of the sorted set of edges.You obtain k-cluster of the graph with maximum spacing.
The best time for Kruskal's is O(E logV). For Prim's using fib heaps we can get O(E+V lgV). Therefore on a dense graph, Prim's is much better.
-
Did you mean Omega(V logE) for Kruskal's best case? Using a binary heap, we only need to perform (V-1) deletions in the best case (when none of the "shortest" V-1 edges forms a cycle). But, the length of our binary heap will start out as E.– PhasmidApr 25, 2022 at 16:15
Prim's is better for more dense graphs, and in this we also do not have to pay much attention to cycles by adding an edge, as we are primarily dealing with nodes. Prim's is faster than Kruskal's in the case of complex graphs.
In kruskal Algorithm we have number of edges and number of vertices on a given graph but on each edge we have some value or weight on behalf of which we can prepare a new graph which must be not cyclic or not close from any side For Example
graph like this
_____________
| | |
| | |
|__________| |
Give name to any vertex a,b,c,d,e,f .