Dijkstra's algorithm
Dijkstra's algorithm is an algorithm for finding the shortest paths between nodes in a weighted graph, which may represent, for example, a road network. It was conceived by computer scientist Edsger W. Dijkstra in 1956 and published three years later.
Dijkstra's algorithm finds the shortest path from a given source node to every other node. It can be used to find the shortest path to a specific destination node, by terminating the algorithm after determining the shortest path to that node. For example, if the nodes of the graph represent cities, and the costs of edges represent the distances between pairs of cities connected by a direct road, then Dijkstra's algorithm can be used to find the shortest route between one city and all other cities. A common application of shortest path algorithms is network routing protocols, most notably IS-IS and OSPF. It is also employed as a subroutine in algorithms such as Johnson's algorithm.
The algorithm uses a min-priority queue data structure for selecting the shortest paths known so far. Before more advanced priority queue structures were discovered, Dijkstra's original algorithm ran in time, where is the number of nodes. proposed a Fibonacci heap priority queue to optimize the running time complexity to. This is asymptotically the fastest known single-source shortest-path algorithm for arbitrary directed graphs with unbounded non-negative weights. However, specialized cases can be improved further. If preprocessing is allowed, algorithms such as contraction hierarchies can be up to seven orders of magnitude faster.
Dijkstra's algorithm is commonly used on graphs where the edge weights are positive integers or real numbers. It can be generalized to any graph where the edge weights are partially ordered, provided the subsequent labels are monotonically non-decreasing.
In many fields, particularly artificial intelligence, Dijkstra's algorithm or a variant offers a uniform cost search and is formulated as an instance of the more general idea of best-first search.
History
Dijkstra thought about the shortest path problem while working as a programmer at the Mathematical Center in Amsterdam in 1956. He wanted to demonstrate the capabilities of the new ARMAC computer. His objective was to choose a problem and a computer solution that non-computing people could understand. He designed the shortest path algorithm and later implemented it for ARMAC for a slightly simplified transportation map of 64 cities in the Netherlands. A year later, he came across another problem advanced by hardware engineers working on the institute's next computer: minimize the amount of wire needed to connect the pins on the machine's back panel. As a solution, he re-discovered Prim's minimal spanning tree algorithm. Dijkstra published the algorithm in 1959, two years after Prim and 29 years after Jarník.Algorithm
The algorithm requires a starting node, and computes the shortest distance from that starting node to each other node. Dijkstra's algorithm starts with infinite distances and tries to improve them step by step:- Create a set of all unvisited nodes: the unvisited set.
- Assign to every node a distance from start value: for the starting node, it is zero, and for all other nodes, it is infinity, since initially no path is known to these nodes. During execution, the distance of a node N is the length of the shortest path discovered so far between the starting node and N.
- From the unvisited set, select the current node to be the one with the smallest distance; initially, this is the starting node. If the unvisited set is empty, or contains only nodes with infinite distance, then the algorithm terminates by skipping to step 6. If the only concern is the path to a target node, the algorithm terminates once the current node is the target node. Otherwise, the algorithm continues.
- For the current node, consider all of its unvisited neighbors and update their distances through the current node; compare the newly calculated distance to the one currently assigned to the neighbor and assign the smaller one to it. For example, if the current node A is marked with a distance of 6, and the edge connecting it with its neighbor B has length 2, then the distance to B through A is 6 + 2 = 8. If B was previously marked with a distance greater than 8, then update it to 8. Otherwise, keep its current distance.
- After considering all of the current node's unvisited neighbors, the current node is removed from the unvisited set. Thus a visited node is never rechecked, which is correct because the distance recorded on the current node is minimal, and thus final. Repeat from step 3.
- Once the loop exits, every visited node contains its shortest distance from the starting node.
Description
The shortest path between two intersections on a city map can be found by this algorithm using pencil and paper. Every intersection is listed on a separate line: one is the starting point and is labeled 0. Every other intersection is initially labeled with a distance of infinity. This is done to note that no path to these intersections has yet been established. At each iteration one intersection becomes the current intersection. For the first iteration, this is the starting point.From the current intersection, the distance to every neighbor intersection is assessed by summing the label of the current intersection and the distance to the neighbor and then relabeling the neighbor with the lesser of that sum and the neighbor's existing label. I.e., the neighbor is relabeled if the path to it through the current intersection is shorter than previously assessed paths. If so, mark the road to the neighbor with an arrow pointing to it, and erase any other arrow that points to it. After the distances to each of the current intersection's neighbors have been assessed, the current intersection is marked as visited. The unvisited intersection with the smallest label becomes the current intersection and the process repeats until all nodes with labels less than the destination's label have been visited.
Once no unvisited nodes remain with a label smaller than the destination's label, the remaining arrows show the shortest path.
Pseudocode
In the following pseudocode, is an array that contains the current distances from the to other vertices, i.e. is the current distance from the source to the vertex. The array contains pointers to previous-hop nodes on the shortest path from source to the given vertex. The code, searches for the vertex in the vertex set that has the least value. returns the length of the edge joining the two neighbor-nodes and. The variable on line 14 is the length of the path from the node to the neighbor node if it were to go through. If this path is shorter than the current shortest path recorded for, then the distance of is updated to.File:DijkstraDemo.gif|thumb|A demo of Dijkstra's algorithm based on Euclidean distance. Red lines are the shortest path covering, i.e., connecting u and prev. Blue lines indicate where relaxing happens, i.e., connecting v with a node u in Q, which gives a shorter path from the source to v.
1 function Dijkstra:
2
3 for each vertex v in Graph.Vertices:
4 dist ← INFINITY
5 prev ← UNDEFINED
6 add v to Q
7 dist ← 0
8
9 while Q is not empty:
10 u ← vertex in Q with minimum dist
11 Q.remove
12
13 for each edge in Graph:
14 alt ← dist + Graph.Distance
15 if alt < dist:
16 dist ← alt
17 prev ← u
18
19 return dist, prev
To find the shortest path between vertices and, the search terminates after line 10 if. The shortest path from to can be obtained by reverse iteration:
1 S ← empty sequence
2 u ← target
3 if prev is defined or u = source: // Proceed if the vertex is reachable
4 while u is defined: // Construct shortest path with stack S
5 S.push // Push the vertex onto the stack
6 u ← prev // Traverse from target to source
Now sequence is the list of vertices constituting one of the shortest paths from to, or the empty sequence if no path exists.
A more general problem is to find all the shortest paths between and . Then instead of storing only a single node in each entry of all nodes satisfying the relaxation condition can be stored. For example, if both and connect to and they lie on different shortest paths through , then both and are added to. When the algorithm completes, data structure describes a graph that is a subset of the original graph with some edges removed. Its key property is that if the algorithm was run with some starting node, then every path from that node to any other node in the new graph is the shortest path between those nodes graph, and all paths of that length from the original graph are present in the new graph. Then to actually find all these shortest paths between two given nodes, a path finding algorithm on the new graph, such as depth-first search would work.
Using a priority queue
A min-priority queue is an abstract data type that provides 3 basic operations:, and. As mentioned earlier, using such a data structure can lead to faster computing times than using a basic queue. Notably, Fibonacci heap or Brodal queue offer optimal implementations for those 3 operations. As the algorithm is slightly different in appearance, it is mentioned here, in pseudocode as well:1 function Dijkstra:
2 Q ← Queue storing vertex priority
3
4 dist ← 0 // Initialization
5 Q.add_with_priority // associated priority equals dist
6
7 for each vertex v in Graph.Vertices:
8 if v ≠ source
9 prev ← UNDEFINED // Predecessor of v
10 dist ← INFINITY // Unknown distance from source to v
11 Q.add_with_priority
12
13
14 while Q is not empty: // The main loop
15 u ← Q.extract_min // Remove and return best vertex
16 for each arc : // Go through all v neighbors of u
17 alt ← dist + Graph.Distance
18 if alt < dist:
19 prev ← u
20 dist ← alt
21 Q.decrease_priority
22
23 return
Instead of filling the priority queue with all nodes in the initialization phase, it is possible to initialize it to contain only source; then, inside the
if alt < dist block, the becomes an operation.Yet another alternative is to add nodes unconditionally to the priority queue and to instead check after extraction that it isn't revisiting, or that no shorter connection was found yet in the
if alt < dist block. This can be done by additionally extracting the associated priority p from the queue and only processing further if p dist inside the while Q is not empty loop.These alternatives can use entirely array-based priority queues without decrease-key functionality, which have been found to achieve even faster computing times in practice. However, the difference in performance was found to be narrower for denser graphs.
Proof
To prove the correctness of Dijkstra's algorithm, mathematical induction can be used on the number of visited nodes.Invariant hypothesis: For each visited node, is the shortest distance from to, and for each unvisited node, is the shortest distance from to when traveling via visited nodes only, or infinity if no such path exists.
Base case
The base case is when there is just one visited node,. Its distance is defined to be zero, which is the shortest distance, since negative weights are not allowed. Hence, the hypothesis holds.Induction
Assuming that the hypothesis holds for visited nodes, to show it holds for nodes, let be the next visited node, i.e. the node with minimum. The claim is that is the shortest distance from to.The proof is by contradiction. If a shorter path were available, then this shorter path either contains another unvisited node or not.
- In the former case, let be the first unvisited node on this shorter path. By induction, the shortest paths from to and through visited nodes only have costs and respectively. This means the cost of going from to via has the cost of at least + the minimal cost of going from to. As the edge costs are positive, the minimal cost of going from to is a positive number. However, is at most because otherwise w would have been picked by the priority queue instead of u. This is a contradiction, since it has already been established that + a positive number <.
- In the latter case, let be the last but one node on the shortest path. That means. That is a contradiction because by the time is visited, it should have set to at most.
After processing, it is still true that for each unvisited node, is the shortest distance from to using visited nodes only. Any shorter path that did not use, would already have been found, and if a shorter path used it would have been updated when processing.
After all nodes are visited, the shortest path from to any node consists only of visited nodes. Therefore, is the shortest distance.
Running time
Bounds of the running time of Dijkstra's algorithm on a graph with edges ' and vertices ' can be expressed as a function of the number of edges, denoted, and the number of vertices, denoted, using big-O notation. The complexity bound depends mainly on the data structure used to represent the set '. In the following, upper bounds can be simplified because is for any simple graph, but that simplification disregards the fact that in some problems, other upper bounds on may hold.For any data structure for the vertex set ', the running time is:
where and are the complexities of the decrease-key and extract-minimum operations in ', respectively.
The simplest version of Dijkstra's algorithm stores the vertex set ' as a linked list or array, and edges as an adjacency list or matrix. In this case, extract-minimum is simply a linear search through all vertices in ', so the running time is.
For sparse graphs, that is, graphs with far fewer than edges, Dijkstra's algorithm can be implemented more efficiently by storing the graph in the form of adjacency lists and using a self-balancing binary search tree, binary heap, pairing heap, Fibonacci heap or a priority heap as a priority queue to implement extracting minimum efficiently. To perform decrease-key steps in a binary heap efficiently, it is necessary to use an auxiliary data structure that maps each vertex to its position in the heap, and to update this structure as the priority queue ' changes. With a self-balancing binary search tree or binary heap, the algorithm requires
time in the worst case; for connected graphs this time bound can be simplified to. The Fibonacci heap improves this to
When using binary heaps, the average case time complexity is lower than the worst-case: assuming edge costs are drawn independently from a common probability distribution, the expected number of decrease-key operations is bounded by, giving a total running time of
Practical optimizations and infinite graphs
In common presentations of Dijkstra's algorithm, initially all nodes are entered into the priority queue. This is, however, not necessary: the algorithm can start with a priority queue that contains only one item, and insert new items as they are discovered. This variant has the same worst-case bounds as the common variant, but maintains a smaller priority queue in practice, speeding up queue operations.Moreover, not inserting all nodes in a graph makes it possible to extend the algorithm to find the shortest path from a single source to the closest of a set of target nodes on infinite graphs or those too large to represent in memory. The resulting algorithm is called uniform-cost search in the artificial intelligence literature and can be expressed in pseudocode as
procedure uniform_cost_search is
node ← start
frontier ← priority queue containing node only
expanded ← empty set
do
if frontier is empty then
return failure
node ← frontier.pop
if node is a goal state then
return solution
expanded.add
for each of node's neighbors n do
if n is not in expanded and not in frontier then
frontier.add
else if n is in frontier with higher cost
replace existing node with n
Its complexity can be expressed in an alternative way for very large graphs: when is the length of the shortest path from the start node to any node satisfying the "goal" predicate, each edge has cost at least ', and the number of neighbors per node is bounded by ', then the algorithm's worst-case time and space complexity are both in.
Further optimizations for the single-target case include bidirectional variants, goal-directed variants such as the A* algorithm, graph pruning to determine which nodes are likely to form the middle segment of shortest paths, and hierarchical decompositions of the input graph that reduce routing to connecting ' and ' to their respective "transit nodes" followed by shortest-path computation between these transit nodes using a "highway". Combinations of such techniques may be needed for optimal practical performance on specific problems.
Bidirectional Dijkstra
Bidirectional Dijkstra is a variant of Dijkstra’s algorithm designed to efficiently compute the shortest path between a given source vertex s and target vertex t, rather than all vertices. The key idea is to run two simultaneous searches: one forward from s on the original graph and one backward from t on the graph with edges reversed. Each search maintains its own tentative distance estimates, priority queue, and set of “settled” vertices. The two frontiers advance toward each other and meet somewhere along the shortest s–t path.Two distance arrays are maintained: df and db, initialized to ∞ except df = 0 and db = 0. Two priority queues Qf and Qb hold vertices not yet fully processed, and two sets Sf and Sb store vertices whose shortest-path distance is finalized in each direction. A variable μ stores the length of the best full s–t path found so far, initially ∞.
The algorithm repeatedly extracts the minimum-distance vertex from whichever queue currently has the smaller key, relaxes its outgoing edges, and updates μ whenever it discovers a connection between the two settled sets:
and symmetrically for the backward search.
A key feature is the stopping condition: once the sum of the current minimum priorities in both queues is at least μ, no yet-unsettled path can improve upon μ. At this point μ equals the true shortest-path distance δ, and the search terminates.
This criterion avoids a common mistake of halting as soon as the two frontiers touch, which may overlook a shorter alternative crossing elsewhere.
Because each search only needs to explore roughly half of the search space in typical graphs, the bidirectional method often visits far fewer vertices and relaxes far fewer edges than one-directional Dijkstra on single-pair queries. In road-network–like graphs the savings can be dramatic, sometimes reducing the explored region from an exponential-size ball to two smaller half-balls.
The method is widely used in point-to-point routing for maps and navigation software and serves as a base for many speed-up techniques such as the ALT, contraction hierarchies, and reach-based routing.
If the actual shortest path is desired, predecessor pointers can be stored in both searches. When μ is updated through some crossing vertex x, the algorithm records this meeting point and reconstructs the final route as the forward path from s to x concatenated with the backward path from x to t.
Theoretical research shows that an optimized bidirectional approach can be instance-optimal, meaning no correct algorithm can asymptotically relax fewer edges on the same graph instance.
Practical performance considerations
Although Dijkstra’s algorithm is optimal for graphs with non-negative edge weights, its practical runtime depends on both data structures and graph properties. Using a binary heap results in a running time of O. Alternatives such as Fibonacci heaps provide better theoretical bounds but often perform worse in real applications because of large constant factors.
Graph structure also plays a major role. Sparse networks, such as road maps, allow Dijkstra’s algorithm to operate efficiently since most vertices have low degree. Dense graphs increase relaxations and slow down the process. Because of this, modern routing systems often use Dijkstra’s algorithm together with preprocessing methods such as A* search, landmark heuristics, or contraction hierarchies, which significantly reduce the search space.
Memory locality is another important factor. Cache-optimized priority queues and adjacency layouts can reduce latency for large graphs that exceed CPU cache limitations.
Because of these considerations, most real-world systems use specialized Dijkstra variants tuned for specific graph families and hardware constraints.
----
Optimality for comparison-sorting by distance
As well as simply computing distances and paths, Dijkstra's algorithm can be used to sort vertices by their distances from a given starting vertex.In 2023, Haeupler, Rozhoň, Tětek, Hladík, and Tarjan, proved that, for this sorting problem on a positively-weighted directed graph, a version of Dijkstra's algorithm with a special heap data structure has a runtime and number of comparisons that is within a constant factor of optimal among comparison-based algorithms for the same sorting problem on the same graph and starting vertex but with variable edge weights. To achieve this, they use a comparison-based heap whose cost of returning/removing the minimum element from the heap is logarithmic in the number of elements inserted after it rather than in the number of elements in the heap.
Specialized variants
When arc weights are small integers, specialized queues can be used for increased speed. The first algorithm of this type was Dial's algorithm for graphs with positive integer edge weights, which uses a bucket queue to obtain a running time. The use of a Van Emde Boas tree as the priority queue brings the complexity to . Another interesting variant based on a combination of a new radix heap and the well-known Fibonacci heap runs in time . Finally, the best algorithms in this special case run in time and time.Related problems and algorithms
Dijkstra's original algorithm can be extended with modifications. For example, sometimes it is desirable to present solutions which are less than mathematically optimal. To obtain a ranked list of less-than-optimal solutions, the optimal solution is first calculated. A single edge appearing in the optimal solution is removed from the graph, and the optimum solution to this new graph is calculated. Each edge of the original solution is suppressed in turn and a new shortest-path calculated. The secondary solutions are then ranked and presented after the first optimal solution.Dijkstra's algorithm is usually the working principle behind link-state routing protocols. OSPF and IS-IS are the most common.
Unlike Dijkstra's algorithm, the Bellman–Ford algorithm can be used on graphs with negative edge weights, as long as the graph contains no negative cycle reachable from the source vertex s. The presence of such cycles means that no shortest path can be found, since the label becomes lower each time the cycle is traversed. It is possible to adapt Dijkstra's algorithm to handle negative weights by combining it with the Bellman-Ford algorithm : Johnson's algorithm.
The A* algorithm is a generalization of Dijkstra's algorithm that reduces the size of the subgraph that must be explored, if additional information is available that provides a lower bound on the distance to the target.
The process that underlies Dijkstra's algorithm is similar to the greedy process used in Prim's algorithm. Prim's purpose is to find a minimum spanning tree that connects all nodes in the graph; Dijkstra is concerned with only two nodes. Prim's does not evaluate the total weight of the path from the starting node, only the individual edges.
Breadth-first search can be viewed as a special-case of Dijkstra's algorithm on unweighted graphs, where the priority queue degenerates into a FIFO queue.
The fast marching method can be viewed as a continuous version of Dijkstra's algorithm which computes the geodesic distance on a triangle mesh.
Dynamic programming perspective
From a dynamic programming point of view, Dijkstra's algorithm is a successive approximation scheme that solves the dynamic programming functional equation for the shortest path problem by the Reaching method.In fact, Dijkstra's explanation of the logic behind the algorithm:
is a paraphrasing of Bellman's principle of optimality in the context of the shortest path problem.