Iterative compression

In computer science, iterative compression is an algorithmic technique for the design of fixed-parameter tractable algorithms, in which one element (such as a vertex of a graph) is added to the problem in each step, and a small solution for the problem prior to the addition is used to help find a small solution to the problem after the step.

The technique was invented by Reed, Smith and Vetta ^[1] to show that the problem of odd cycle transversal was solvable in time O(3^k kmn), for a graph with n vertices, m edges, and odd cycle transversal number k. Odd cycle transversal is the problem of finding the smallest set of vertices of a graph that includes at least one vertex from every odd cycle; its parameterized complexity was a longstanding open question. ^{[2] [3]} This technique later proved very useful in showing fixed-parameter tractability results. It is now considered to be one of the fundamental techniques in the area of parameterized algorithmics.

Iterative compression has been used successfully in many problems, for instance odd cycle transversal (see below) and edge bipartization, feedback vertex set, cluster vertex deletion and directed feedback vertex set. ^[4] It has also been used successfully for exact exponential time algorithms for independent set. ^[5]

Technique

Iterative compression applies, for instance, to parameterized graph problems whose inputs are a graph G = (V,E) and a natural number k, and where the problem is to test the existence of a solution (a set of vertices) of size ≤ k. Suppose that the problem has the following properties:

• It is closed under induced subgraphs: If a solution of size ≤ k exists in a given graph, then a solution of this size or smaller also exists in every induced subgraph).
• If X is a solution, and X' is a set of vertices containing X, then X' is also a solution.
• There exists an efficient subroutine which, given a solution Y of size k + 1 determines whether it can be compressed to a solution of size k. That is, it finds a solution of size k or determines that no such solution exists.

If these assumptions are met, then the problem can be solved by adding vertices one at a time to an induced subgraph, and finding the solution to the induced subgraph, as follows:

1. Start with a subgraph induced by a vertex set S of size k, and a solution X that equals S itself. (If X is not a solution to S then no solution exists.)
2. While S ≠ V, perform the following steps:
   • Let v be any vertex of V \ S, and add v to S
   • Test whether the (k + 1)-vertex solution Y = X∪ {v} to S can be compressed to a k-vertex solution.
   • If it cannot be compressed, abort the algorithm: the input graph has no k-vertex solution.
   • Otherwise, set X to the new compressed solution and continue the loop.

This algorithm calls the compression subroutine a linear number of times. Therefore, if the compression variant is solvable in fixed-parameter tractable time, i.e., f(k) · n^c for some constant c, then the iterative compression procedure solving the entire problem runs in f(k) · n^c+1 time. The same technique can be applied to finding sets of edges for graph properties closed under subgraphs (rather than induced subgraph), or for other properties beyond graph theory. When the value of the parameter k is unknown, it can be found by using an outer level of exponential search or sequential search for the optimal choice of k, with each step of the search based on the same iterative compression algorithm.

Applications

In their original paper Reed et al. showed how to make a graph bipartite by deleting at most k vertices in time O(3^k kmn). Later, a simpler algorithm was given, also using iterative compression, by Lokshstanov, Saurabh and Sikdar. ^[6] In order to compress a deletion set Y of size k + 1 to a deletion set X of size k, their algorithm tests all of the 3^k+1 partitions of Y into three subsets: the subset of Y that belongs to the new deletion set, and the two subsets of Y that belong to the two sides of the bipartite graph that remains after deleting X. Once these three sets have been selected, the remaining vertices of a deletion set X (if it exists) can be found from them by applying a max-flow min-cut algorithm.

Vertex cover is another example for which iterative compression can be employed. In the vertex cover problem, a graph G = (V,E) and a natural number k are taken as inputs and the algorithm must decide whether there exists a set X of k vertices such that every edge is incident to a vertex in X. In the compression variant of the problem, the input is a set Y of k + 1 vertices that are incident to all edges of the graph, and the algorithm must find a set X of size k with the same property, if it exists. One way to do this is to test all 2^{k + 1} choices of which subset of Y is to be removed from the cover and reintroduced back into the graph. Such a choice can only work if no two removed vertices are adjacent, and for each such choice, the subroutine must include in the cover all the vertices outside Y that are incident to an edge that becomes uncovered by this removal. Using this subroutine in an iterative compression algorithm gives a simple O(2^k n²) algorithm for vertex cover.

See also

• Kernelization, a different design technique for fixed-parameter tractable algorithms

References

1. Reed, Bruce; Smith, Kaleigh; Vetta, Adrian (2004), "Finding odd cycle transversals", Operations Research Letters, 32 (4): 299–301, doi:10.1016/j.orl.2003.10.009, MR   2057781 .
2. Niedermeier, Rolf, Invitation to Fixed-Parameter Algorithms, Oxford University Press, p. 184, ISBN   9780198566076
3. Cygan, Marek; Fomin, Fedor V.; Kowalik, Lukasz; Lokshtanov, Daniel; Marx, Daniel; Pilipczuk, Marcin; Pilipczuk, Michal; Saurabh, Saket (2015), Parameterized Algorithms, Springer, p. 555, ISBN   978-3-319-21274-6 .
4. Guo, Jiong; Moser, Hannes; Niedermeier, Rolf (2009), "Iterative compression for exactly solving NP-hard minimization problems", Algorithmics of Large and Complex Networks, Lecture Notes in Computer Science, vol. 5515, Springer, pp. 65–80, doi:10.1007/978-3-642-02094-0_4, ISBN   978-3-642-02093-3 .
5. Fomin, Fedor; Gaspers, Serge; Kratsch, Dieter; Liedloff, Mathieu; Saurabh, Saket (2010), "Iterative compression and exact algorithms", Theoretical Computer Science , 411 (7): 1045–1053, doi: 10.1016/j.tcs.2009.11.012 .
6. Lokshtanov, Daniel; Saurabh, Saket; Sikdar, Somnath (2009), "Simpler parameterized algorithm for OCT", 20th International Workshop on Combinatorial Algorithms, IWOCA 2009, Hradec nad Moravicí, Czech Republic, June 28–July 2, 2009, Revised Selected Papers, Lecture Notes in Computer Science, vol. 5874, Springer, pp. 380–384, doi:10.1007/978-3-642-10217-2_37, ISBN   978-3-642-10216-5 .