Set cover problem

From Wikipedia, the free encyclopedia

The set covering problem is a classical question in computer science and complexity theory. As input you are given several sets. They may have some elements in common. You must select a minimum number of these sets so that the sets you have picked contain all the elements that are contained in any of the sets in the input. It was one of Karp's 21 NP-complete problems shown to be NP-complete in 1972.

More formally, given a universe $\mathcal{U}$ and a family $\mathcal{S}$ of subsets of $\mathcal{U}$ , a cover is a subfamily $\mathcal{C}\subseteq\mathcal{S}$ of sets whose union is $\mathcal{U}$ . In the set covering decision problem, the input is a pair $(\mathcal{U},\mathcal{S})$ and an integer $k$ ; the question is whether there is a set covering of size $k$ or less. In the set covering optimization problem, the input is a pair $(\mathcal{U},\mathcal{S})$ , and the task is to find a set covering which uses the fewest sets.

The decision version of set covering is NP complete, and the optimization version of set cover is NP hard.

Set covering is equivalent to the Hitting set problem. It is easy to see this by observing that an instance of set covering can be viewed as an arbitrary bipartite graph, with sets represented by vertices on the left, the universe represented by vertices on the right, and edges representing the inclusion of elements in sets. The task is then to find a minimum cardinality subset of left-vertices which covers all of the right-vertices. In the Hitting set problem, the objective is to cover the left-vertices using a minimum subset of the right vertices. Converting from one problem to the other is therefore achieved by interchanging the two sets of vertices.

The set covering problem can be seen as a finite version of the notion of compactness in topology, where the elements of certain infinite families of sets can be covered by choosing only finitely many of them.

1 Greedy algorithm
2 Low-frequency systems
3 Inapproximability results
4 Related problems
5 References
6 External links

[edit] Greedy algorithm

The greedy algorithm for set covering chooses sets according to one rule: at each stage, choose the set which contains the largest number of uncovered elements. It can be shown that this algorithm achieves an approximation ratio of $H (s)$ , where $s$ is the size of the largest set and $H (n)$ is the $n$ -th harmonic number:

$H(n) = \sum_{k=1}^{n} \frac{1}{k} \le \ln{n} +1$

Tight example for the greedy algorithm with k=3

There is a standard example on which the greedy algorithm achieves an approximation ratio of $log 2 (n) / 2$ . The universe consists of $n = 2 (k + 1) - 2$ elements. The set system consists of $k$ pairwise disjoint sets $S_1,\ldots,S_k$ with sizes $2,4,8,\ldots,2^k$ respectively, as well as two additional disjoint sets $T 0, T 1$ , each of which contains half of the elements from each $S i$ . On this input, the greedy algorithm takes the sets $S_k,\ldots,S_1$ , in that order, while the optimal solution consists only of $T 0$ and $T 1$ . An example of such an input for $k = 3$ is pictured on the right.

Inapproximability results show that the greedy algorithm is essentially the best-possible polynomial time approximation algorithm for set cover (see Inapproximability results below), under plausible complexity assumptions.

[edit] Low-frequency systems

If each element occurs in at most $f$ sets, then a solution can be found in polynomial time which approximates the optimum to within a factor of $f$ . The algorithm formulates the set covering instance as an integer program, which is relaxed to a linear program. The resulting linear program can be solved in polynomial time (e.g. using the Ellipsoid method), and the solutions are rounded to obtain an approximate integral solution.

[edit] Inapproximability results

Lund and Yannakakis (1994) showed that set covering cannot be approximated in polynomial time to within a factor of $(\log_2{n})/2\approx{}0.72\ln{n}$ , unless NP has quasi-polynomial time algorithms. Feige (1998) improved this lower bound to $(1-o(1))\cdot\ln{n}$ under the same assumptions, which essentially matches the approximation ratio achieved by the greedy algorithm. Raz and Safra established a lower bound of $c\cdot\ln{n}$ , where $c$ is a constant, under the weaker assumption that P $\not=$ NP. A similar result with a higher value of $c$ was recently proved by Alon, Moshkovitz, and Safra.

[edit] Related problems

Vertex cover
Set packing
Edge cover
Hitting set: dual problem of set cover

[edit] References

Noga Alon, Dana Moshkovitz, and Muli Safra. Algorithmic construction of sets for k-restrictions. ACM Transactions on Algorithms (TALG), v.2 n.2, p.153-177, April 2006.

Thomas H. Cormen, Charles E. Leiserson, Ronald L. Rivest, and Clifford Stein. Introduction to Algorithms, Second Edition. MIT Press and McGraw-Hill, 2001. ISBN 0-262-03293-7. Section 35.3, The set-covering problem, pp.1033–1038.

Uriel Feige. A Threshold of ln $n$ for Approximating Set Cover. Journal of the ACM (JACM), v.45 n.4, p.634 - 652, July 1998.

Carsten Lund and Mihalis Yannakakis. On the hardness of approximating minimization problems. Journal of the ACM (JACM), v.41 n.5, p.960-981, Sept. 1994

Ran Raz and Muli Safra. A sub-constant error-probability low-degree test, and a sub-constant error-probability PCP characterization of NP. Proceedings of STOC 1997, pp. 475-484, 1997.