View source for ♯P-completeness of 01-permanent

{{short description|Mathematical proof about the permanent of matrices}}
{{Correct title|title=#P-completeness of 01-permanent|reason=hash}}

The '''#P-completeness of 01-permanent''', sometimes known as '''Valiant's theorem''',<ref name="P">[[Christos Papadimitriou|Christos H. Papadimitriou]]. ''Computational Complexity.''  [[Addison-Wesley]], 1994. {{isbn|0-201-53082-1}}. Page 443</ref> is a [[mathematical proof]] about the [[permanent (mathematics)|permanent]] of [[matrix (mathematics)|matrices]], considered a seminal result in [[computational complexity theory]].<ref>[[Allen Kent]], James G. Williams, Rosalind Kent and Carolyn M. Hall (editors). [https://books.google.com/books?id=uDegDR4ikTQC&dq=%22permanent+of+a+matrix%22+valiant&pg=PA34 ''Encyclopedia of microcomputers''.][[Marcel Dekker]], 1999. {{isbn|978-0-8247-2722-2}}; p. 34</ref><ref>Jin-Yi Cai, A. Pavan and D. Sivakumar, [https://books.google.com/books?id=fIAMFv4doooC&dq=%22permanent+of+a+matrix%22+valiant&pg=PA90 ''On the Hardness of Permanent.''] In: STACS, '99: 16th Annual Symposium on Theoretical Aspects of Computer Science, Trier, Germany, March 4–6, 1999 Proceedings. pp. 90–99. [[Springer-Verlag]], New York, LLC
Pub. Date: October 2007. {{isbn|978-3-540-65691-3}}; p. 90.</ref> In a 1979 [[scholarly paper]], [[Leslie Valiant]] proved that the [[computational problem]] of computing the permanent of a matrix is [[Sharp-P-complete|#P-hard]], even if the matrix is restricted to have entries that are all 0 or 1.<ref>{{cite journal| author = Leslie G. Valiant| title = The Complexity of Computing the Permanent| journal = Theoretical Computer Science| volume = 8| issue = 2| pages = 189–201| publisher = Elsevier| date = 1979| doi = 10.1016/0304-3975(79)90044-6| doi-access = }}</ref> In this restricted case, computing the permanent is even [[Sharp-P-complete|#P-complete]], because it corresponds to the [[Sharp-P|#P problem]] of counting the number of permutation matrices one can get by changing ones into zeroes.

Valiant's 1979 paper also introduced   [[Sharp-P|#P]] as a [[complexity class]].<ref>[[Lance Fortnow]]. [https://books.google.com/books?id=JWOA9M9CcX8C&dq=permanent+Valiant&pg=PA265 ''My Favorite Ten Complexity Theorems of the Past Decade.''] Foundations of Software Technology and Theoretical Computer Science: Proceedings of the 14th Conference, Madras, India, December 15–17, 1994.  P. S. Thiagarajan (editor), pp. 256–275, [[Springer-Verlag]], New York, 2007. {{isbn|978-3-540-58715-6}}; p. 265</ref>

Valiant's definition of completeness, and his proof of completeness of 01-permanent, both used [[Polynomial-time reduction|polynomial-time]] [[Turing reduction]]s. In this kind of reduction, a single hard instance of some other problem in #P is reduced to computing the permanent of a sequence of multiple graphs, each of which could potentially depend on the results of previous permanent computations. A later simplification by {{harvtxt|Ben-Dor |Halevi|1993}} showed that it is possible to use a weaker notion of reduction, a [[polynomial-time counting reduction]], that translates the other problem into a single instance of the permanent problem.

==Significance==
One reason for interest in the computational complexity of the permanent is that it provides an example of a problem where constructing a single solution can be done efficiently but where counting all solutions is hard.<ref>{{cite book | last=Bürgisser | first=Peter | title=Completeness and reduction in algebraic complexity theory | zbl=0948.68082 | series=Algorithms and Computation in Mathematics | volume=7 | location=Berlin | publisher=[[Springer-Verlag]] | year=2000 | isbn=978-3-540-66752-0 | page=2 | url=https://books.google.com/books?id=XBlnjSW1VekC&q=permanent+Valiant&pg=PA2 }}</ref>  As Papadimitriou writes in his book ''Computational Complexity'':
{{cquote|The most impressive and interesting #P-complete problems ''are those for which the corresponding search problem can be solved in polynomial time.'' The PERMANENT problem for 0–1 matrices, which is equivalent to the problem of counting perfect matchings in a [[bipartite graph]] [...] is the classic example here.<ref name="P"/>}}
Specifically, [[Computation of the permanent of a matrix|computing the permanent]] (shown to be difficult by Valiant's results) is closely connected with finding a [[perfect matching]] in a bipartite graph, which is solvable in polynomial time by the [[Hopcroft–Karp algorithm]].<ref>[[John Hopcroft|John E. Hopcroft]], [[Richard Karp|Richard M. Karp]]: ''An <math>n^{5/2}</math> Algorithm for Maximum Matchings in Bipartite Graphs.'' SIAM J. Comput. 2(4), 225–231 (1973)</ref><ref name=clrs>{{Introduction to Algorithms|2|chapter=26.5: The relabel-to-front algorithm|pages=696–697}}</ref> For a bipartite graph with 2''n'' vertices partitioned into two parts with ''n'' vertices each, the number of perfect matchings equals the permanent of its [[biadjacency matrix]] and the square of the number of perfect matchings is equal to the permanent of its [[adjacency matrix]].<ref name="Kozen"/> Since any 0–1 matrix is the biadjacency matrix of some bipartite graph, Valiant's theorem implies<ref name="Kozen">[[Dexter Kozen]]. [https://books.google.com/books?id=L_AMnf9UF9QC&dq=%22permanent+of+a+matrix%22+valiant&pg=PA142 ''The Design and Analysis of Algorithms.''] [[Springer-Verlag]], New York, 1991.
{{isbn|978-0-387-97687-7}};  pp. 141–142</ref> that the problem of counting the number of perfect matchings in a bipartite graph is [[Sharp-P-complete|#P-complete]], and in conjunction with [[Toda's theorem]] this implies that it is hard for the entire [[polynomial hierarchy]].<ref>[[Seinosuke Toda]]. [http://siamdl.aip.org/getabs/servlet/GetabsServlet?prog=normal&id=SMJCAT000020000005000865000001&idtype=cvips&gifs=Yes PP is as Hard as the Polynomial-Time Hierarchy.] [[SIAM Journal on Computing]], Volume 20 (1991), Issue 5, pp. 865&ndash;877.</ref><ref>{{Cite web |url=http://www.sigact.org/Prizes/Godel/1998.html |title=1998 Gödel Prize. Seinosuke Toda |access-date=2016-07-06 |archive-url=https://web.archive.org/web/20140108203934/http://www.sigact.org/Prizes/Godel/1998.html |archive-date=2014-01-08 |url-status=dead }}</ref>

The computational complexity of the permanent also has some significance in other aspects of complexity theory: it is not known whether [[NC (complexity)|NC]] equals P (informally, whether every polynomially-solvable problem can be solved by a polylogarithmic-time [[parallel algorithm]]) and [[Ketan Mulmuley]] has suggested an approach to resolving this question that relies on writing the permanent as the [[determinant]] of a matrix.<ref>[[Ketan Mulmuley]]. [https://dx.doi.org/10.1137/S0097539794282930 Lower Bounds in a Parallel Model without Bit Operations.] [[SIAM Journal on Computing]], Volume 28 (1999), Issue 4, pp. 1460&ndash;1509.</ref>

Hartmann <ref>W. Hartmann. On the complexity of immanants. Linear and Multilinear Algebra 18 (1985), no. 2, pp. 127–140.</ref> proved a generalization of Valiant's theorem concerning the complexity of computing [[immanant of a matrix|immanants of matrices]] that generalize both the determinant and the permanent.

==Ben-Dor and Halevi's proof==
Below, the proof that computing the permanent of a 01-matrix is [[Sharp-P-complete|#P-complete]] is described. It mainly follows the proof by {{harvtxt|Ben-Dor |Halevi|1993}}.<ref>{{Cite book |last1=Ben-Dor |first1=Amir |last2= Halevi |first2=Shai |year=1993 |url= http://people.csail.mit.edu/shaih/pubs/01perm.pdf |contribution= Zero-one permanent is ''#P''-complete, a simpler proof |title= Proceedings of the 2nd Israel Symposium on the Theory and Computing Systems |pages= 108–117}}</ref>

===Overview===
Any square matrix <math>A = (a_{ij})</math> can be viewed as the [[adjacency matrix]] of a [[directed graph]], with <math>a_{ij}</math> representing the weight of the edge from vertex <math>i</math> to vertex <math>j</math>. Then, the permanent of <math>A</math> is equal to the sum of the weights of all cycle-covers of the graph; this is a [[Permanent (mathematics)|graph-theoretic interpretation of the permanent]].

[[Sharp-SAT|#SAT]], a [[function problem]] related to the [[Boolean satisfiability problem]], is the problem of counting the number of satisfying assignments of a given Boolean formula. It is a [[Sharp-P-complete|#P-complete]] problem (by definition), as any NP machine can be encoded into a Boolean formula by a process similar to that in [[Cook's theorem]], such that the number of satisfying assignments of the Boolean formula is equal to the number of accepting paths of the NP machine. Any formula in SAT [[3SAT|can be rewritten]] as a formula in 3-[[conjunctive normal form|CNF]] form preserving the number of satisfying assignments, and so #SAT and #3SAT are equivalent and #3SAT is [[Sharp-P-complete|#P-complete]] as well.

In order to prove that 01-Permanent is [[Sharp-P-complete|#P-hard]], it is therefore sufficient to show that the number of satisfying assignments for a 3-CNF formula can be expressed succinctly as a function of the permanent of a matrix that contains only the values 0 and 1. This is usually accomplished in two steps:
# Given a 3-CNF formula <math>\phi</math>, construct a directed integer-weighted graph <math>G_\phi</math>, such that the sum of the weights of cycle covers of <math>G_\phi</math> (or equivalently, the permanent of its adjacency matrix) is equal to the number of satisfying assignments of <math>\phi</math>. This establishes that Permanent is #P-hard.
# Through a series of reductions, reduce Permanent to 01-Permanent, the problem of computing the permanent of a matrix all entries 0 or 1. This establishes that 01-permanent is #P-hard as well.

===Constructing the integer graph===

Given a 3CNF-formula <math>\phi</math> with <math>m</math> clauses and <math>n</math> variables, one can construct a weighted, directed graph <math>G_\phi</math> such that
# each satisfying assignment for <math>\phi</math> will have a corresponding set of cycle covers in <math>G_\phi</math> where the sum of the weights of cycle covers in this set will be <math>12^m</math> ; and
# all other cycle covers in <math>G_\phi</math> will have weights summing to 0.
Thus if <math>(\#\phi)</math> is the number of satisfying assignments for <math>\phi</math>, the permanent of this graph will be <math>12^m \cdot (\#\phi)</math>.
(Valiant's original proof constructs a graph with entries in <math>\{-1,0,1,2,3\}</math> whose permanent is <math>4^{t(\phi)}\cdot(\#\phi)</math> where <math>t(\phi)</math> is "twice the number of occurrences of literals in <math>\phi</math>" – <math>m</math>.)

The graph construction makes use of a component that is treated as a "black box."  To keep the explanation simple, the properties of this component are given without actually defining the structure of the component.

To specify <math>G_\phi</math>, one first constructs a variable node in <math>G_\phi</math> for each of the <math>n</math> variables in <math>\phi</math>. Additionally, for each of the <math>m</math> clauses in <math>\phi</math>, one constructs a clause component <math>C_j</math> in <math>G_\phi</math> that functions as a sort of "black box." All that needs to be noted about <math>C_j</math> is that it has three input edges and three output edges. The input edges come either from variable nodes or from previous clause components (e.g., <math>C_i</math> for some <math>i<j</math>) and the output edges go either to variable nodes or to later clause components (e.g., <math>C_i</math> for some <math>o>j</math>). The first input and output edges correspond with the first variable of the clause <math>j</math>, and so on. Thus far, all of the nodes that will appear in the graph <math>G_\phi</math> have been specified.

Next, one would consider the edges. For each variable <math>x_i</math> of <math>\phi</math>, one makes a true cycle (T-cycle) and a false cycle (F-cycle) in <math>G_\phi</math>. To create the T-cycle, one starts at the variable node for <math>x_i</math> and draw an edge to the clause component <math>C_j</math> that corresponds to the first clause in which <math>x_i</math> appears. If <math>x_i</math> is the first variable in the clause of <math>\phi</math> corresponding to <math>C_j</math>, this edge will be the first input edge of <math>C_j</math>, and so on. Thence, draw an edge to the next clause component corresponding to the next clause of <math>\phi</math> in which <math>x_i</math> appears, connecting it from the appropriate output edge of <math>C_j</math> to the appropriate input edge of the next clause component, and so on. After the last clause in which <math>x_i</math> appears, we connect the appropriate output edge of the corresponding clause component back to <math>x_i</math>'s variable node. Of course, this completes the cycle. To create the F-cycle, one would follow the same procedure, but connect <math>x_i</math>'s variable node to those clause components in which ~<math>x_i</math> appears, and finally back to <math>x_i</math>'s variable node. All of these edges outside the clause components are termed ''external edges'', all of which have weight 1. Inside the clause components, the edges are termed ''internal edges''. Every external edge is part of a T-cycle or an F-cycle (but not both—that would force inconsistency).

Note that the graph <math>G_\phi</math> is of size linear in <math>|\phi|</math>, so the construction can be done in polytime (assuming that the clause components do not cause trouble).

====Notable properties of the graph{{Anchor|A very nice property of the graph}}====

A useful property of <math>G_\phi</math> is that its cycle covers correspond to variable assignments for <math>\phi</math>. For a cycle cover <math>Z</math> of <math>G_\phi</math>, one can say that <math>Z</math> induces an assignment of values for the variables in <math>\phi</math> just in case <math>Z</math> contains all of the external edges in <math>x_i</math>'s T-cycle and none of the external edges in <math>x_i</math>'s F-cycle for all variables <math>x_i</math> that the assignment makes true, and vice versa for all variables <math>x_i</math> that the assignment makes false. Although any given cycle cover <math>Z</math> need not induce an assignment for <math>\phi</math>, any one that does induces exactly one assignment, and the same assignment induced depends only on the external edges of <math>Z</math>. The term <math>Z</math> is considered an incomplete cycle cover at this stage, because one talks only about its external edges, <math>M</math>. In the section below, one considers <math>M</math>-completions to show that one has a set of cycle covers corresponding to each <math>M</math> that have the necessary properties.

The sort of covers <math>Z</math> that do not induce assignments are the ones with cycles that "jump" inside the clause components. That is, if for every <math>C_j</math>, at least one of <math>C_j</math>'s input edges is in <math>Z</math>, and every output edge of the clause components is in <math>Z</math> when the corresponding input edge is in <math>Z</math>, then <math>Z</math> is proper with respect to each clause component, and <math>Z</math> will produce a satisfying assignment for <math>\phi</math>. This is because proper covers <math>Z</math> contain either the complete T-cycle or the complete F-cycle of every variable <math>x_i</math> in <math>\phi</math> as well as each including edges going into and coming out of each clause component. Thus, these covers assign either true or false (but never both) to each <math>x_i</math> and ensure that each clause is satisfied. Further, the sets of cycle covers corresponding to all such <math>Z</math> have weight <math>12^m</math>, and any other <math>Z</math> has weight <math>0</math>. The reasons for this depend on the construction of the clause components, and are outlined below.

====The clause component====

To understand the relevant properties of the clause components <math>C_j</math>, one needs the notion of an M-completion. A cycle cover <math>Z</math> induces a satisfying assignment just in case its external edges satisfy certain properties. For any cycle cover of <math>G_\phi</math>, consider only its external edges, the subset <math>M</math>. Let <math>M</math> be a set of external edges. A set of internal edges <math>L</math> is an <math>M</math>-completion just in case <math>M\cup L</math> is a cycle cover of <math>G_\phi</math>. Further, denote the set of all <math>M</math>-completions by <math>L^M</math> and the set of all resulting cycle covers of <math>G_\phi</math> by <math>Z^M</math>.

Recall that construction of <math>G_\phi</math> was such that each external edge had weight 1, so the weight of <math>Z^M</math>, the cycle covers resulting from any <math>M</math>, depends only on the internal edges involved. We add here the premise that the construction of the clause components is such that the sum over possible <math>M</math>-completions of the weight of the internal edges in each clause component, where <math>M</math> is proper relative to the clause component, is 12. Otherwise the weight of the internal edges is 0.  Since there are <math>m</math> clause components, and the selection of sets of internal edges, <math>L</math>, within each clause component is independent of the selection of sets of internal edges in other clause components, so one can multiply everything to get the weight of <math>Z^M</math>. So, the weight of each <math>Z^M</math>, where <math>M</math> induces a satisfying assignment, is <math>12^m</math>. Further, where <math>M</math> does not induce a satisfying assignment, <math>M</math> is not proper with respect to some <math>C_j</math>, so the product of the weights of internal edges in <math>Z^M</math> will be <math>0</math>.

The clause component is a weighted, directed graph with 7 nodes with edges weighted and nodes arranged to yield the properties specified above, and is given in Appendix A of Ben-Dor and Halevi (1993). Note that the internal edges here have weights drawn from the set <math>\{-1,0,1,2,3\}</math>; not all edges have 0–1 weights.

Finally, since the sum of weights of all the sets of cycle covers inducing any particular satisfying assignment is <math>12^m</math>, and the sum of weights of all other sets of cycle covers is 0, one has <math>\operatorname{Perm}(G_\phi)=12^m\cdot(\#\phi)</math>. The following section reduces computing <math>\operatorname{Perm}(G_\phi)</math> to the permanent of a 01 matrix.

===01-Matrix===

The above section has shown that Permanent is #P-hard. Through a series of reductions, any permanent can be reduced to the permanent of a matrix with entries only 0 or 1. This will prove that 01-Permanent is #P-hard as well.

====Reduction to a non-negative matrix====

Using [[modular arithmetic]], convert an integer matrix <math>A</math> into an equivalent non-negative matrix <math>A'</math> so that the permanent of <math>A</math> can be computed easily from the permanent of <math>A'</math>, as follows:

Let <math>A</math> be an <math>n \times n</math> integer matrix where no entry has a magnitude larger than <math>\mu</math>.
* Compute <math>Q = 2 \cdot n! \cdot \mu^n + 1</math>. The choice of <math>Q</math> is due to the fact that <math>|\operatorname{Perm}(A)| \le n! \cdot \mu^n</math>
* Compute <math>A' = A\,\bmod\,Q</math>
* Compute <math>P = \operatorname{Perm}(A') \bmod Q</math>
* If <math>P < Q/2</math> then Perm(''A'') = ''P''. Otherwise <math>\operatorname{Perm}(A) = P - Q</math>

The transformation of <math>A</math> into <math>A'</math> is polynomial in <math>n</math> and <math>\log (\mu)</math>, since the number of bits required to represent <math>Q</math> is polynomial in <math>n</math> and <math>\log (\mu)</math>

An example of the transformation and why it works is given below.
:<math>A = \begin{bmatrix}2 & -2 \\ -2 & 1\end{bmatrix}</math>
:<math>\operatorname{Perm}(A) = 2 \cdot 1 + (-2) \cdot (-2) = 6.</math>

Here, <math>n = 2</math>, <math>\mu = 2</math>, and <math>\mu^n = 4</math>, so <math>Q = 17</math>. Thus
:<math>A' = A \bmod 17 = \begin{bmatrix}2 & 15 \\ 15 & 1\end{bmatrix}.</math>

Note how the elements are non-negative because of the modular arithmetic. It is simple to compute the permanent
:<math>\operatorname{Perm}(A') = 2 \cdot 1 + 15 \cdot 15 = 227</math>

so <math>P = 227 \bmod 17 = 6</math>. Then <math>P < Q/2</math>, so <math>\operatorname{Perm}(A) = P = 6.</math>

====Reduction to powers of 2====
[[Image:Permanent-Nonneg2Powers.png|400px|right|Figure 1: Construction of 2Power from NonNeg]]

Note that any number can be [[Binary numeral system|decomposed into a sum of powers of 2]]. For example,
:<math>13 = 2^3 + 2^2 + 2^0</math>

This fact is used to convert a non-negative matrix into an equivalent matrix whose entries are all powers of 2. The reduction can be expressed in terms of graphs equivalent to the matrices.

Let <math>G</math> be a <math>n</math>-node weighted directed graph with non-negative weights, where largest weight is <math>W</math>. Every edge <math>e</math> with weight <math>w</math> is converted into an equivalent edge with weights in powers of 2 as follows:
:<math>w = 2^{x_1} + 2^{x_2} + \cdots + 2^{x_r}</math>, <math>0 \le x_1 \le x_2 \le \cdots \le x_r \le \log (w)</math>

This can be seen graphically in the Figure 1. The subgraph that replaces the existing edge contains <math>r</math> nodes and <math>3r</math> edges.

To prove that this produces an equivalent graph <math>G'</math> that has the same permanent as the original, one must show the correspondence between the cycle covers of <math>G</math> and <math>G'</math>.

Consider some cycle-cover <math>R</math> in <math>G</math>.
* If an edge <math>e</math> is not in <math>R</math>, then to cover all the nodes in the new sub graph, one must use the self-loops. Since all self-loops have a weight of 1, the weight of cycle-covers in <math>R</math> and <math>R'</math> match.
* If <math>e</math> is in <math>R</math>, then in all the corresponding cycle-covers in <math>G'</math>, there must be a path from <math>u</math> to <math>v</math>, where <math>u</math> and <math>v</math> are the nodes of edge <math>e</math>. From the construction, one can see that there are <math>r</math> different paths and sum of all these paths equal to the weight of the edge in the original graph <math>G</math>. So the weight of corresponding cycle-covers in <math>G</math> and <math>G'</math> match.

Note that the size of <math>G'</math> is polynomial in <math>n</math> and <math>\log W</math>.

====Reduction to 0–1====

<!-- Image with unknown copyright status removed: [[Image:Permanent-Proof-01matrix.gif|275px|thumb|right|Figure 2: Construction of a 01-matrix from 2Power]] -->
[[Image:Permanent-2powers01.png|right|Figure 2: Construction of a 01-matrix from 2Power]]

The objective here is to reduce a matrix whose entries are powers of 2 into an equivalent matrix containing only zeros and ones (i.e. a directed graph where each edge has a weight of 1).

Let <math>G</math> be a <math>n</math>-node directed graph where all the weights on edges are powers of two.  Construct a graph, <math>G'</math>, where the weight of each edge is 1 and <math>\operatorname{Perm}(G) = \operatorname{Perm}(G')</math>.  The size of this new graph, <math>(G')</math>, is polynomial in <math>n</math> and <math>p</math> where the maximal weight of any edge in graph <math>G</math> is <math>2^p</math>.

This reduction is done locally at each edge in <math>G</math> that has a weight larger than 1. Let <math>e = (u, v)</math> be an edge in <math>G</math> with a weight <math>w = 2^r > 1</math>.  It is replaced by a subgraph <math>J_e</math> that is made up of <math>2r</math> nodes and <math>6r</math> edges as seen in Figure 2. Each edge in <math>J_e</math> has a weight of 1.  Thus, the resulting graph <math>G'</math> contains only edges with a weight of 1.

Consider some cycle-cover <math>R</math> in <math>G</math>.
* If an original edge <math>e</math> from graph <math>G</math> is not in <math>R</math>, one cannot create a path through the new subgraph <math>J_e</math>.  The only way to form a cycle cover over <math>J_e</math> in such a case is for each node in the subgraph to take its self-loop.  As each edge has a weight of one, the weight of the resulting cycle cover is equal to that of the original cycle cover.
* However, if the edge in <math>G</math> is a part of the cycle cover then in any cycle cover of <math>G'</math> there must be a path from <math>u</math> to <math>v</math> in the subgraph. At each step down the subgraph there are two choices one can make to form such a path.  One must make this choice <math>r</math> times, resulting in <math>2^r</math> possible paths from <math>u</math> to <math>v</math>.  Thus, there are <math>2^r</math> possible cycle covers and since each path has a weight of 1, the sum of the weights of all these cycle covers equals the weight of the original cycle cover.

==Aaronson's proof==
In 2011, quantum computer scientist [[Scott Aaronson]] proved that the permanent is #P-hard using quantum methods.<ref>[[Scott Aaronson|S. Aaronson]], [http://eccc.hpi-web.de/report/2011/043/download A Linear-Optical Proof that the Permanent is #P-Hard]</ref>

==References==
{{Reflist}}

{{DEFAULTSORT:Permanent Is Sharp-P-Complete}}
[[Category:Computational problems]]
[[Category:Combinatorics]]
[[Category:Article proofs]]