Google matrix

From testwiki
Jump to navigation Jump to search

Template:Short description Template:Multiple issues

Fig.1. Google matrix of Wikipedia articles network, written in the bases of PageRank index; fragment of top 200 X 200 matrix elements is shown, total size N=3282257 (from [1])

A Google matrix is a particular stochastic matrix that is used by Google's PageRank algorithm. The matrix represents a graph with edges representing links between pages. The PageRank of each page can then be generated iteratively from the Google matrix using the power method. However, in order for the power method to converge, the matrix must be stochastic, irreducible and aperiodic.

Adjacency matrix A and Markov matrix S

In order to generate the Google matrix G, we must first generate an adjacency matrix A which represents the relations between pages or nodes.

Assuming there are N pages, we can fill out A by doing the following:

  1. A matrix element Ai,j is filled with 1 if node j has a link to node i, and 0 otherwise; this is the adjacency matrix of links.
  2. A related matrix S corresponding to the transitions in a Markov chain of given network is constructed from A by dividing the elements of column "j" by a number of kj=Σi=1NAi,j where kj is the total number of outgoing links from node j to all other nodes. The columns having zero matrix elements, corresponding to dangling nodes, are replaced by a constant value 1/N. Such a procedure adds a link from every sink, dangling state a to every other node.
  3. Now by the construction the sum of all elements in any column of matrix S is equal to unity. In this way the matrix S is mathematically well defined and it belongs to the class of Markov chains and the class of Perron-Frobenius operators. That makes S suitable for the PageRank algorithm.

Construction of Google matrix G

Fig.2. Google matrix of Cambridge University network (2006), coarse-grained matrix elements are written in the bases of PageRank index, total size N=212710 is shown (from [1])

Then the final Google matrix G can be expressed via S as:

Gij=αSij+(1α)1N(1)

By the construction the sum of all non-negative elements inside each matrix column is equal to unity. The numerical coefficient α is known as a damping factor.

Usually S is a sparse matrix and for modern directed networks it has only about ten nonzero elements in a line or column, thus only about 10N multiplications are needed to multiply a vector by matrix G.[2][3]

Examples of Google matrix

An example of the matrix S construction via Eq.(1) within a simple network is given in the article CheiRank.

For the actual matrix, Google uses a damping factor α around 0.85.[2][3][4] The term (1α) gives a surfer probability to jump randomly on any page. The matrix G belongs to the class of Perron-Frobenius operators of Markov chains.[2] The examples of Google matrix structure are shown in Fig.1 for Wikipedia articles hyperlink network in 2009 at small scale and in Fig.2 for University of Cambridge network in 2006 at large scale.

Spectrum and eigenstates of G matrix

File:Googlematrixcambridge2006spectrum.gif
Fig3. The spectrum of eigenvalues of the Google matrix of University of Cambridge from Fig.2 at α=1, blue points show eigenvalues of isolated subspaces, red points show eigenvalues of core component (from [5])

For 0<α<1 there is only one maximal eigenvalue λ=1 with the corresponding right eigenvector which has non-negative elements Pi which can be viewed as stationary probability distribution.[2] These probabilities ordered by their decreasing values give the PageRank vector Pi with the PageRank Ki used by Google search to rank webpages. Usually one has for the World Wide Web that P1/Kβ with β0.9. The number of nodes with a given PageRank value scales as NP1/Pν with the exponent ν=1+1/β2.1.[6][7] The left eigenvector at λ=1 has constant matrix elements. With 0<α all eigenvalues move as λiαλi except the maximal eigenvalue λ=1, which remains unchanged.[2] The PageRank vector varies with α but other eigenvectors with λi<1 remain unchanged due to their orthogonality to the constant left vector at λ=1. The gap between λ=1 and other eigenvalue being 1α0.15 gives a rapid convergence of a random initial vector to the PageRank approximately after 50 multiplications on G matrix.

Fig4. Distribution of eigenvalues λi of Google matrices in the complex plane at α=1 for dictionary networks: Roget (A, N=1022), ODLIS (B, N=2909) and FOLDOC (C, N=13356); UK university WWW networks: University of Wales (Cardiff) (D, N=2778), Birmingham City University (E, N=10631), Keele University (Staffordshire) (F, N=11437), Nottingham Trent University (G, N=12660), Liverpool John Moores University (H, N=13578)(data for universities are for 2002) (from [8])

At α=1 the matrix G has generally many degenerate eigenvalues λ=1 (see e.g. [6][8]). Examples of the eigenvalue spectrum of the Google matrix of various directed networks is shown in Fig.3 from [5] and Fig.4 from.[8]

The Google matrix can be also constructed for the Ulam networks generated by the Ulam method [8] for dynamical maps. The spectral properties of such matrices are discussed in [9,10,11,12,13,15].[5][9] In a number of cases the spectrum is described by the fractal Weyl law [10,12].

Fig5. Distribution of eigenvalues λ in the complex plane for the Google matrix G of the Linux Kernel version 2.6.32 with matrix size N=285509 at α=0.85, unit circle is shown by solid curve (from [9])
Fig.6 Coarse-grained probability distribution for the eigenstates of the Google matrix for Linux Kernel version 2.6.32. The horizontal lines show the first 64 eigenvectors ordered vertically by |λi| (from [9])

The Google matrix can be constructed also for other directed networks, e.g. for the procedure call network of the Linux Kernel software introduced in [15]. In this case the spectrum of λ is described by the fractal Weyl law with the fractal dimension d1.3 (see Fig.5 from [9]). Numerical analysis shows that the eigenstates of matrix G are localized (see Fig.6 from [9]). Arnoldi iteration method allows to compute many eigenvalues and eigenvectors for matrices of rather large size [13].[5][9]

Other examples of G matrix include the Google matrix of brain [17] and business process management [18], see also.[1] Applications of Google matrix analysis to DNA sequences is described in [20]. Such a Google matrix approach allows also to analyze entanglement of cultures via ranking of multilingual Wikipedia articles abouts persons [21]

Historical notes

The Google matrix with damping factor was described by Sergey Brin and Larry Page in 1998 [22], see also articles on PageRank history [23],[24].

See also

References

Template:Reflist Template:Refbegin

Template:Refend