Mixing time of quantum Gibbs sampling
for random sparse Hamiltonians

A natural set of jump operators for a given $n\times n$ Hamiltonian on a graph $G$ are $\bm{A}^{a}=\frac{1}{\sqrt{n}}|e_{a}\rangle\!\langle e_{a}|$ or similar operators supported on a few neighboring vertices of $G$. Importantly, these are not “local” in the sense of multi-particle Hamiltonians, which refers to being composed of terms that act on a small number of qubits—often also geometrically close to one another. Utilizing graph-local jump operators also significantly simplifies the structure of the Lindbladian and the analysis of mixing times for certain graph families.

Moving beyond graph-local jumps, the Lindbladian $\mathcal{L}_{\beta}$ of the quantum Gibbs sampler can still be efficiently implemented on a quantum computer with certain non-local jumps. This is possible as long as each jump $\bm{A}^{a}$ is efficiently implementable, the set of jumps $M$ includes both $\bm{A}^{a}$ and its adjoint $\bm{A}^{a{\dagger}}$, and $\sum_{a\in[M]}\|{\bm{A}^{a{\dagger}}\bm{A}^{a}}\|_{\infty}=1$ (due to this normalization condition, we will sometimes speak of the jumping distribution $\mathcal{A}$, from which the jump operators $\bm{A}^{a}$ are sampled with probability $\|{\bm{A}^{a{\dagger}}\bm{A}^{a}}\|$). This raises the question of whether there is an advantage in using non-local jumps that have a bounded spectral norm, or if more structured local jumps are sufficient to achieve a fast-mixing quantum MCMC. After all, classical continuous-time random walks are typically considered with local jumps on the graph vertices. However, in the context of graphs, we will see that the structured nature of local jumps offers no advantage, but rather seems to cause a slowdown of the resulting algorithm.

In addition to theoretical analysis, we also generated data for cyclic graphs, path graphs, and random $d$-regular graphs with $n$ vertices, as shown in Figure 1. These numerical results suggest spectral gaps of $o(n^{-1})$ for generic sparse graphs with graph-local jumps. We observed that increasing the constant $d$ does improve the spectral gap decay, though it never improved past the asymptotic decay $O(n^{-1})$.

These results are all suboptimal, since for an $n\times n$ Hamiltonian $\bm{H}$, we expect an efficient result would be polynomial in the number of qubits, i.e. $\mathrm{polylog}(n)$ rather than $\mathrm{poly}(n)$. The poor performance can be attributed to two factors: (1) The operators $\bm{A}^{a{\dagger}}\bm{A}^{a}$ have $L^{1}$ norm $\frac{1}{n}$. (2) In the energy basis, many entries of $\bm{A}^{a}$ are highly correlated.

The first drawback effectively scales the Lindbladian down by $\frac{1}{n}$, since the $L^{1}$ norm of $\bm{A}^{\dagger}\bm{A}$ can be as high as $1$ when the operator norm $\|{\bm{A}^{\dagger}\bm{A}}\|=\frac{1}{n}$. However, the chosen jump operators are projectors, so their $L^{1}$ and operator norms are equal. In both Theorem 2.1 and in the data, a spectral gap even worse than $\frac{1}{n}$ is observed. This is due to the second drawback. The aforementioned correlations lead to off-diagonal terms in the Lindbladian, which in general have the potential to dampen the spectral gap, and in the case of the cyclic graph provably do so. It appears that more generally, the biases of an ensemble of local jumps can introduce off-diagonal terms to the Lindbladian that decrease the spectral gap. The same harmful correlations appears to exist in higher degree graphs in addition to cyclic ones, though to a lesser extent as evidenced by the improved spectral gap.

We include the adjoint of each randomly chosen jump since the CKG Lindbladian requires the set of jump operators to be closed under adjoint, $\{\bm{A}^{a}:a\in[M]\}=\{\bm{A}^{a{\dagger}}:a\in[M]\}$. When $n$ is a power of $2$, the unitary $1$-design can be constructed as a tensor product of random Pauli operators on $\log_{2}(n)$ qubits, in which case the jumps are self-adjoint and can be sampled and implemented efficiently. The efficiency of our results on a general system relies on the ability to efficiently implement some unitary 1-design.

As we will see, in our application, this 1-design sampling is effectively equivalent to sampling from a Haar-random distribution. This approach improves on the results given for graph-local jumps, and is able to achieve an efficient algorithm in the number of qubits for a graph (running time $\mathrm{polylog}(n)$) for Gibbs sampling. This improved performance is in part because all the eigenvalues of a Haar random unitary have magnitude 1. Hence, it avoids the problem of $\bm{A}^{\dagger}\bm{A}$ having a relatively small $L^{1}$ norm given the constraint on its operator norm $\|{\bm{A}^{\dagger}\bm{A}}\|$. These jumps also avoid the second problem encountered for the graph-local jumps: Since the number of degrees of freedom of randomness is very large over the ensemble, any form of bias is mitigated. Indeed, the resulting Lindbladian over the full ensemble has no off-diagonal terms resulting from correlated elements of the jump operator.

Our results extend beyond cyclic graphs to any graph of bounded degree $d=O(1)$ where $\|{\bm{H}}\|\leq d$ at constant temperature, or more generally when $\beta\|{\bm{H}}\|=O(1)$. We refer to these sparse Hamiltonians as bounded degree and formally define them as:

While the examples of bounded degree Hamiltonians we consider are mostly graphs, the above theorem applies to preparing the Gibbs state for any Hamiltonian at a temperature $\beta^{-1}$ such that $\beta^{-1}=O(\|{\bm{H}}\|)$.

Theorem 2.2 demonstrates that bounded-degree Hamiltonians with non-local jumps exhibit fast mixing times. However, it leaves open the case of Hamiltonians with unbounded degrees, such as those with $d\leq\mathrm{polylog}(n)$. More formally, we define

In our next result, we show that again selecting the jumping distribution (including adjoints) to be $M$ samples from a unitary 1-design for sufficiently large $M$ and choosing the energy resolution $\sigma_{E}=\beta^{-1}$ yields an algorithm whose efficiency depends on its low-energy spectrum. In particular, the runtime scales inverse polynomially with the fraction of eigenvalues $\delta(n)$ of $\bm{H}$ that are within $O(\beta^{-1})$ of the minimum eigenvalue.

Having established a sufficient spectral condition for the fast mixing of random ensembles of sparse Hamiltonians, we now give explicit examples that satisfy this criterion. We also give one example, the hypercube, which does not, and for which local jumps in place of unitary design jumps achieve an exponential speedup. This example elucidates the potential of structured local jumps for speedups, in contrast to the case of the cyclic graph in which structured graph-local jumps yielded a slowdown.

However, we show in Theorem 4.4 that by choosing local jumps $\frac{1}{\sqrt{d}}\bm{Z}_{i}$, the spectral gap is $\frac{1}{d}$, yielding an efficient algorithm for Gibbs sampling. Hypercubes therefore provide an example where not graph-local jumps, but rather local jumps on the qubits, ensure fast mixing. The crucial feature of local jumps that improves mixing time is that a local jump $\bm{A}^{a}$ on a local Hamiltonian $\bm{H}$ satisfies $\|{[\bm{A}^{a},\bm{H}]}\|=O(1)$—i.e., the jump operator only jumps between nearby eigenstates. This property is not held by graph-local jumps in general, so they displayed no improvement in the studied cases. In general, local jumps are the strongest candidates for fast-mixing on local Hamiltonians, though for which classes of local Hamiltonians fast-mixing can be achieved is still largely open.

The proof of the mixing time for graph-local jumps in the cyclic graph involves two steps: First, in Appendix 7.1.3, we derive a general expression for the CKG Lindbladian in the energy basis given by equation (13).

We then utilize this expression along with the fully known spectrum of the cyclic graph to show that the Lindbladian is block-diagonal in the energy basis of this graph, as demonstrated in Appendix 7.2. One of these blocks corresponds to a classical Markov chain on the diagonal entries of the state in the energy basis, for which we establish a spectral gap lower bound using the canonical path method. For the remaining $n-1$ blocks, we apply the Gershgorin circle theorem to bound their eigenvalues.

Note that a CKG Lindbladian must have jump operators in adjoint pairs, so a Lindbladian with a single jump operator will not satisfy detailed balance. However, the expected Lindbladian over one Haar random jump operator is equal to the expected Lindbladian over the adjoint pair of a Haar random jump operator, by linearity of expectation.

The proof of Theorem 2.2 proceeds by first showing that this expected Lindbladian $\mathbb{E}_{\bm{A}\sim\mathcal{H}(U(n))}[\mathcal{L}_{\beta}]$ has a constant spectral gap, as long as $\beta(n)\|{\bm{H}(n)}\|$ is bounded by a constant as a function of system size. As before, we call such systems bounded degree, since for constant $\beta$ bounded degree graphs satisfy the required property. Indeed, if such a system has degree bounded by $d$, it must have spectrum in $[-d,d]$ by Gershgorin’s circle theorem, since every row consists of zeros and at most $d$ ones. Adding phases to the edges of these bounded degree graphs remains feasible by a similar argument, so there is no constraint of stoquasticity.

The result is stated formally as follows:

To establish Lemma 3.1, we show that for any system, the average Lindbladian over a Haar random ensemble of jump operators decomposes as $\mathcal{L}_{\mu}=\mathcal{L}_{\text{classical}}+\mathcal{L}_{\text{dephasing}}$. For a density matrix in the energy basis, the evolution of $\mathcal{L}_{\text{classical}}$ is a classical continuous Markov chain of the diagonal. The evolution of this classical Lindbladian maps the diagonal, in the limit, to the Gibbs distribution. The spectral gap of $\mathcal{L}_{\text{classical}}$ can be analyzed with the large suite of techniques for classical Markov chains.

Meanwhile, $\mathcal{L}_{\text{dephasing}}$ damps the off-diagonal terms of the density matrix. In the limit as $t\to\infty$, the state therefore converges to a classical distribution on the diagonal in the energy basis, with no off-diagonal terms, as desired. The operator $\mathcal{L}_{\text{dephasing}}$ diagonalizes in the energy basis of density matrices, with each off-diagonal element decaying at an independent rate. It is therefore simple to analyze as well. In summary, Lemma 3.1 establishes that the $\lambda_{\text{gap}}(\mathcal{L}_{\mu})=\min(\lambda_{\text{gap}}(\mathcal{L}_{\text{classical}}),\lambda_{\text{min}}(\mathcal{L}_{\text{dephasing}}))=\Omega(1)$.

However, this result does not imply that any given jump sampled from the unitary 1-design (with its adjoint pair) would yield a gapped Lindbladian. As a result, it does not yet yield an efficient Gibbs sampling algorithm. To obtain such a result in Theorem 2.2, we demonstrate that the remainder term $\delta\mathcal{L}$ in (2) has a small spectral norm when a Lindbladian is constructed from a sufficiently large number of jumps $M$, rather than just one. In particular, a Lindbladian sampled with $\Theta(\log(n))$ normalized jumps from any 1-design concentrates closely to its expectation, thereby establishing a spectral gap lower bound. Since this lower bound applies to any graph at constant temperature $\beta^{-1}$ with bounded degree, it applies to the periodic lattices, path graphs, and $k$-regular graphs discussed in the previous section.

The lemma expresses that if $\lambda_{\text{min}}$ is within $O(\beta^{-1})$ of $\delta(n)$ of the eigenvalues, the spectral gap is at least $\delta(n)$. Similarly to Theorem 2.2, using this result to obtain an efficient Gibbs sampling algorithm amounts to showing that a Lindbladian with enough independently sampled jump operators shares a similar asymptotic spectral gap to the average Lindbladian, using a concentration bound. When the average spectral gap from the above lemma is $\delta(n)$, the number of jump operators to concentrate around the expectation increases to $\delta(n)^{-2}$, along with an overhead of $\log(n)\log(\beta\|{\bm{H}}\|)^{2}$. This result is captured in Theorem 2.3, and results in an algorithm with runtime $\mathrm{poly}(\delta(n)^{-1},\log(n),\log(\epsilon^{-1}))$ for Gibbs sampling, where $\epsilon$ is the error in diamond distance. This runtime bound relies on the standing assumption in this paper that $\log(\beta\|{\bm{H}}\|)=\mathrm{poly}(\log(n))$.

Since the quantum MCMC algorithm was proposed recently, numerical and analytic characterizations of algorithm are limited. As for classical Markov chains, it has been shown that the mixing time of the algorithm can be characterized by the spectral gap $\lambda_{\text{gap}}(\mathcal{L}_{\beta})$ of the Lindbladian. If the first eigenvalue $\lambda_{1}=0$ corresponds to eigenvector $\rho_{\beta}$, then the spectral gap is $\lambda_{\text{gap}}(\mathcal{L}_{\beta})=\min_{j>1}|\lambda_{j}|$ [CKG23]. Lindbladians are in general negative semidefinite like classical Markov chain generators, so $\lambda_{\text{gap}}(\mathcal{L}_{\beta})=\min_{j}(-\lambda_{\text{j}})$. More precisely, it holds that