SciPost Submission Page
Riemannian optimization of isometric tensor networks
by Markus Hauru, Maarten Van Damme, Jutho Haegeman
Submission summary
| Authors (as registered SciPost users): | Jutho Haegeman · Markus Hauru |
| Submission information | |
|---|---|
| Preprint Link: | https://arxiv.org/abs/2007.03638v4 (pdf) |
| Date accepted: | Feb. 3, 2021 |
| Date submitted: | Jan. 14, 2021, 11:21 a.m. |
| Submitted by: | Markus Hauru |
| Submitted to: | SciPost Physics |
| Ontological classification | |
|---|---|
| Academic field: | Physics |
| Specialties: |
|
| Approaches: | Theoretical, Computational |
Abstract
Several tensor networks are built of isometric tensors, i.e. tensors satisfying $W^\dagger W = \mathrm{I}$. Prominent examples include matrix product states (MPS) in canonical form, the multiscale entanglement renormalization ansatz (MERA), and quantum circuits in general, such as those needed in state preparation and quantum variational eigensolvers. We show how gradient-based optimization methods on Riemannian manifolds can be used to optimize tensor networks of isometries to represent e.g. ground states of 1D quantum Hamiltonians. We discuss the geometry of Grassmann and Stiefel manifolds, the Riemannian manifolds of isometric tensors, and review how state-of-the-art optimization methods like nonlinear conjugate gradient and quasi-Newton algorithms can be implemented in this context. We apply these methods in the context of infinite MPS and MERA, and show benchmark results in which they outperform the best previously-known optimization methods, which are tailor-made for those specific variational classes. We also provide open-source implementations of our algorithms.
Published as SciPost Phys. 10, 040 (2021)
Reports on this Submission
Report #2 by Anonymous (Referee 2) on 2021-1-29 (Invited Report)
- Cite as: Anonymous, Report on arXiv:2007.03638v4, delivered 2021-01-29, doi: 10.21468/SciPost.Report.2476
Strengths
Report
The authors declined make modifications in response to point 1. I still think that there are advantages to writing the transformation as right multiplication of [W,W_\perp] by the appropriate unitary. The unitary structure combines the MPS left orthogonalization and left tangent gauge choice, and parallel transport expressed as right multiplication by a unitary explicitly preserves these two gauge choices. The parallel transport is also then explicitly independent of the point on the manifold from which it is performed. Both of these points are hidden a little in the present form of (9) and (10). However, this was mainly an aesthetic suggestion and it is acceptable that the authors decide not to follow it.
This is an informative and useful paper and I recommend it for publication.
Report #1 by Edwin Miles Stoudenmire (Referee 1) on 2021-1-23 (Invited Report)
- Cite as: Edwin Miles Stoudenmire, Report on arXiv:2007.03638v4, delivered 2021-01-23, doi: 10.21468/SciPost.Report.2459
