Tree Tensor Networks for Generative Modeling

ORAL

Abstract

Tensor Network States are widely used representations for many-body quantum states. They have close connections to the Graphical Models for high-dimensional data. In both research domains employing patterns such as locality or low information complexity are crucial for designing the model architecture. We employ Tree Tensor Network (TTN) for generative model. The TTN exhibits balanced performance in expressibility and efficient training and sampling. We apply TTN generative model on random binary patterns and the binary MNIST datasets and compare its performance with the matrix product states and other the popular generative models such as the Variational AutoEncoder and PixelCNN. Finally, we discuss about the future development of Tensor Network States in machine learning problems.

*T.X; S.C. is supported by the Grant No. 2017YFA0302901, Grants No. 11190024 and No. 11474331.
L.W. is supported by the Grant No. 2016YFA0300603 and the Grant No. 11774398.
P.Z. is supported by the Grant No. QYZDBSSW-SYS032 and Project 11747601 of National Natural Science Foundation of China.

Presenters

  • Song Cheng

    • Institute of Physics

Authors

  • Song Cheng

    • Institute of Physics
  • Tao Xiang

    • Chinese Academy of Sciences (CAS), China
    • Institute of Physics
    • Institute of Physics, Chinese Academy of Sciences
    • Institute of Physics, CAS
    • Institute of Physics, Chinese Academy of Sciences, P.O. Box 603, Beijing 100190, China
  • Lei Wang

    • Institute of Physics
    • Institute of Physics, Chinese Academy of Sciences
    • Institute of Physics Chinese Academy of Sciences
  • pan zhang

    • institute of theoretical physics
    • Institute of Theoretical Physics, Chinese Academy of Sciences