Tensor Learning Team

RIKEN Center for Advanced Intelligence Project (AIP).
Email: qibin.zhao [at] riken.jp

About Us

We study various tensor-based machine learning technologies, e.g., tensor decomposition, multilinear latent variable model, tensor regression and classification, tensor networks, deep tensor learning, and Bayesian tensor learning, with aim to facilitate the learning from high-order structured data or large-scale latent space. Our goal is to develop innovative, scalable and efficient tensor learning algorithms supported by theoretical principles. The novel applications in computer vision and brain data analysis will also be explored to provide new insights into tensor learning methods. (RIKEN AIP TLT Web)

Job Opportunities

Seeking Openings for Research Scientists or Postdoctoral Researchers or Technical Scientist or Internship Student. [ Job ]

News

  • 2020/06/01: One paper has been accepted to ICML 2020.
  • 2020/01: Prof. Michael Ng (The University of Hong Kong, China) gave a talk "Robust Tensor Completion and its Application".
  • 2019/11: Qibin Zhao gave a talk at CAS-RIKEN young scientist seminar.
  • 2019/11: Our three papers (one oral and two poster) have been accepted to AAAI 2020.
  • 2019/10: Our paper has been accepted to ACML 2019 (Journal Track).
  • 2019/09: 2 papers have been accepted to NeurIPS 2019.
  • 2019/08: Prof. Baogang Hu (Chinese Academy of Sciences, China) gave a talk "Genealized constraints for knowledge-driven-and-data-driven approaches".
  • 2019/08: Prof. Liqing Zhang (Shanghai Jiao Tong University, China) gave a talk "Image Disentangled Representation and Multi-Attribute Transfer".
  • 2019/05: Our paper has been accepted to ACL 2019.
  • 2019/05: Our paper received IEEE Signal Processing Magazine Best Paper Award. [Paper]
  • 2019/05: Longhao Yuan recieved the Best Student Paper Award. [Paper]
  • 2019/02: 2 papers have been accepted to CVPR 2019.
  • 2019/02: 5 papers have been accepted to ICASSP 2019.
  • 2018/11: Our paper has been accepted to AAAI 2019.
  • 2018/10: Unit Leader Qibin Zhao talked at International Workshop on Tensor Networks and Machine Learning, Skoltech, Moscow.
  • 2018/06: Dr. Guillaume Rabusseau (McGill University, Canada) gave a talk "Machine Learning with Tensors for Structured Data".
  • 2018/06: Lecture at Waseda University. [Slides]
  • 2018/05: Prof. Danilo Mandic (Imperial College London, UK) gave a talk "Hearables: Enabling technologies for lifelong learning in E-Health".
  • 2018/04: Our paper has been accepted to IJCAI 2018.
  • 2018/03: Prof. Justin Dauwels (Nanyang Technological University, Singapore) gave a talk "Bayesian Inference of Sparse Networks (BISN)".
  • 2018/01: Our paper has been accepted to ICLR 2018 (Workshop).
  • 2018/01: Our paper has been accepted to ICASSP 2018.
  • 2017/12: Dr. Fabien Lotte (Inria Bordeaux Sud-Ouest, France) gave a talk "Combining machine learning and psychology to design usable Brain-Computer Interfaces".
  • 2017/12: Dr. Tomasz M. RUTKOWSKI (Cogent Labs Inc., The University of Tokyo, Japan) gave a talk "End-to-end Deep-learning Approaches for Online BCI and Offline Experiment Brainwave Analyses".

Member

Team Leader


    Qibin Zhao

Postdoctoral Researcher


    Ming Hou

     Chao Li

Parttimer


     Linfeng Sui

Trainee • Intern • IPA

  • Runjia Zhang (Trainee)
  • Yifan Wang (Trainee)
  • Huifeng Liang (Powerway Inc., Trainee)

Visiting Scientist

  • Andrzej Cichocki (Professor, Skolkovo Institute of Science and Technology, Russia)
  • Toshihisa Tanaka (Professor, Tokyo University of Agriculture and Technology, Japan)
  • Jianting CAO (Professor, Saitama Institute of Technology, Japan)
  • Cesar F. Caiafa (Independent Researcher, Instituto Argentino de Radioastronomía, Argentina)
  • YOKOTA Tatsuya (Assistant Professor, Nagoya Institute of Technology, Japan)
  • Andong Wang (PostDoc Researcher, Guangdong University of Technology, China)

Former members

  • Xuyang Zhao (Saitama Institute of Technology, Parttimer),
  • Ning Zheng (Postdoctoral Researcher),
  • Zihao Huang, Binghua Li (Nankai University, Intern),
  • Jianfu Zhang (Shanghai Jiao Tong University, Intern),
  • Zerui Tao (Lanzhou University, Intern),
  • Andong Wang (Nanjing University of Science and Technology, Intern),
  • Ziyao Wang (Southeast University, Intern),
  • Longhao Yuan (Saitama Institute of Technology, Parttimer),
  • Jiajia Tang (Hangzhou Dianzi University, Intern),
  • Anjie Zhang (University of Electro-Communications, Parttimer),
  • Xingwei Cao (McGill University, Parttimer),
  • Jianqiang Li, Yuyuan Yu, Jinshi Yu, Shifeng Huang, Xinqi Chen (Guangdong University of Technology, Intern).

Publications

Selected Publications

Full publication list

2020
  • Beyond unfolding: Exact recovery of latent convex tensor decomposition under reshuffling [Paper] [Poster] [Code]
    C. Li, M. E. Khan, Z. Sun, G. Niu, B. Han, S. Xie, and Q. Zhao. [C] AAAI 2020
  • Robust tensor decomposition via orientation invariant tubal nuclear norms [Paper] [Material] [Slide] [Code]
    A. Wang, C. Li, Z. Jin, and Q. Zhao. [C] AAAI 2020

2019
  • Deep multimodal multilinear fusion with high-order polynomial pooling [Paper] [Poster] [Code]
    M. Hou, J. Tang, J. Zhang, W. Kong, Q. Zhao. [C] NeurIPS 2019
  • Dynamic pet image reconstruction using nonnegative matrix factorization incorporated with deep image prior [Paper]
    T. Yokota, K. Kawai, M. Sakata, Y. Kimura, H. Hontani. [C] ICCV 2019
  • Learning Representations from Imperfect Time Series Data via Tensor Rank Regularization [Paper]
    P. Liang, Z. Liu, Y. Tsai, Q. Zhao, R. Salakhutdinov, L. Morency. [C] ACL 2019
  • Guaranteed Matrix Completion Under Multiple Linear Transformations [Paper] [Slide]
    C. Li, W. He, L. Yuan, Z. Sun, Q. Zhao. [C] CVPR 2019
  • Non-Local Meets Global: An Integrated Paradigm for Hyperspectral Denoising [Paper]
    W. He, Q. Yao, C. Li, N. Yokoya, Q. Zhao. [C] CVPR 2019
  • Learning Efficient Tensor Representations with Ring-structured Networks [Paper] [Poster]
    Q. Zhao, M. Sugiyama, L. Yuan, A, Cichocki. [C] ICASSP 2019
  • Low-rank Embedding of Kernels in Convolutional Neural Networks under Random Shuffling [Paper] [Poster]
    C. Li, Z. Sun, J. Yu, M. Hou, Q. Zhao. [C] ICASSP 2019
  • Randomized Tensor Ring Decomposition and Its Application to Large-scale Data Reconstruction [Paper] [Poster]
    L. Yuan, C. Li, J. Cao, Q. Zhao. [C] ICASSP 2019
  • Total-variation-regularized Tensor Ring Completion for Remote Sensing Image Reconstruction [Paper] [Poster]
    W. He, L. Yuan, N. Yokoya. [C] ICASSP 2019
  • Tensor ring decomposition with rank minimization on latent space: An efficient approach for tensor completion [Paper] [Code]
    L. Yuan, C. Li, M. Danilo, J. Cao, Q. Zhao. [C] AAAI 2019
  • Remote sensing image reconstruction using tensor ring completion and total variation [Paper]
    W. He, N. Yokoya, L. Yuan, Q. Zhao. [ J ] IEEE Transactions on Geoscience and Remote Sensing

2018
  • Tensorizing generative adversarial nets [Paper] [Code]
    X. Cao, X. Zhao, Q. Zhao. [C] ICCE Asia 2018 (International Conference On Consumer Electronics)
  • Generative adversarial positive-unlabeled learning [Paper] [Slide] [Code]
    M. Hou, B. Chaib-draa, C. Li, Q. Zhao. [C] IJCAI 2018
  • AI neurotechnology for aging societies–task-load and dementia EEG digital biomarker development using information geometry machine learning methods [Paper]
    T. M. Rutkowski, Q. Zhao, M. S. Abe, M. Otake. [C] NeurIPS Workshop 2018
  • High-order tensor completion for data recovery via sparse tensor-train optimization [Paper]
    L. Yuan, Q. Zhao, J. Cao. [C] ICASSP 2018
  • Detection of epileptic foci based on interictal iEEG by using convolutional neural network [Paper]
    X. Zhao, Q. Zhao, T. Tanaka, J. Cao, W. Kong, H. Sugano, N. Yoshida. [C] DSP 2018 (International Conference on Digital Signal Processing)
  • Feature extraction for incomplete data via low-rank tensor decomposition with feature regularization [Paper]
    Q. Shi, Y. Cheung, Q. Zhao, H. Lu. [ J ] IEEE Transactions on Neural Networks and Learning Systems (TNNLS)
  • High-order tensor completion via gradient-based optimization under tensor train format [Paper]
    L. Yuan, Q. Zhao, L. Gui, J. Cao. [ J ] Signal Processing: Image Communication

2017
  • Feature extraction for incomplete data via low-rank Tucker decomposition [Paper]
    Q. Shi, Y. Cheung, and Q. Zhao. [C] ECML PKDD 2017 (Joint European Conference on Machine Learning and Knowledge Discovery in Databases)

2016
  • Tensor Ring Decomposition [arXiv]
    Q. Zhao, G. Zhou, S. Xie, L. Zhang, A. Cichocki. [J]

Books

  • Tensor networks for dimensionality reduction and large-scale optimization: Part 2 applications and future perspectives [Book]
    A. Cichocki, A. Phan, Q. Zhao, N. Lee, I. Oseledets, M. Sugiyama, D. P. Mandic et al.
    Foundations and Trends in Machine Learning
  • Tensor networks for dimensionality reduction and large-scale optimization: Part 1 low-rank tensor decompositions [Book]
    A. Cichocki, N. Lee, I. Oseledets, A. Phan, Q. Zhao, D. P. Mandic et al
    Foundations and Trends in Machine Learning

Resource

Codes

  • TRLRF: Tensor Ring Low-rank Factors (Matlab) [Github]
  • TGAN: Tensorizing Generative Adversarial Nets (Python) [Github]
  • Gan PU: Generative Adversarial Positive-Unlabeled Learning (Python) [Code]
  • BCPF: Bayesian CP Factorization for Tensor Completion (Matlab) [Github]
  • BRTF: Bayesian Robust Tensor Factorization (Matlab) [Github]
  • T3C: Tensor-Train Tensor Completion (Matlab) [Github]


Slides

  • Tensor Network Representation for Machine Learning - Recent Advances and Perspectives [Slide]
  • Waseda University Lectures
       Lecture 1: Multilinear Algebra and Tensor Decompositions [Slide]
       Lecture 2: Tensor Networks [Slide]
       Lecture 3: Tensor Methods for Signal Processing and Machine Learning [Slide]

Access

Access to Center for Advanced Intelligence Project


    Where to Find Us

    RIKEN Center for Advanced Intelligence Project,
    Nihonbashi 1-chome Mitsui Building, 15th floor, 1-4-1 Nihonbashi, Chuo-ku, Tokyo.
    〒103-0027, Japan.

    Contact Info

    Email: qibin.zhao [at] riken.jp
    Tel: +81-(0)48-467-3626