Toward Causal Representation Learning

被引:507
作者
Schoelkopf, Bernhard [1 ]
Locatello, Francesco [1 ,2 ,3 ]
Bauer, Stefan [1 ]
Ke, Nan Rosemary [4 ,5 ]
Kalchbrenner, Nal [2 ]
Goyal, Anirudh [4 ,5 ]
Bengio, Yoshua [4 ,5 ,6 ]
机构
[1] Max Planck Inst Intelligent Syst, D-72076 Tubingen, Germany
[2] Google Res Amsterdam, NL-1082 MD Amsterdam, Netherlands
[3] Swiss Fed Inst Technol, Comp Sci Dept, CH-8092 Zurich, Switzerland
[4] Mila, Montreal, PQ H2S 3H1, Canada
[5] Univ Montreal, Dept Comp Sci & Operat Res, Montreal, PQ H3T 1J4, Canada
[6] CIFAR, Toronto, ON M5G 1M1, Canada
关键词
Mathematical model; Machine learning; Data models; Differential equations; Task analysis; Training; Adaptation models; Artificial intelligence; causality; deep learning; representation learning; INFERENCE; ACCURACY; LEVEL; MODEL;
D O I
10.1109/JPROC.2021.3058954
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The two fields of machine learning and graphical causality arose and are developed separately. However, there is, now, cross-pollination and increasing interest in both fields to benefit from the advances of the other. In this article, we review fundamental concepts of causal inference and relate them to crucial open problems of machine learning, including transfer and generalization, thereby assaying how causality can contribute to modern machine learning research. This also applies in the opposite direction: we note that most work in causality starts from the premise that the causal variables are given. A central problem for AI and causality is, thus, causal representation learning, that is, the discovery of high-level causal variables from low-level observations. Finally, we delineate some implications of causality for machine learning and propose key research areas at the intersection of both communities.
引用
收藏
页码:612 / 634
页数:23
相关论文
共 271 条
  • [71] Fujimoto S., 2019, PMLR, P2052
  • [72] Fukumizu K., 2007, ADV NEURAL INFORM PR, V20, P489, DOI DOI 10.5555/2981562.2981624
  • [73] Geffner H., 2019, ARXIV190905546
  • [74] Geiger D., 1990, Ann. Math. Artif. Intell, V2, P165, DOI DOI 10.1007/BF01531004
  • [75] Geirhos R., 2018, ARXIV PREPRINT ARXIV
  • [76] Gong MM, 2017, CONFERENCE ON UNCERTAINTY IN ARTIFICIAL INTELLIGENCE (UAI2017)
  • [77] Gong MM, 2016, PR MACH LEARN RES, V48
  • [78] Goodfellow Ian, 2015, ICLR, P1
  • [79] A theory of causal learning in children: Causal maps and Bayes nets
    Gopnik, A
    Glymour, C
    Sobel, DM
    Schulz, LE
    Kushnir, T
    Danks, D
    [J]. PSYCHOLOGICAL REVIEW, 2004, 111 (01) : 3 - 32
  • [80] Gottesman Omer, 2018, ARXIV180512298