Combining machine learning and domain decomposition methods for the solution of partial differential equations—A review

被引:38
作者
Heinlein A. [1 ,2 ]
Klawonn A. [1 ,2 ]
Lanser M. [1 ,2 ]
Weber J. [1 ]
机构
[1] Department of Mathematics and Computer Science, University of Cologne, Köln
[2] Center for Data and Simulation Science, University of Cologne, Köln
关键词
adaptive coarse spaces; deep learning; Deep Ritz; domain decomposition methods; hybrid modeling; neural networks; PDEs; physics-informed neural networks; scientific machine learning;
D O I
10.1002/gamm.202100001
中图分类号
学科分类号
摘要
Scientific machine learning (SciML), an area of research where techniques from machine learning and scientific computing are combined, has become of increasing importance and receives growing attention. Here, our focus is on a very specific area within SciML given by the combination of domain decomposition methods (DDMs) with machine learning techniques for the solution of partial differential equations. The aim of the present work is to make an attempt of providing a review of existing and also new approaches within this field as well as to present some known results in a unified framework; no claim of completeness is made. As a concrete example of machine learning enhanced DDMs, an approach is presented which uses neural networks to reduce the computational effort in adaptive DDMs while retaining their robustness. More precisely, deep neural networks are used to predict the geometric location of constraints which are needed to define a robust coarse space. Additionally, two recently published deep domain decomposition approaches are presented in a unified framework. Both approaches use physics-constrained neural networks to replace the discretization and solution of the subdomain problems of a given decomposition of the computational domain. Finally, a brief overview is given of several further approaches which combine machine learning with ideas from DDMs to either increase the performance of already existing algorithms or to create completely new methods. © 2021 The Authors. GAMM - Mitteilungen published by Wiley-VCH GmbH.
引用
收藏
相关论文
共 82 条
[1]  
Abadi M., Agarwal A., Barham P., Brevdo E., Chen Z., Citro C., Corrado G.S., Davis A., Dean J., Devin M., Ghemawat S., Goodfellow I., Harp A., Irving G., Isard M., Jia Y., Jozefowicz R., Kaiser L., Kudlur M., Levenberg J., Mane D., Monga R., Moore S., Murray D., Olah C., Schuster M., Shlens J., Steiner B., Sutskever I., Talwar K., Tucker P., Vanhoucke V., Vasudevan V., Viegas F., Vinyals O., Warden P., Wattenberg M., Wicke M., Yu Y., Zheng X., TensorFlow: Large-scale machine learning on heteroge
[2]  
Baker N., Alexander F., Bremer T., Hagberg A., Kevrekidis Y., Najm H., Parashar M., Patra A., Sethian J., Wild S., Willcox K., Brochure on basic research needs for scientific machine learning: Core technologies for artificial intelligence, (2019)
[3]  
Baydin A.G., Pearlmutter B.A., Radul A.A., Siskind J.M., Automatic differentiation in machine learning: A survey, J. Mach. Learn. Res., 18, pp. 5595-5637, (2017)
[4]  
Beirao da Veiga L., Pavarino L.F., Scacchi S., Widlund O.B., Zampini S., Adaptive selection of primal constraints for isogeometric BDDC deluxe preconditioners, SIAM J. Sci. Comput., 39, pp. A281-A302, (2017)
[5]  
Bekkerman R., Bilenko M., Langford J., Scaling up machine learning: Parallel and distributed approaches, (2011)
[6]  
Bengio E., Bacon P.-L., Pineau J., Precup D., Conditional computation in neural networks for faster models, (2015)
[7]  
Bjorstad P.E., Koster J., Krzyzanowski P., Domain decomposition solvers for large scale industrial finite element problems, Proceedings of the PARA2000 Workshop on Applied Parallel Computing, Lecture Notes in Computer Science 1947, Springer-Verlag, Berlin, Germany, (2000)
[8]  
Burrows S., Frochte J., Volske M., Torres A.B.M., Stein B., Learning overlap optimization for domain decomposition methods, Advances in knowledge discovery and data mining, pp. 438-449, (2013)
[9]  
Calvo J.G., Widlund O.B., An adaptive choice of primal constraints for BDDC domain decomposition algorithms, Electron. Trans. Numer. Anal., 45, pp. 524-544, (2016)
[10]  
Cros J.-M., A preconditioner for the Schur complement domain decomposition method, Domain Decomposition Methods in Science and Engineering, pp. 373-380, (2003)