Complex Systems Modeling and Computation

In the Focus Group Complex Systems Modeling and Computation, Hans Fischer Senior Prof. Yannis Kevrekidis collaborates with his hosts Prof. Katharina Krischer (Non-Equilibrium Chemical Physics) and Prof. Oliver Junge (Numerics of Complex Systems).

Complex multiscale systems and especially complex processes involving cascades of scales are ubiquitous in current natural science research. Such processes feature more than two characteristic scales, their smallest and largest scales are widely separated, and much of their scale range participates in the process interactions. Also, they are often too complex for experimental studies, but with the steady increase of computing power, there is hope that they can be understood through computational simulations. Such simulations remain very challenging, however, as their wide range of scales is associated with very large numbers of degrees of freedom and in many cases this will prohibit brute-force all-detail computational modeling far into the future. Moreover, interactions of the smallest, largest, and intermediate scales often render most established theoretical or computational tools ineffective or inapplicable because most of them are well founded only for two-scale problems.

The Problem: In our University textbooks, the equations describing a phenomenon (fluid flow, chemotaxis, mechanics) are typically written at the same level that we want the information (macroscopic velocity fields, bacterial concentrations, macroscopic deformations). But these days, increasingly, the level at which the physics are understood (molecular, cellular, agent-based) is much finer than the macroscopic, human, systems level at which we want to get information. We do not have the time/intelligence/experience to obtain good macro descriptions (good closures) – so we are “stuck” with simulating and observing very detailed models of great complexity at great cost. Sometimes we do not even know what the right macroscopic variables (the right observables, the right reaction coordinates, the right order parameters) are. If we had macro-equations, getting information from the models, designing, controlling, optimizing, would be “easy” – we have great computational tools for macro-level, continuum models, based on calculus and numerical analysis.

We do not have accurate macroscopic equations, but we have “fine scale” descriptions. Yet we do not want to simulate molecules for long times and large spaces and many parameter values – instead we think: if we had macroscopic PDEs, what would our numerical subroutines do? They would use the PDEs to get residuals, Jacobians, time derivatives, Hessians at specific moments in time and specific grid points in space – so, now that we do not have macro equations, we set up and run brief bursts of fine scale simulations where macro numbers are needed; and instead of getting these numbers from a closed formula, we get them from a brief (possibly ensemble of) numerical experiments with the fine scale model. We call this equation-free not because we do not have equations (we have micro equations) – it is the macro equations that we do not have. We use calculus, and Taylor series, and traditional continuum numerical analysis to help us design the right micro computational experiment from which to get the numbers to do macro computations with. Traditional numerical analysis (initial value solvers, PDE discretizations, eigenvalue algorithms) become protocols for the design of computational experiments with the fine scale code – protocols on where to iteratively collect computational data. We use this to drastically accelerate the way we extract macro information from micro models of complex systems – we know how to do this for problems that range from macromolecular folding to micelle formation, and form chemotaxis and multiscale flow to agent-based simulations in the social sciences; there are nontrivial technical issues, but we can do this well.

The Catch: To do equation-free computations, we may not need macro equations, but we need to know what the right macro observables are – the right macroscopic variables. If we do not know these variables, we cannot design the right fine scale computational experiments – and we do not know how to observe them to get the right macro information. This is then the “variable-free” part: use manifold learning to process the fine-scale simulation data streams on the fly, to obtain the right variables with which to do equation-free computations on the fly.

The Ambition is then to functionally integrate machine learning with equation-free algorithms in order to model complex systems “the best way possible”: (a) run the fine scale codes intelligently to find the right macro variables (using, for example, Diffusion Maps); (b) use traditional numerical algorithms and the right observables to get local Taylor series – the backbone of traditional continuum numerics; and (c) use these local derivatives, residuals, Jacobians, Hessians in the right observables to design the next fine scale simulation – the next place where interesting macro information needs to be collected. Joint reduction of the state variables and the multitude of parameters in complex dynamical systems is also a current research focus.

Publications of the Focus Group

2018

  • Kemeth, Felix P.; Haugland, Sindre W.; Dietrich, Felix; Bertalan, Tom; Hohlein, Kevin; Li, Qianxiao; Bollt, Erik M.; Talmon, Ronen; Krischer, Katharina; Kevrekidis, Ioannis G.: An Emergent Space for Distributed Data With Hidden Internal Order Through Manifold Learning. IEEE Access 6, 2018, 77402-77413 mehr… BibTeX Volltext ( DOI )
  • Kemeth, Felix P.; Haugland, Sindre W.; Krischer, Katharina: Symmetries of Chimera States. Physical Review Letters 120 (21), 2018 mehr… BibTeX Volltext ( DOI )
  • Mitsos, Alexander; Najman, Jaromił; Kevrekidis, Ioannis G.: Correction to: Optimal deterministic algorithm generation. Journal of Global Optimization 73 (2), 2018, 465-465 mehr… BibTeX Volltext ( DOI )

2017

  • Chiavazzo, Eliodoro; Covino, Roberto; Coifman, Ronald R.; Gear, C. William; Georgiou, Anastasia S.; Hummer, Gerhard; Kevrekidis, Ioannis G.: Intrinsic map dynamics exploration for uncharted effective free-energy landscapes. Proceedings of the National Academy of Sciences 114 (28), 2017, E5494-E5503 mehr… BibTeX Volltext ( DOI )
  • Junge, Oliver; Kevrekidis, Ioannis G.: On the sighting of unicorns: A variational approach to computing invariant sets in dynamical systems. Chaos: An Interdisciplinary Journal of Nonlinear Science 27 (6), 2017, 063102 mehr… BibTeX Volltext ( DOI )
  • Yair, Or; Talmon, Ronen; Coifman, Ronald R.; Kevrekidis, Ioannis G.: Reconstruction of normal forms by learning informed observation geometries from data. Proceedings of the National Academy of Sciences 114 (38), 2017, E7865-E7874 mehr… BibTeX Volltext ( DOI )

2016

  • Ben-Tal, A.; Kevrekidis, I. G.: Coarse-Graining and Simplification of the Dynamics Seen in Bursting Neurons. SIAM Journal on Applied Dynamical Systems 15 (2), 2016, 1193-1226 mehr… BibTeX Volltext ( DOI )
  • Choi, M.; Bertalan, T.; Laing, C.R.; Kevrekidis, I.G.: Dimension reduction in heterogeneous neural networks: Generalized Polynomial Chaos (gPC) and ANalysis-Of-VAriance (ANOVA). The European Physical Journal Special Topics 225 (6-7), 2016, 1165-1180 mehr… BibTeX Volltext ( DOI )
  • Holiday, A.; Kevrekidis, I.G.: Equation-free analysis of a dynamically evolving multigraph. The European Physical Journal Special Topics 225 (6-7), 2016, 1281-1292 mehr… BibTeX Volltext ( DOI )
  • Kattis, Assimakis A; Holiday, Alexander; Stoica, Ana-Andreea; Kevrekidis, Ioannis G: Modeling epidemics on adaptively evolving networks: A data-mining perspective. Virulence 7 (2), 2016, 153-162 mehr… BibTeX Volltext ( DOI )
  • Kemeth, Felix P.; Haugland, Sindre W.; Schmidt, Lennart; Kevrekidis, Ioannis G.; Krischer, Katharina: A classification scheme for chimera states. Chaos: An Interdisciplinary Journal of Nonlinear Science 26 (9), 2016, 094815 mehr… BibTeX Volltext ( DOI )
  • Rajendran, Karthikeyan; Tsoumanis, Andreas C.; Siettos, Constantinos I.; Laing, Carlo R.; Kevrekidis, Ioannis G.: MODELING HETEROGENEITY IN NETWORKS USING POLYNOMIAL CHAOS. International Journal for Multiscale Computational Engineering 14 (3), 2016, 291-302 mehr… BibTeX Volltext ( DOI )