This thesis is devoted to the numerical and theoretical analysis of ensemble optimal control problems governed by kinetic models. The formulation and study of these problems have been put forward in recent years by R.W. Brockett with the motivation that ensemble control may provide a more general and robust control framework for dynamical systems. Following this formulation, a Liouville (or continuity) equation with an unbounded drift function is considered together with a class of cost functionals that include tracking of ensembles of trajectories of dynamical systems and different control costs. Specifically, $L^2$, $H^1$ and $L^1$ control costs are taken into account which leads to non--smooth optimization problems. For the theoretical investigation of the resulting optimal control problems, a well--posedness theory in weighted Sobolev spaces is presented for Liouville and related transport equations. Specifically, existence and uniqueness results for these equations and energy estimates in suitable norms are provided; in particular norms in weighted Sobolev spaces. Then, non--smooth optimal control problems governed by the Liouville equation are formulated with a control mechanism in the drift function. Further, box--constraints on the control are imposed. The control--to--state map is introduced, that associates to any control the unique solution of the corresponding Liouville equation. Important properties of this map are investigated, specifically, that it is well--defined, continuous and Frechet differentiable. Using the first two properties, the existence of solutions to the optimal control problems is shown. While proving the differentiability, a loss of regularity is encountered, that is natural to hyperbolic equations. This leads to the need of the investigation of the control--to--state map in the topology of weighted Sobolev spaces. Exploiting the Frechet differentiability, it is possible to characterize solutions to the optimal control problem as solutions to an optimality system. This system consists of the Liouville equation, its optimization adjoint in the form of a transport equation, and a gradient inequality. Numerical methodologies for solving Liouville and transport equations are presented that are based on a non--smooth Lagrange optimization framework. For this purpose, approximation and solution schemes for such equations are developed and analyzed. For the approximation of the Liouville model and its optimization adjoint, a combination of a Kurganov--Tadmor method, a Runge--Kutta scheme, and a Strang splitting method are discussed. Stability and second--order accuracy of these resulting schemes are proven in the discrete $L^1$ norm. In addition, conservation of mass and positivity preservation are confirmed for the solution method of the Liouville model. As numerical optimization strategy, an adapted Krylow--Newton method is applied. Since the control is considered to be an element of $H^1$ and to obey certain box--constraints, a method for calculating a $H^1$ projection is presented. Since the optimal control problem is non-smooth, a semi-smooth adaption of Newton's method is taken into account. Results of numerical experiments are presented that successfully validate the proposed deterministic framework. After the discussion of deterministic schemes, the linear space--homogeneous Keilson--Storer master equation is investigated. This equation was originally developed for the modelling of Brownian motion of particles immersed in a fluid and is a representative model of the class of linear Boltzmann equations. The well--posedness of the Keilson--Storer master equation is investigated and energy estimates in different topologies are derived. To solve this equation numerically, Monte Carlo methods are considered. Such methods take advantage of the kinetic formulation of the Liouville equation and directly implement the behaviour of the system of particles under consideration. This includes the probabilistic behaviour of the collisions between particles. Optimal control problems are formulated with an objective that is constituted of certain expected values in velocity space and the $L^2$ and $H^1$ costs of the control. The problems are governed by the Keilson--Storer master equation and the control mechanism is considered to be within the collision kernel. The objective of the optimal control of this model is to drive an ensemble of particles to acquire a desired mean velocity and to achieve a desired final velocity configuration. Existence of solutions of the optimal control problem is proven and a Keilson--Storer optimality system characterizing the solution of the proposed optimal control problem is obtained. The optimality system is used to construct a gradient--based optimization strategy in the framework of Monte--Carlo methods. This task requires to accommodate the resulting adjoint Keilson--Storer model in a form that is consistent with the kinetic formulation. For this reason, we derive an adjoint Keilson--Storer collision kernel and an additional source term. A similar approach is presented in the case of a linear space--inhomogeneous kinetic model with external forces and with Keilson--Storer collision term. In this framework, a control mechanism in the form of an external space--dependent force is investigated. The purpose of this control is to steer the multi--particle system to follow a desired mean velocity and position and to reach a desired final configuration in phase space. An optimal control problem using the formulation of ensemble controls is stated with an objective that is constituted of expected values in phase space and $H^1$ costs of the control. For solving the optimal control problems, a gradient--based computational strategy in the framework of Monte Carlo methods is developed. Part of this is the denoising of the distribution functions calculated by Monte Carlo algorithms using methods of the realm of partial differential equations. A standalone C++ code is presented that implements the developed non--linear conjugated gradient strategy. Results of numerical experiments confirm the ability of the designed probabilistic control framework to operate as desired. An outlook section about optimal control problems governed by non--linear space--inhomogeneous kinetic models completes this thesis.

Mathematical modelling, simulation, and optimisation are core methodologies for future developments in engineering, natural, and life sciences. This work aims at applying these mathematical techniques in the field of biological processes with a focus on the wine fermentation process that is chosen as a representative model. In the literature, basic models for the wine fermentation process consist of a system of ordinary differential equations. They model the evolution of the yeast population number as well as the concentrations of assimilable nitrogen, sugar, and ethanol. In this thesis, the concentration of molecular oxygen is also included in order to model the change of the metabolism of the yeast from an aerobic to an anaerobic one. Further, a more sophisticated toxicity function is used. It provides simulation results that match experimental measurements better than a linear toxicity model. Moreover, a further equation for the temperature plays a crucial role in this work as it opens a way to influence the fermentation process in a desired way by changing the temperature of the system via a cooling mechanism. From the view of the wine industry, it is necessary to cope with large scale fermentation vessels, where spatial inhomogeneities of concentrations and temperature are likely to arise. Therefore, a system of reaction-diffusion equations is formulated in this work, which acts as an approximation for a model including computationally very expensive fluid dynamics. In addition to the modelling issues, an optimal control problem for the proposed reaction-diffusion fermentation model with temperature boundary control is presented and analysed. Variational methods are used to prove the existence of unique weak solutions to this non-linear problem. In this framework, it is possible to exploit the Hilbert space structure of state and control spaces to prove the existence of optimal controls. Additionally, first-order necessary optimality conditions are presented. They characterise controls that minimise an objective functional with the purpose to minimise the final sugar concentration. A numerical experiment shows that the final concentration of sugar can be reduced by a suitably chosen temperature control. The second part of this thesis deals with the identification of an unknown function that participates in a dynamical model. For models with ordinary differential equations, where parts of the dynamic cannot be deduced due to the complexity of the underlying phenomena, a minimisation problem is formulated. By minimising the deviations of simulation results and measurements the best possible function from a trial function space is found. The analysis of this function identification problem covers the proof of the differentiability of the function–to–state operator, the existence of minimisers, and the sensitivity analysis by means of the data–to–function mapping. Moreover, the presented function identification method is extended to stochastic differential equations. Here, the objective functional consists of the difference of measured values and the statistical expected value of the stochastic process solving the stochastic differential equation. Using a Fokker-Planck equation that governs the probability density function of the process, the probabilistic problem of simulating a stochastic process is cast to a deterministic partial differential equation. Proofs of unique solvability of the forward equation, the existence of minimisers, and first-order necessary optimality conditions are presented. The application of the function identification framework to the wine fermentation model aims at finding the shape of the toxicity function and is carried out for the deterministic as well as the stochastic case.

The main theme of this thesis is the development of multigrid and hierarchical matrix solution procedures with almost linear computational complexity for classes of partial integro-differential problems. An elliptic partial integro-differential equation, a convection-diffusion partial integro-differential equation and a convection-diffusion partial integro-differential optimality system are investigated. In the first part of this work, an efficient multigrid finite-differences scheme for solving an elliptic Fredholm partial integro-differential equation (PIDE) is discussed. This scheme combines a second-order accurate finite difference discretization and a Simpson's quadrature rule to approximate the PIDE problem and a multigrid scheme and a fast multilevel integration method of the Fredholm operator allowing the fast solution of the PIDE problem. Theoretical estimates of second-order accuracy and results of local Fourier analysis of convergence of the proposed multigrid scheme are presented. Results of numerical experiments validate these estimates and demonstrate optimal computational complexity of the proposed framework that includes numerical experiments for elliptic PIDE problems with singular kernels. The experience gained in this part of the work is used for the investigation of convection diffusion partial-integro differential equations in the second part of this thesis. Convection-diffusion PIDE problems are discretized using a finite volume scheme referred to as the Chang and Cooper (CC) scheme and a quadrature rule. Also for this class of PIDE problems and this numerical setting, a stability and accuracy analysis of the CC scheme combined with a Simpson's quadrature rule is presented proving second-order accuracy of the numerical solution. To extend and investigate the proposed approximation and solution strategy to the case of systems of convection-diffusion PIDE, an optimal control problem governed by this model is considered. In this case the research focus is the CC-Simpson's discretization of the optimality system and its solution by the proposed multigrid strategy. Second-order accuracy of the optimization solution is proved and results of local Fourier analysis are presented that provide sharp convergence estimates of the optimal computational complexity of the multigrid-fast integration technique. While (geometric) multigrid techniques require ad-hoc implementation depending on the structure of the PIDE problem and on the dimensionality of the domain where the problem is considered, the hierarchical matrix framework allows a more general treatment that exploits the algebraic structure of the problem at hand. In this thesis, this framework is extended to the case of combined differential and integral problems considering the case of a convection-diffusion PIDE. In this case, the starting point is the CC discretization of the convection-diffusion operator combined with the trapezoidal quadrature rule. The hierarchical matrix approach exploits the algebraic nature of the hierarchical matrices for blockwise approximations by low-rank matrices of the sparse convection-diffusion approximation and enables data sparse representation of the fully populated matrix where all essential matrix operations are performed with at most logarithmic optimal complexity. The factorization of part of or the whole coefficient matrix is used as a preconditioner to the solution of the PIDE problem using a generalized minimum residual (GMRes) procedure as a solver. Numerical analysis estimates of the accuracy of the finite-volume and trapezoidal rule approximation are presented and combined with estimates of the hierarchical matrix approximation and with the accuracy of the GMRes iterates. Results of numerical experiments are reported that successfully validate the theoretical estimates and the optimal computational complexity of the proposed hierarchical matrix solution procedure. These results include an extension to higher dimensions and an application to the time evolution of the probability density function of a jump diffusion process.

An efficient and accurate computational framework for solving control problems governed by quantum spin systems is presented. Spin systems are extremely important in modern quantum technologies such as nuclear magnetic resonance spectroscopy, quantum imaging and quantum computing. In these applications, two classes of quantum control problems arise: optimal control problems and exact-controllability problems, with a bilinear con- trol structure. These models correspond to the Schrödinger-Pauli equation, describing the time evolution of a spinor, and the Liouville-von Neumann master equation, describing the time evolution of a spinor and a density operator. This thesis focuses on quantum control problems governed by these models. An appropriate definition of the optimiza- tion objectives and of the admissible set of control functions allows to construct controls with specific properties. These properties are in general required by the physics and the technologies involved in quantum control applications. A main purpose of this work is to address non-differentiable quantum control problems. For this reason, a computational framework is developed to address optimal-control prob- lems, with possibly L1 -penalization term in the cost-functional, and exact-controllability problems. In both cases the set of admissible control functions is a subset of a Hilbert space. The bilinear control structure of the quantum model, the L1 -penalization term and the control constraints generate high non-linearities that make difficult to solve and analyse the corresponding control problems. The first part of this thesis focuses on the physical description of the spin of particles and of the magnetic resonance phenomenon. Afterwards, the controlled Schrödinger- Pauli equation and the Liouville-von Neumann master equation are discussed. These equations, like many other controlled quantum models, can be represented by dynamical systems with a bilinear control structure. In the second part of this thesis, theoretical investigations of optimal control problems, with a possible L1 -penalization term in the objective and control constraints, are consid- ered. In particular, existence of solutions, optimality conditions, and regularity properties of the optimal controls are discussed. In order to solve these optimal control problems, semi-smooth Newton methods are developed and proved to be superlinear convergent. The main difficulty in the implementation of a Newton method for optimal control prob- lems comes from the dimension of the Jacobian operator. In a discrete form, the Jacobian is a very large matrix, and this fact makes its construction infeasible from a practical point of view. For this reason, the focus of this work is on inexact Krylov-Newton methods, that combine the Newton method with Krylov iterative solvers for linear systems, and allows to avoid the construction of the discrete Jacobian. In the third part of this thesis, two methodologies for the exact-controllability of quan- tum spin systems are presented. The first method consists of a continuation technique, while the second method is based on a particular reformulation of the exact-control prob- lem. Both these methodologies address minimum L2 -norm exact-controllability problems. In the fourth part, the thesis focuses on the numerical analysis of quantum con- trol problems. In particular, the modified Crank-Nicolson scheme as an adequate time discretization of the Schrödinger equation is discussed, the first-discretize-then-optimize strategy is used to obtain a discrete reduced gradient formula for the differentiable part of the optimization objective, and implementation details and globalization strategies to guarantee an adequate numerical behaviour of semi-smooth Newton methods are treated. In the last part of this work, several numerical experiments are performed to vali- date the theoretical results and demonstrate the ability of the proposed computational framework to solve quantum spin control problems.

The topic of this thesis is the theoretical and numerical analysis of optimal control problems, whose differential constraints are given by Fokker-Planck models related to jump-diffusion processes. We tackle the issue of controlling a stochastic process by formulating a deterministic optimization problem. The key idea of our approach is to focus on the probability density function of the process, whose time evolution is modeled by the Fokker-Planck equation. Our control framework is advantageous since it allows to model the action of the control over the entire range of the process, whose statistics are characterized by the shape of its probability density function. We first investigate jump-diffusion processes, illustrating their main properties. We define stochastic initial-value problems and present results on the existence and uniqueness of their solutions. We then discuss how numerical solutions of stochastic problems are computed, focusing on the Euler-Maruyama method. We put our attention to jump-diffusion models with time- and space-dependent coefficients and jumps given by a compound Poisson process. We derive the related Fokker-Planck equations, which take the form of partial integro-differential equations. Their differential term is governed by a parabolic operator, while the nonlocal integral operator is due to the presence of the jumps. The derivation is carried out in two cases. On the one hand, we consider a process with unbounded range. On the other hand, we confine the dynamic of the sample paths to a bounded domain, and thus the behavior of the process in proximity of the boundaries has to be specified. Throughout this thesis, we set the barriers of the domain to be reflecting. The Fokker-Planck equation, endowed with initial and boundary conditions, gives rise to Fokker-Planck problems. Their solvability is discussed in suitable functional spaces. The properties of their solutions are examined, namely their regularity, positivity and probability mass conservation. Since closed-form solutions to Fokker-Planck problems are usually not available, one has to resort to numerical methods. The first main achievement of this thesis is the definition and analysis of conservative and positive-preserving numerical methods for Fokker-Planck problems. Our SIMEX1 and SIMEX2 (Splitting-Implicit-Explicit) schemes are defined within the framework given by the method of lines. The differential operator is discretized by a finite volume scheme given by the Chang-Cooper method, while the integral operator is approximated by a mid-point rule. This leads to a large system of ordinary differential equations, that we approximate with the Strang-Marchuk splitting method. This technique decomposes the original problem in a sequence of different subproblems with simpler structure, which are separately solved and linked to each other through initial conditions and final solutions. After performing the splitting step, we carry out the time integration with first- and second-order time-differencing methods. These steps give rise to the SIMEX1 and SIMEX2 methods, respectively. A full convergence and stability analysis of our schemes is included. Moreover, we are able to prove that the positivity and the mass conservation of the solution to Fokker-Planck problems are satisfied at the discrete level by the numerical solutions computed with the SIMEX schemes. The second main achievement of this thesis is the theoretical analysis and the numerical solution of optimal control problems governed by Fokker-Planck models. The field of optimal control deals with finding control functions in such a way that given cost functionals are minimized. Our framework aims at the minimization of the difference between a known sequence of values and the first moment of a jump-diffusion process; therefore, this formulation can also be considered as a parameter estimation problem for stochastic processes. Two cases are discussed, in which the form of the cost functional is continuous-in-time and discrete-in-time, respectively. The control variable enters the state equation as a coefficient of the Fokker-Planck partial integro-differential operator. We also include in the cost functional a $L^1$-penalization term, which enhances the sparsity of the solution. Therefore, the resulting optimization problem is nonconvex and nonsmooth. We derive the first-order optimality systems satisfied by the optimal solution. The computation of the optimal solution is carried out by means of proximal iterative schemes in an infinite-dimensional framework.