Dokument

Summary:
In particular in the last decade, optimization under uncertainty has engaged attention in the mathematical community and beyond. When trying to model the behavior of real-world processes mathematically, this behavior is often not fully understood. Uncertainty may concern the involved species of biological or chemical reactions, the kind of reactions taking place, and the numerical values of model coefficients. But also experimental measurements, which form the basis for the determination of the model parameters, contain unavoidable errors. In order to judge the validity and reliability of the numerical results of simulations and model predictions, the inherent uncertainties have at least to be quantified. But it would be even better to incorporate these uncertainties in the mathematical computations from the beginning to derive solutions that are insensitive with respect to such perturbations. The present dissertation starts with an introductory chapter that examines the background of the thesis, in particular the distinct sources of uncertainties and errors in mathematical models. The structure of the remaining part of the thesis is guided by the different types of uncertainties that may be relevant in numerical optimization. Part I of the dissertation deals with measurement errors in the experimental data and part II of the dissertation treats the case of uncertainties in the model coefficients. Part III of the dissertation, finally, contains numerical examples that illustrate the theoretical considerations of the previous chapters.

Bibliographie / References

1. R. Andersen. Modern Methods for Robust Regression, volume 152 of Quantita- tive Application in the Social Sciences. SAGE Publications, 2008.
2. J. Nocedal and S. J. Wright. Numerical Optimization. Springer, New York, 1999.
3. A. Cervantes and L. T. Biegler. Large-scale DAE optimization using a simul- taneous NLP formulation. AIChE Journal, 44(5):10381050, 2004.
4. A. Borzì, V. Schulz, C. Schillings, and G. von Winckel. On the treatment of dis- tributed uncertainties in PDE-constrained optimization. GAMM-Mitteilungen, 33(2):230246, 2010.
5. I. H. Sloan. Polynomial interpolation and hyperinterpolation over general re- gions. Journal of Approximation Theory, 83:238254, 1995.
6. T. Binder and E. Kostina. Gauss-Newton methods for robust parameter es- timation. In Model Based Parameter Estimation: Theory and Applications. Springer, to appear.
7. [22] H. G. Bock. Numerical treatment of inverse problems in chemical reaction kinetics. In K.-H. Ebert, P. Deuhard, and W. Jäger, editors, Modelling of Chemical Reaction Systems, volume 18 of Springer Series in Chemical Physics, pages 102125. Springer, 1981.
8. F. R. Hampel. Robust estimation: A condensed partial survey. Zeitschrift für Wahrscheinlichkeitstheorie und verwandte Gebiete, 27:87104, 1973.
9. A. Ben-Tal. Second-order and related extremality conditions in nonlinear pro- gramming. Journal of Optimization Theory and Applications, 31(2):143165, 1980.
10. P. Deuhard. A modied Newton method for the solution of ill-conditioned sys- tems of nonlinear equations with application to multiple shooting. Numerische Mathematik, 22:289315, 1974.
11. L. Fejér. Mechanische Quadraturen mit positiven Cotesschen Zahlen. Mathe- matische Zeitschrift, 37(1):287309, 1933.
12. A. Ben-Tal and A. Nemirovski. Robust solutions of Linear Programming prob- lems contaminated with uncertain data. Mathematical Programming, 88:411 421, 2000.
13. E. Novak and K. Ritter. High dimensional integration of smooth functions over cubes. Numerische Mathematik, 75:7997, 1995.
14. T. Gerstner and M. Griebel. Dimension-adaptive tensor-product quadrature. Computing, 71:6587, 2003.
15. A. Borzì. Multigrid and sparse-grid schemes for elliptic control problems with random coecients. Computation and Visualization in Science, 13(4):153160, 2010.
16. M. Diehl, H. G. Bock, and E. Kostina. An approximation technique for robust nonlinear optimization. Mathematical Programming, 107:213230, 2006.
17. J. Waldvogel. Fast construction of the Fejér and Clenshaw-Curtis quadrature rules. BIT Numerical Mathematics, 46:195202, 2006.
18. A. Sommariva, M. Vianello, and R. Zanovello. Nontensorial Clenshaw-Curtis cubature. Numerical Algorithms, 49:409427, 2008.
19. O. L. Mangasarian and S. Fromovitz. The Fritz John necessary optimality conditions in the presence of equality and inequality constraints. Journal of Mathematical Analysis and Applications, 17:3747, 1967.
20. U. Novak and P. Deuhard. Numerical identication of selected rate constants in large chemical reaction systems. Applied Numerical Mathematics, 1(1):5975, 1985.
21. K. Schittkowski. Data tting in partial dierential algebraic equations: Some academic and industrial applications. Journal of Computational and Applied Mathematics, 163(1):2957, 2004.
22. B. Ganapathysubramanian and N. Zabaras. Sparse grid collocation schemes for stochastic natural convection problems. Journal of Computational Physics, 225:652685, 2007.
23. B. Ganapathysubramanian and N. Zabaras. Modeling diusion in random het- erogeneous media: Data-driven models, stochastic collocation and the vari- ational multiscale method. Journal of Computational Physics, 226:326353, 2007.
24. G. Lin, A. M. Tartakovsky, and D. M.Tartakovsky. Uncertainty quantication via random domain decomposition and probabilistic collocation on sparse grids. Journal of Computational Physics, 229:69957012, 2010.
25. G. A. Watson. Choice of norms for data tting and function approximation. Acta Numerica, 7:337377, 1998. Bibliography
26. S. Krishna, M. H. Jensen, and K. Sneppen. Minimal model of spiky oscilla- tions in NF-κB signaling. Proceedings of the National Academy of Sciences, 103:1084010845, 2006.
27. F. J. Anscombe. Rejection of outliers. Technometrics, 2(1):123147, 1960.
28. A. H. Stroud. Remarks on the disposition of points in numerical integration formulas. Mathematical Tables and Other Aids to Computation, 11(60):257 261, 1957.
29. H. O'Hara and F. J. Smith. Error estimation in the Clenshaw-Curtis quadrature formula. The Computer Journal, 11(2):213219, 1968.
30. J. W. L. Glaisher. Note on a paper by Mr. Stone, 'On the rejection of discordant observations'. Monthly Notices of the Royal Astronomical Society, 34:251, 1874.
31. L. N. Trefethen. Is Gauss quadrature better than Clenshaw-Curtis? SIAM Review, 50(1):6787, 2008.
32. W. Gautschi. Numerical quadrature in the presence of a singularity. SIAM Journal on Numerical Analysis, 4(3):357362, 1967.
33. K. Chung and T. Yao. On lattices admitting unique Lagrange interpolations. SIAM Journal on Numerical Analysis, 14(4):735743, 1977.
34. Ascher. Collocation for two-point boundary value problems revisited. SIAM Journal on Numerical Analysis, 23(3):596609, 1986.
35. El Ghaoui and H. Lebret. Robust solutions to least squares problems with uncertain data. SIAM Journal on Matrix Analysis and Applications, 18:1035 1064, 1997.
36. C. de Boor and A. Ron. Computational aspects of polynomial interpolation in several variables. Mathematics of Computation, 58(198):705727, 1992.
37. M. Stigler. Simon Newcomb, Percy Daniell, and the history of robust estima- tion 18851920. Journal of the American Statistical Association, 68:872879, 1973.
38. M. M. Putko, P. A. Newman, A. C. Taylor III, and L. L. Green. Approach for uncertainty propagation and robust design in CFD using sensitivity derivatives. AIAA Paper 2001-2528, American Institute of Aeronautics and Astronautics, 2001.
39. I. Barrodale and F. D. K. Roberts. An improved algorithm for discrete l 1 linear approximation. SIAM Journal on Numerical Analysis, 10(5):839848, 1973.
40. D. Bertsimas, D. B. Brown, and C. Caramanis. Theory and applications of robust optimization. SIAM Review, 53(3):464501, 2011.
41. I. Barrodale and F. D. K. Roberts. Algorithm 478: Solution of an overdeter- mined system of linear equations in the l 1 norm. Communications of the ACM, 17:319320, 1974.
42. H. Ekblom and K. Madsen. Algorithms for non-linear Huber estimation. BIT Numerical Mathematics, 29(1):6076, 1989.
43. W. Chauvenet. A Manual of Spherical and Practical Astronomy, volume II Theory and Use of Astronomical Instruments, chapter Appendix Criterion for the rejection of doubtful observations, pages 558566. J. B. Lippincott & Co., Philadelphia, 4 edition, 1868. First edition: 1863.
44. E. J. Schlossmacher. An iterative technique for absolute deviations curve tting. Journal of the American Statistical Association, 68:857859, 1973.
45. J. O. Street, R. J. Carroll, and D. Ruppert. A note on computing robust regression estimates via iteratively reweighted least squares. The American Statistician, 42(2):152154, 1988.
46. L. Wirsching. An SQP algorithm with inexact derivatives for a direct multiple shooting method for optimal control problems. Diploma thesis, University of Heidelberg, 2006.
47. E. Kostina and O. Kostyukova. A primal-dual active-set method for convex quadratic programming. Preprint, University of Heidelberg, 2003.
48. M. J. Hinich and P. P. Talwar. A simple method for robust regression. Journal of the American Statistical Association, 70:113119, 1975.
49. D. E. Smith, editor. A Source Book in Mathematics. Dover Publications, 1959. [128] S. Smolyak. Quadrature and interpolation formulas for tensor products of certain classes of functions. Dokl. Akad. Nauk SSSR, 4:240243, 1963.
50. F. Nobile, R. Tempone, and C. G. Webster. A sparse grid stochastic colloca- tion method for partial dierential equations with random input data. SIAM Journal on Numerical Analysis, 46(5):23092345, 2008.
51. D. Draper. Assessment and propagation of model uncertainty. Journal of the Royal Statistical Society. Series B (Methodological), 57(1):4597, 1995.
52. G. Faber. Über die interpolatorische Darstellung stetiger Funktionen. Jahres- bericht der Deutschen Mathematikervereinigung, 23:192210, 1914.
53. G. I. Schuëller and H. A. Jensen. Computational methods in optimization considering uncertainties -an overview. Computational Methods in Applied Mechanics and Engineering, 198:213, 2008.
54. T. Oden, R. Moser, and O. Ghattas. Computer predictions with quantied uncertainty, Part I. SIAM News, 43(9):14, 2010.
55. C. Maire and R. Boscovich. De litteraria expeditione per ponticiam ditionem. 1755.
56. R. Bulirsch. Die Mehrzielmethode zur numerischen Lösung von nichtlinearen Randwertproblemen und Aufgaben der optimalen Steuerung. Technical report, Carl-Cranz-Gesellschaft, 1971. [33] J. Burkardt. 1D quadrature rules for sparse grids.
57. A. Schreiber. Die Methode von Smolyak bei der multivariaten Interpolation. PhD thesis, University of Göttingen, 2000.
58. V. H. Schulz. Ein ezientes Kollokationsverfahren zur numerischen Behand- lung von Mehrpunktrandwertaufgaben in der Parameteridentizierung und Op- timalen Steuerung. Diploma thesis, University of Augsburg, 1990.
59. V. Bär. Ein Kollokationsverfahren zur numerischen Lösung allgemeiner Mehrpunktrandwertaufgaben mit Schalt-und Sprungbedingungen mit Anwen- dungen in der Optimalen Steuerung und der Parameteridentizierung. Diploma thesis, University of Bonn, 1983.
60. A. Griewank and A. Walther. Evaluating Derivatives: Principles and Tech- niques of Algorithmic Dierentiation. SIAM, 2008.
61. A. M. Bruckstein, D. L. Donoho, and M. Elad. From sparse solutions of systems of equations to sparse modeling of signals and images. SIAM Review, 51(1):34 81, 2009.
62. W. L. Oberkampf, M. N. Sindir, and A. T. Conlisk. Guide for the verication and validation of computational uid dynamics simulations. Tech Report G- 077-98, American Institute for Aeronautics and Astronautics, 1998.
63. V. Barthelmann, E. Novak, and K. Ritter. High dimensional polynomial inter- polation on sparse grids. Advances in Computational Mathematics, 12:273288, 2000.
64. [141] D. Xiu and J. S. Hesthaven. High-order collocation methods for dieren- tial equations with random inputs. SIAM Journal of Scientic Computing, 27(3):11181139, 2005.
65. F. Hampel. Is statistics too dicult? Research Report 81, ETH Zürich, 1997.
66. T. Sauer. Lagrange interpolation on subgrids of tensor product grids. Mathe- matics of Computation, 73:181190, 2004.
67. H. G. Wilson. Least-squares versus minimum absolute deviations estimation in linear models. Decision Sciences, 9:322335, 1978.
68. G. Airy. Letter from professor Airy, Astronomer Royal, to the editor. Astro- nomical Journal, 4(18):137138, 1856.
69. D. G. Luenberger. Linear and Nonlinear Programming. Addison-Wesley, 1984.
70. P. J. Huber. Minimax aspects of bounded-inuence regression. Journal of the American Statistical Association, 78:6672, 1983.
71. F. M. Hemez and S. W. Doebling. Model validation and uncertainty quan- tication. In Proceedings of the 19th International Model Analysis Conference, 2001.
72. A. V. Fiacco and G. P. McCormick. Nonlinear programming: sequential un- constrained minimization techniques. Classics in Applied Mathematics. SIAM, 1990. Bibliography
73. J. R. Rice and J. S. White. Norms for smoothing and estimation. SIAM Review, 6(3):243256, 1964.
74. A. Legendre. Nouvelles méthodes pour la détermination des orbites des comètes. Firmin Didot, 1805.
75. M. Rodriguez-Fernandez, J. A. Egea, and J. R. Banga. Novel metaheuristic for parameter estimation in nonlinear dynamic biological systems. BMC Bioinfor- matics, 7:483, 2006.
76. T. Gerstner and M. Griebel. Numerical integration using sparse grids. Numer- ical Algorithms, 18:209232, 1998.
77. H. G. Bock, E. Kostina, and J. P. Schlöder. Numerical methods for parameter estimation in nonlinear dierential algebraic equations. GAMM-Mitteilungen, 30(2):376408, 2007.
78. J. P. Schlöder. Numerische Methoden zur Behandlung hochdimensionaler Auf- gaben der Parameteridentizierung. Bonner Mathematische Schriften 187, 1988.
79. M. Gasca and J. I. Maeztu. On Lagrange and Hermite interpolation in R k . Numerische Mathematik, 39:114, 1982.
80. M. R. Osborne, B. Presnell, and B. A. Turlach. On the LASSO and its dual. Journal of Computational and Graphical Statistics, 9(2):319337, 2000. Bibliography [110] B. Peirce. Criterion for the rejection of doubtful observations. The Astronomical Journal, II(45):161163, 1852.
81. J. W. L. Glaisher. On the law of facility of errors of observations, and on the method of least squares. Memoirs of the Royal Astronomical Society, 39(Part II):75124, 1872.
82. J. W. L. Glaisher. On the rejection of discordant observations. Monthly Notices of the Royal Astronomical Society, 33:391402, 1873.
83. R. C. Fair. On the robust estimation of econometric models. Annals of Eco- nomic and Social Measurement, 3(4):667677, 1974.
84. V. Schulz and C. Schillings. Optimal aerodynamic design under shape uncer- tainties. Tech Report 09-5, University of Trier, 2009.
85. M. Ross. Peirce's criterion for the elimination of suspect experimental data. Journal of Engineering Technology, 20:3841, 2003.
86. T. Sauer. Polynomial interpolation of minimal degree. Numerische Mathematik, 78:5985, 1997.
87. J. T. Betts. Practical Methods for Optimal Control and Estimation Using Non- linear Programming. Advances in Design and Control. SIAM, 2010.
88. P. E. Gill, W. Murray, and M. H. Wright. Practical Optimization. Academic Press, London, 1981.
89. H. G. Bock. Randwertproblemmethoden zur Parameteridentizierung in Sys- temen nichtlinearer Dierentialgleichungen. Bonner Mathematische Schriften 187, 1987.
90. R. E. Fuguitt and J. E. Hawkins. Rate of the thermal isomerization of α-pinene in the liquid phase. Journal of the American Chemical Society, 69(2):319322, 1947.
91. H. G. Bock. Recent advances in parameter identication techniques for ODE. In P. Deuhard and E. Hairer, editors, Numerical Treatment of Inverse Problems in Dierential and Integral Equations, pages 95121. Birkhäuser, 1983.
92. D. Andrews, F. Bickel, F. Hampel, P. Huber, W. Rogers, and J. Tukey. Robust Estimates of Location: Survey and Advances. Princeton University Press, 1972.
93. P. J. Huber. Robust estimation of a location parameter. The Annals of Math- ematical Statistics, 35(1):73101, 1964.
94. O. L. Mangasarian and D. R. Musicant. Robust linear and support vector regression. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(9):950955, 2000.
95. J. A. Scales and A. Gersztenkorn. Robust methods in inverse theory. Inverse Problems, 4:10711091, 1988.
96. H. G. Bock, S. Körkel, E. Kostina, and J. P. Schlöder. Robustness aspects in parameter estimation, optimal design of experiments and optimal control. In W. Jäger, R. Rannacher, and J. Warnatz, editors, Reactive Flows, Diusion and Transport, pages 117146. Springer, 2007. Bibliography [26] H. G. Bock, E. Kostina, and J. P. Schlöder. On the role of natural level functions to achieve global convergence for damped Newton methods. In M. Powell, editor, System Modelling and Optimization. Methods, Theory and Applications.
97. P. J. Huber. Robustness: Where are we now? In L 1 -Statistical Procedures and Related Topics, volume 31 of IMS Lecture Notes -Monograph Series, pages 487498. IMS, 1997. Bibliography
98. A. Ben-Tal, L. El Ghaoui, and A. Nemirovski. Robust Optimization. Princeton Series in Applied Mathematics. Princeton University Press, 2009.
99. A. Ben-Tal and A. Nemirovski. Robust optimization -methodology and appli- cations. Mathematical Programming, Series B, 92:453480, 2002.
100. E. Kostina. Robust parameter estimation in dynamic systems. Optimization and Engineering, 5(4):461484, 2004.
101. P. J. Rousseeuw and A. M. Leroy. Robust Regression and Outlier Detection. Wiley, 1987.
102. P. W. Holland and R. E. Welsch. Robust regression using iteratively reweighted least-squares. Communications in Statistics -Theory and Methods, 6(9):813 827, 1977.
103. P. J. Huber. Robust Statistics. John Wiley & Sons, 1981.
104. P. J. Huber. Robust statistics: A review. The Annals of Mathematical Statistics, 43(4):10411067, 1972.
105. P. J. Huber and E. M. Ronchetti. Robust Statistics. Wiley Series in Probability and Statistics. John Wiley & Sons, 2. edition, 2009.
106. M. Nattermann. Sensitivitätsanalyse und optimale Versuchsplanung für Pa- rameterschätzprobleme, basierend auf der quadratischen Approximation der Kondenzgebiete. Diploma thesis, University of Marburg, 2010.
107. E. Novak and K. Ritter. Simple cubature formulas with high polynomial ex- actness. Constructive Approximation, 15:499522, 1999.
108. M. Holtz. Sparse Grid Quadrature in High Dimensions with Applications in Finance and Insurance, volume 77 of Lecture Notes in Computational Science and Engineering. Springer Verlag, 2011.
109. J. Garcke. Sparse grid tutorial. Technical report, Technical University of Berlin, 2011.
110. J. E. Dennis and R. E. Welsch. Techniques for nonlinear least squares and robust regression. Communications in Statistics -Simulation and Computation, 7(4):345359, 1978.
111. R. C. Geary. Testing for normality. Biometrika, 34:209242, 1947.
112. E. Novak and K. Ritter. The curse of dimension and a universal method for numerical integration. In G. Nürnberger, J. Schmidt, and G. Walz, editors, Multivariate Approximations and Splines, pages 177188. Birkhäuser, 1997.
113. A. Koberstein. The Dual Simplex Method, Techniques for a Fast and Stable Implementation. PhD thesis, University of Paderborn, 2005.
114. A. Homann, A. Levchenko, M. L. Scott, and D. Baltimore. The IκBNF- κB signaling module: Temporal control and selective gene activation. Science, 298:12411245, 2002.
115. F. R. Hampel. The inuence curve and its role in robust estimation. Journal of the American Statistical Association, 69:383393, 1974.
116. W. Li and J. J. Swetits. The linear l 1 estimator and the Huber M-estimator. SIAM Journal on Optimization, 8(2):457475, 1998.
117. E. Kostina. The long step rule in the bounded-variable dual simplex method: Numerical experiments. Mathematical Methods of Operations Research, 55:413 429, 2002.
118. J. M. Booker, M. C. Anderson, and M. A. Meyer. The role of expert knowledge in uncertainty quantication (Are we adding more uncertainty or more under- standing?). In B. Bodt and E. Wegman, editors, Proceedings of the Seventh Annual U.S. Army Conference on Applied Statistics, pages 155161, 2001.
119. A. E. Beaton and J. W. Tukey. The tting of power series, meaning polynomials, illustrated on band-spectroscopic data. Technometrics, 16(2):147185, 1974.
120. S. Waldherr. Uncertainty and robustness analysis of biochemical reaction net- works via convex optimisation and robust control theory. PhD thesis, University of Stuttgart, 2009.
121. W. Klimke. Uncertainty Modeling using Fuzzy Arithmetic and Sparse Grids. PhD thesis, University of Stuttgart, 2005.
122. K. F. Alvin, W. L. Oberkampf, K. V. Diegert, and B. M. Rutherford. Uncer- tainty quantication in computational structural dynamics: A new paradigm for model validation. In Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, volume 3243, pages 11911198, 1998.
123. G. E. Karniadakis and J. Glimm. Uncertainty quantication in simulation science. Preface of Journal of Computational Physics 217, pp. 14, 2006.
124. D. L. Ma and R. D. Braatz. Worst-case analysis of nite-time control policies. IEEE Transactions on Control Systems Technology, 9(5):766774, 2001.
125. C. F. Gauss. Theoria Motus Corporum Coelestium in Sectionibus Conicis Solem Ambientium. F. Perthes & J.H. Besser, Hamburg, 1809.
126. A. Ben-Tal and A. Nemirovski. Robust convex optimization. Mathematics of Operations Research, 23(4):769805, 1998.
127. Bibliography [13] A. Ben-Tal, D. den Hertog, A. de Waegenaere, B. Melenberg, and G. Rennen. Robust solutions of optimization problems aected by uncertain probabilities. CentER Working Paper Series 2011-061, Tilburg University, 2011. Available at SSRN: http://ssrn.com/abstract=1853428.
128. C. W. Clenshaw and A. R. Curtis. A method for numerical integration on an automatic computer. Numerische Mathematik, 2:197205, 1960. Bibliography [38] Committee on Mathematical Foundations of Verication, Validation, and Uncertainty Quantication and Board on Mathematical Sciences and Their Applications, Division of Engineering and Physical Sciences, National Re- search Council. Assessing the reliability of complex models: Mathemat- ical and statistical foundations of verication, validation, and uncertainty quantication. Prepublication copy, The National Academics Press, 2012. http://www.nap.edu/catalog.php?record_id=13395.
129. D. Birkes and Y. Dodge. Alternative Methods of Regression. John Wiley & Sons, 1993.
130. T. Lipniacki, P. Paszek, A. R. Brasier, B. Luxon, and M. Kimmel. Mathe- matical model of NF-κB regulatory module. Journal of Theoretical Biology, 228:195215, 2004.
131. V. Gabrel, C. Murat, and A. Thiele. Recent advances in robust optimization and robustness: An overview. Technical report, LAMSADE, Université Paris- Dauphine, Paris, France, 2012.
132. C. de Boor and A. Ron. The least solution for the polynomial interpolation problem. Mathematische Zeitschrift, 210:347378, 1992.

Das Dokument ist im Internet frei zugänglich - Hinweise zu den Nutzungsrechten