American industrial engineer, control theorist and mathematician
A native of Terre Haute, Indiana , Stuart E. Dreyfus is professor emeritus at University of California, Berkeley in the Industrial Engineering and Operations Research Department. While at the Rand Corporation he was a programmer of the JOHNNIAC computer.[ 1] [ 2] While at Rand he coauthored Applied Dynamic Programming with Richard Bellman . Following that work, he was encouraged to pursue a Ph.D. which he completed in applied mathematics at Harvard University in 1964, on the calculus of variations . In 1962, Dreyfus simplified the Dynamic Programming -based derivation of backpropagation (due to Henry J. Kelley and Arthur E. Bryson ) using only the chain rule .[ 3] [ 4] [ 5] [ 6] He also coauthored Mind Over Machine with his brother Hubert Dreyfus in 1986.[ 7]
^ Richard Bellman (1 June 1984). Eye of the Hurricane . World Scientific. p. 185. ISBN 978-981-4635-70-7 .
^ Kaufman, H. (September 1964). "Applied Dynamic Programming, by Richard E. Bellman and Stuart E. Dreyfus. Princeton University Press, Princeton, New Jersey, 4962. xxii + 363 pages" . Canadian Mathematical Bulletin . 7 (3). Canadian Mathematical Society: 499. doi :10.1017/S0008439500032100 .
^ Dreyfus, Stuart (1962). "The numerical solution of variational problems" . Journal of Mathematical Analysis and Applications . 5 (1): 30–45. doi :10.1016/0022-247X(62)90004-5 .
^ Stuart Dreyfus (1990). Artificial Neural Networks, Back Propagation and the Kelley-Bryson Gradient Procedure. J. Guidance, Control and Dynamics, 1990.
^ Eiji Mizutani, Stuart Dreyfus, Kenichi Nishio (2000). On derivation of MLP backpropagation from the Kelley-Bryson optimal-control gradient formula and its application. Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN 2000), Como Italy, July 2000. Online [permanent dead link ]
^ Jürgen Schmidhuber (2015). Deep Learning. Scholarpedia, 10(11):32832. Section on Backpropagation
^ Stefano Franchi; Güven Güzeldere (2005). Mechanical Bodies, Computational Minds: Artificial Intelligence from Automata to Cyborgs . MIT Press. p. 142. ISBN 978-0-262-56206-5 .