45
273 References Chapter 1 Beckett, S. (2009). Waiting for Godot. New York: Continuum. (Originally published in 1954) Carroll, L. (1871). Through the looking glass. London: Macmillan. Dörner, D. (1975). Wie Menschen eine Welt verbessern wollten und sie dabei zerstörten [How people wanted to improve a world and in the proc- ess destroyed it]. Bild der Wissenschaft, 12 (Populärwissenschaftlicher Aufsatz), 48–53. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press. Wiener, N. (1948). Cybernetics: Or control and communication in the animal and the machine. New York: Wiley. Willmott, M., & Nelson, W. (2003). Complicated lives: Sophisticated consumers, intricate lifestyles, simple solutions. Chichester: Wiley. Chapter 2 Anscombe, G. E. M. (1981). Causality and determination. In J. Barnes (Ed.), The collected philosophical papers of G. E. M. Anscombe: vol. 2. Metaphysics Controlling Uncertainty: Decision Making and Learning in Complex W orlds Magda Osman © 2010 Magda Osman. ISBN: 978-1-405-19946-9

Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

  • Upload
    magda

  • View
    215

  • Download
    1

Embed Size (px)

Citation preview

Page 1: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

273

References

Chapter 1

Beckett , S. ( 2009 ). Waiting for Godot . New York : Continuum . (Originally published in 1954)

Carroll , L. ( 1871 ). Through the looking glass . London : Macmillan . D ö rner , D. ( 1975 ). Wie Menschen eine Welt verbessern wollten und sie dabei

zerst ö rten [How people wanted to improve a world and in the proc-ess destroyed it] . Bild der Wissenschaft , 12 (Popul ä rwissenschaftlicher Aufsatz), 48 – 53 .

Sutton , R. S. , & Barto , A. G. ( 1998 ). Reinforcement learning: An introduction . Cambridge, MA : MIT Press .

Wiener , N. ( 1948 ). Cybernetics: Or control and communication in the animal and the machine . New York : Wiley .

Willmott , M. , & Nelson , W. ( 2003 ). Complicated lives: Sophisticated consumers, intricate lifestyles, simple solutions . Chichester : Wiley .

Chapter 2

Anscombe , G. E. M. ( 1981 ). Causality and determination . In J. Barnes (Ed.), The collected philosophical papers of G. E. M. Anscombe: vol. 2. Metaphysics

Controlling Uncertainty: Decision Making and Learning in Complex W orlds Magda Osman

© 2010 Magda Osman. ISBN: 978-1-405-19946-9

Page 2: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

274

and the philosophy of mind (pp. 133 – 147 ). Minneapolis : University of Minnesota Press .

Armstrong , D. M. ( 1999 ). The open door: Counterfactual versus singularist theories of causation . In H. Sankey (Ed.), Causation and laws of nature (pp. 175 – 195 ). Dordrecht : Kluwer .

Bogen , J. ( 2004 ). Analyzing causality: The opposite of counterfactual is factual . International Studies in the Philosophy of Science , 18 , 3 – 26 .

Bogen , J. ( 2008 ). Causally productive activities . Studies in History and Philosophy of Science , 39 , 112 – 123 .

Brand , M. ( 1984 ). Intending and acting . Cambridge, MA : MIT Press . Bratman , M. E. ( 1987 ). Intention, plans, and practical reason . Cambridge, MA :

Cambridge University Press . Carnap , R. ( 1928 ). The logical structure of the world . Berkeley : University of

California Press . Carnap , R. ( 1945 ). The two concepts of probability: The problem of prob-

ability . Philosophy and Phenomenological Research , 5 , 513 – 532 . Carnap , R. ( 1950 ). Logical foundations of probability . Chicago : University of

Chicago Press . Cartwright , N. ( 1980 ). The reality of causes in a world of instrumental laws .

Proceedings of the Bienneial Meeting of the Philosophy of Science Association , 2 , 38 – 45 .

Cheng , P. W. ( 1997 ). From covariation to causation: A causal power theory . Psychological Review , 104 , 367 – 405 .

Craig , E. ( 1987 ). The mind of God and the works of man . Oxford : Oxford University Press .

Davidson , D. ( 1963 ). Actions, reasons, and clauses . Journal of Philosophy , 60 , 685 – 700 .

Davidson , D. ( 1967 ). Causal relations . Journal of Philosophy , 64 , 691 – 703 . Davidson , D. ( 1970 ). Events as particulars . Nous , 4 , 25 – 32 . Davidson , D. ( 1980 ). Essays on actions and events . Oxford : Clarendon Press . Dennett , D. ( 1971 ). Intentional systems . Journal of Philosophy , 68 , 87 – 106 . Dennett , D. ( 1978 ). Skinner skinned . In D. Dennett , Brainstorms . Cambridge,

MA : MIT Press . Dennett , D. ( 1983 ). Intentional systems in cognitive ethology: The panglos-

sian paradigm defended . Behavioural and Brain Sciences , 6 , 343 – 390 . Dennett , D. ( 1987 ). The intentional stance . Cambridge, MA : MIT Press . Dennett , D. ( 2006 ). The hoax of intelligent design, and how it was perpe-

trated . In J. Brockman (Ed.), Intelligent thought: Science versus the intel-ligent design movement (pp. 33 – 49 ). New York : Vintage .

Page 3: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

275

References

Dretske , F. ( 1989 ). Reasons and causes . Philosophical Perspectives , 3 , 1 – 15 . Dretske , F. ( 1993 ). Mental events as structuring causes of behaviour . In A.

Mele & J. Heil (Eds.), Mental causation (pp. 121 – 136 ). Oxford : Oxford University Press .

Dretske , F. ( 1999 ). Machines, plants, and animals: The origins of agency . Erkenntnis , 51 , 19 – 31 .

Ducasse , C. J. ( 1969 ). Causation and the types of necessity . London : Dover . Falkenstein , L. ( 1998 ). Hume ’ s answer to Kant . Nous , 32 , 331 – 360 . Frankfurt , H. G. ( 1978 ). The problem of action . American Philosophical

Quarterly , 15 , 157 – 162 . Goldman , A. ( 1970 ). A theory of human action . Englewood Cliffs, NJ :

Prentice - Hall . Guyer , P. ( 2006 ). Kant . New York : Routledge . Harding , D. , Fox , C. , & Mehta , J. ( 2002 ). Studying rare events through

qualitative case studies: Lessons from a study of rampage school shootings . Sociological Methods Research , 31 , 174 – 217 .

Harman , E. ( 1968 ). Enumerative induction and best explanation . Journal of Philosophy , 65 , 523 – 529 .

Hausman , D. M. , & Woodard , J. ( 1999 ). Independence, invariance and the causal Markov condition . British Journal of the Philosophy of Science , 50 , 521 – 583 .

Hempel , C. H. ( 1965 ). Aspects of scientifi c explanation . New York : Free Press . Hornsby , J. ( 1980 ). Actions . London : Routledge and Kegan Paul . Hornsby , J. ( 1993 ). Agency and causal explanation . In A. Mele & J. Heil

(Eds.), Mental causation (pp. 160 – 188 ). Oxford : Oxford University Press . Hooker , C. A. , Penfold , H. B. , & Evans , R. J. ( 1992 ). Control, connectionism

and cognition: Towards a new regulatory paradigm . British Journal for the Philosophy of Science , 43 , 517 – 536 .

Hume , D. ( 1978 ). A treatise of human nature (ed. L. A. Selby - Bigge & P. H. Nidditch ). Oxford : Clarendon Press . (Originally published in 1739)

Jackson , F. , & Pettit , P. ( 1988 ). Functionalism and broad content . Mind , 47 , 381 – 400 .

Jeffrey , R. ( 1969 ). Statistical explanation vs statistical inference . In N. Rescher (Ed.), Essays in Honor of Carl G. Hempel (pp. 104 – 113 ). Dordrecht : Reidel .

Johnson , C. ( 2003 ). Failure in safety - critical systems: A handbook of accident and incident reporting . Glasgow : University of Glasgow Press .

Kim , J. ( 1973 ). Causes and counterfactuals . Journal of Philosophy , 70 , 429 – 441 .

Kitcher , P. ( 1980 ). A priori knowledge . Philosophical Review , 89 , 3 – 23 .

Page 4: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

276

Kletz , T. ( 1994 ). What went wrong? Case histories of process plant disasters ( 3rd ed. ). Houston, TX : Gulf Publishing .

Langsam , H. ( 1994 ). Kant, Hume, and our ordinary concept of causation . Philosophy and Phenomenological Research , 54 , 625 – 647 .

Lewis , D. ( 1973 ). Counterfactuals . Cambridge, MA : Harvard University Press . Libet , B. ( 1985 ). Unconscious cerebral initiative and the role of conscious

will in voluntary action . Behavioural and Brain Sciences , 8 , 529 – 566 . Lucas , J. ( 2006 ). Reason and reality . Retrieved March 28, 2010, from http://

users.ox.ac.uk/ ∼ jrlucas/ . Mackie , J. L. ( 1973 ). Truth, probability, and paradox . Oxford : Oxford University

Press . Mele , A. R. ( 1992 ). Springs of action . Oxford : Oxford University Press . Mele , A. ( 1995 ). Autonomous agents . New York : Oxford University Press . Mele , A. ( 2009 ). Moral responsibilities and agents ’ histories . Philosophical

Studies , 142 , 161 – 181 . Nagel , T. ( 1986 ). The view from nowhere . Oxford : Clarendon Press . Owens , A. ( 1989 ). Causes and coincidences . Proceedings of the Aristotelian

Society , 90 , 49 – 64 . Owens , A. ( 1992 ). Causes and coincidences . Cambridge : Cambridge University

Press . Pacherie , E. ( 2008 ). The phenomenology of action: A conceptual frame-

work . Cognition , 107 , 179 – 217 . Psillos , S. ( 2002 ). Causation and explanation . Chesham : Acumen . Quinn , W. ( 1989 ). Actions, intentions, and consequences: The doctrine of

double effect . Philosophy and Public Affairs , 18 , 334 – 351 . Russell , B. ( 1918 ). On the notion of cause . In B. Russell , Mysticism and logic .

London : Allen & Unwin . Salmon , W. ( 1984 ). Scientifi c explanation and the causal structure of the world .

Princeton, NJ : Princeton University Press . Salmon , W. ( 1989 ). Four decades of scientifi c explanation . Oxford : Oxford

University Press . Searle , J. ( 1983 ). Intentionality . Cambridge : Cambridge University Press . Shanks , D. R. , & Dickinson , A. ( 1987 ). Associative accounts of causality

judgment . In G. H. Bower (Ed.), The psychology of learning and motiva-tion: Advances in research and theory (Vol. 21 , pp. 229 – 261 ). San Diego, CA : Academic Press .

Sloman , A. ( 1993 ). The mind as a control system . In C. Hookway & D. Peterson (Eds.), Philosophy and the cognitive sciences (pp. 69 – 110 ). Cambridge : Cambridge University Press .

Page 5: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

277

References

Sloman , A. ( 1999 ). What sort of architecture is required for a human - like agent? In M. Wooldridge & A. Rao (Eds.), Foundations of rational agency (pp. 35 – 52 ). Dordrecht : Kluwer Academic .

Sloman , S. A. , & Lagnado , D. A. ( 2005 ). The problem of induction . In K. Holyoak & R. Morrison (Eds.), The Cambridge handbook of thinking and reasoning (pp. 95 – 116 ). Cambridge : Cambridge University Press .

Stoutland , F. ( 1976 ). The causation of behaviour . In Essays on Wittgenstein in honor of G. H. von Wright. Acta Philosophica Fennica , 28 , 286 – 325 .

Strawson , G. ( 1989 ). The secret connexion . Oxford : Clarendon Press . Thalberg , I. ( 1972 ). Enigmas of agency . London : Allen & Unwin . Von Wright , G. H. ( 1973 ). On the logic of the causal relations . In E. Sosa &

M. Tooley (Eds.), Causation (pp. 205 – 124 ). Oxford : Oxford University Press .

White , C. ( 1990 ). Ideas about causation in philosophy and psychology . Psychological Bulletin , 108 , 3 – 18 .

Woodward , J. ( 1993 ). Capacities and invariance . In J. Earman , A. Janis , G. J. Massey , & N. Rescher (Eds.), Philosophical problems of the internal and external worlds . Pittsburgh, PA : University of Pittsburgh Press .

Woodward , J. ( 2000 ). Explanation and invariance in the special science . British Journal for the Philosophy of Science , 51 , 197 – 254 .

Chapter 3

Andrei , N. ( 2006 ). Modern control theory: A historical perspective . Studies in Informatics and Control , 10 , 51 – 62 .

Bate , I. , McDermind , J. , & Nightingale , P. ( 2003 ). Establishing timing requirements for control loops in real - time systems . Microprocessors and Microsystems , 27 , 159 – 169 .

Birmingham , H. P. , & Taylor , F. V. ( 1954 ). A design philosophy for man - machine control systems . Proceedings of IRE , 42 , 1748 – 1758 .

Bode , H. ( 1945 ). Network analysis and feedback amplifi er design . New York : Van Nostrand .

Bryson , A. E. , & Ho , Y. C. ( 1975 ). Applied optimal control . New York : Wiley . Chretienne , P. ( 1989 ). Timed Petri nets: A solution to the minimum - time -

reachability problem between two states of a timed - event graph . Journal of Systems and Software , 6 , 95 – 101 .

Coyle , G. ( 1996 ). System dynamics modelling: A practical approach . London : Chapman & Hall .

Page 6: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

278

Dayan , P. , Kakade , S. , & Montague , P. R. ( 2000 ). Learning and selective attention . Nature Neuroscience , 3 , 1218 – 1223 .

Degani , A. ( 2004 ). Taming HAL: Designing interfaces beyond 2001 . New York : Palgrave Macmillan .

Degani , A. , & Heymann , M. ( 2002 ). Formal verifi cation of human - automa-tion interaction . Human Factors , 44 , 28 – 43 .

Dorf , R. C. , & Bishop , R. H. ( 2008 ). Modern control systems . Upper Saddle River, NJ : Pearson Prentice Hall .

Doyle , J. ( 1982 ). Analysis of feedback systems with structured uncertain-ties . IEEE Proceeding , 129 , 242 – 250 .

Doyle , J. , Francis , B. , & Tannenbaum , A. ( 1990 ). Feedback control theory . New York : Macmillan .

Ellis , G. ( 2002 ). Observers in control systems: A practical guide . New York : Academic Press .

Feng , G. , & Lozanao , R. ( 1999 ). Adaptive control systems . Oxford : Newness . Gee , S. S. , & Wang , C. ( 2004 ). Adaptive neural control of uncertain

MIMO nonlinear systems . IEEE Transactions on Neural Networks , 15 , 674 – 692 .

Georgantzas , N. C. , & Katsamakas , E. G. ( 2008 ). Information systems research with system dynamics . System Dynamics Review , 24 , 247 – 264 .

Huang , Y. S. , & Su , P. J. ( 2009 ). Modelling and analysis of traffi c light control systems . IET Control Theory and Application , 3 , 340 – 350 .

Ioannou , P. A. , & Sun , J. ( 1996 ). Robust adaptive control . Englewood Cliffs, NJ : Prentice - Hall .

Jacobs , O. L. R. ( 1993 ). Introduction to control theory ( 2nd ed. ). Oxford : Oxford Science .

Johnson , C. ( 2003 ). Failure in safety - critical systems: A handbook of accident and incident reporting . Glasgow : University of Glasgow Press .

Johnson , C. ( 2005 ). What are emergent properties and how do they affect the engineering of complex systems? Reliability Engineering and System Safety , 91 , 1475 – 1481 .

Kirlik , A. ( 2007 ). Conceptual and technical issues in extending computa-tional cognitive modelling to aviation . In J. Jacko (Ed.), Human - computer interaction: Part I. HCII (pp. 872 – 881 ). Berlin : Springer - Verlag .

K ö rding , K. , & Wolpert , D. ( 2006 ). Bayesian decision theory in sensori-motor control . Trends in Cognitive Science , 7 , 319 – 326 .

Lakatos , B. G. , Sapundzhiev , T. J. , & Garside , J. ( 2007 ). Stability and dynam-ics of isothermal CMSMPR crystallizers . Chemical Engineering Science , 62 , 4348 – 4364 .

Page 7: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

279

References

Leigh , J. R. ( 1992 ). Control theory: A guided tour . London : Peter Peregrinus . Leondes , C. T. ( 1998 ). Control and dynamic systems: Vol. 7. Neural network

systems techniques and applications . New York : Academic Press . Mayne , D. Q. , Rawlings , J. B. , Rao , C. V. , & Scokaert , P. O. M. ( 2000 ).

Constrained model predictive control: Stability and optimality . Automatica , 36 , 789 – 814 .

Mill , J. S. ( 1884 ). A system of logic (Bk. 3, Chap. 6). London : Longman . Morse , A. S. ( 1996 ). Supervisory control of families of linear set - point

controllers – part 1: Exact matching . IEEE Transactions in Automated Control , 41 , 1413 – 1431 .

Morse , A. S. ( 1997 ). Supervisory control of families of linear set - point con-trollers – part 2: Robustness . IEEE Transactions in Automated Control , 42 , 1500 – 1515 .

Nyquist , H. ( 1932 ). Regeneration theory . Bell System Tech Journal , 11 , 126 – 147 . Papageorgiou , M. , Diakaki , C. , Dinopoulou , V. , & Kotsialos , A. ( 2003 ).

Review of road traffi c control strategies . Proceedings in IEEE , 2043 – 2067 . Perko , L. ( 1991 ). Differential equations and dynamical systems . New York :

Springer - Verlag . Ramadge , P. J. , & Wonham , W. M. ( 1987 ). Supervisory control of a class of

discrete event processes . SIAM J. Control Optimization , 25 , 206 – 230 . Ramadge , P. J. , & Wonham , W. M. ( 1989 ). The control of discrete - event

systems . Proceedings in IEEE , 77 , 81 – 98 . Ramakrishnan , R. , & Gehrke , J. ( 2003 ). Database management systems ( 3rd

ed. ). New York : McGraw - Hill . Rasmussen , J. ( 1985 ). Human information processing and human machine inter-

action . Amsterdam : North Holland . Redmill , F. , & Rajan , J. ( 1997 ). Human factors in safety - critical system . Oxford :

Butterworth Heinemann . Richardson , G. P. ( 1999 ). Refl ections for the future of system dynamics .

Journal of the Operational Research Society , 50 , 440 – 449 . Richardson , G. P. , & Pugh , A. L. , III . ( 1981 ). Introduction to system dynamics

modeling with DYNAMO . Portland, OR : Productivity Press . Rothrock , L. , & Kirlik , A. ( 2003 ). Inferring rule - based strategies in dynamic

judgment tasks: Towards a noncompensatory formulation of the lens model . IEEE Transactions on Systems, Man and Cybernetics – Part A: Systems and Humans , 33 , 58 – 72 .

Russell , A. , Clark , M. , & Mack , G. ( 2006 ). Automated population of dynamic Bayes nets for pre - confl ict analysis and forecasting . IEEE Aerospace Conference Proceedings , 1 – 9 , 3422 – 3432 .

Page 8: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

280

Safonov , M. G. , & Tsao , T. C. ( 1997 ). The unfalsifi ed control concept and learning . IEEE Transactions on Automatic Control , 42 , 843 – 847 .

Sheridan , T. B. ( 2002 ). Human and automation: Systems design and research issues . New York : Wiley .

Suchman , L. ( 1987 ). Plans and situated actions . Cambridge : Cambridge University Press .

Suchman , L. ( 2006 ). Human - machine reconfi gurations: Plans and situated actions . Cambridge : Cambridge University Press .

Summer , A. ( 2009 ). Safety management is a virtue . Process Safety Progress , 28 , 210 – 213 .

Vicente , K. J. ( 2002 ). Ecological interface design: Process and challenges . Human Factors , 44 , 62 – 78 .

Vicente , K. J. , Roth , E. M. , & Mumaw , R. J. ( 2001 ). How do operators monitor a complex, dynamic work domain? The impact of control room technology . Journal of Human - Computer Studies , 54 , 831 – 856 .

Weeks , B. L. , Ruddle , C. M. , Zaug , J. M. , & Cook , D. J. ( 2002 ). Monitoring high - temperature solid - solid phase transitions of HMX with atomic force microscopy . Ultramicroscopy , 93 , 19 – 23 .

Wolpert , D. ( 1997 ). Computational approaches to motor control . Trends in Cognitive Science , 1 , 209 – 216 .

Yang , F , Wang , Z. , Ho , D , W. C. , & Gani , M. ( 2007 ). Robust H control with missing measurements and time delays . IEEE Transactions on Automatic Control , 52 , 1666 – 1672 .

Yu , L. , & Goa , F. ( 2001 ). Optimal guaranteed cost control of discrete - time uncertain systems with both state and input delays . Journal of the Franklin Institute , 338 , 101 – 110 .

Chapter 4

Acid , S. , & de Campos , L , M. ( 2003 ). Searching for Bayesian network struc-tures in the space of restricted acyclic partically directed graphs . Journal of Artifi cial Intelligence Research , 18 , 445 – 490 .

Agre , P. , & Horswill , I. ( 1997 ). Lifeworld analysis . Journal of Artifi cial Intelligence Research , 6 , 111 – 145 .

Aitkenhead , M. J. , & McDonald , A. J. S. ( 2006 ). The state of play in machine/environment interaction . Machine Learning , 25 , 247 – 276 .

Ashby , W. ( 1945 ). Effects of control on stability . Nature , 155 , 242 – 243 .

Page 9: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

281

References

Ashby , W. ( 1947 ). Principles of the self - organizing dynamic system . Journal of General Psychology , 37 , 125 – 128 .

Ashby , W. ( 1956 ). Introduction to Cybernetics . New York : Wiley . Barto , A. G. , & Mahadevan , S. ( 2003 ). Recent advances in hierarchical

reinforcement learning . Discrete Event Dynamic Systems - Theory and Applications , 13 , 41 – 77 .

Barto , A. G. , & Sutton , R. S. ( 1981 ). Landmark learning: An illustration of associative search . Biological Cybernetics , 42 , 1 – 8 .

Bowker , G. , & Chou , R - Y. ( 2009 ). Ashby ’ s notion of memory and the ontol-ogy of technical evolution . International Journal of General Systems , 2 , 129 – 137 .

Bratko , I. , & Urban c i c , T. ( 1997 ). Transfer of control skill by machine learn-ing . Engineering Application of Artifi cial Intelligence , 10 , 63 – 71 .

Brown , S. D. , & Steyvers , M. ( 2009 ). Detecting and predicting changes . Cognitive Psychology , 58 , 49 – 67 .

Bryant , J. ( 1991 ). Systems theory and scientifi c philosophy . New York : University Press of America .

Casti , J. L. ( 1985 ). Canonical models and the Law of Requisite Variety . Journal of Optimization Theory and Applications , 46 , 455 – 459 .

Cohen , W. ( 1995 ). Fast effective rule induction . In Proceedings of ICML - 95 (pp. 115 – 123 ). San Francisco : Morgan Kaufmann .

Conant , R. C. , & Ashby , W. ( 1970 ). Every good regulator of a system must be a model of that system . International Journal of Systems Science , 1 , 89 – 97 .

Corning , P. A. ( 2007 ). Control information theory: The ‘ missing link ’ in the science of cybernetics . Systems Research and Behavioral Science , 24 , 297 – 311 .

Cowell , R. G. ( 2001 ). Conditions under which conditional independence and scoring methods lead to identical selection of Bayesian network models . In Proceedings of 17th International Conference on Uncertainty in Artifi cial Intelligence (pp. 319 – 328 ). San Francisco : Morgan Kaufmann .

Daw , N. D. , Niv , Y. , & Dayan , P. ( 2005 ). Uncertainty - based competition between prefrontal and dorsolateral striatal systems for behavioural control . Nature Neuroscience , 8 , 1704 – 1711 .

Daw , N. D. , O ’ Doherty , J. P. , Dayan , P. , Seymour , B. , & Dolan , R. ( 2006 ). Cortical substrates for exploratory decisions in humans . Nature , 441 , 876 – 879 .

Dayan , P. , & Niv , Y. ( 2008 ). Reinforcement learning: The good, the bad and the ugly . Current Opinion in Neurobiology , 18 , 185 – 196 .

Page 10: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

282

Doucet , A. , Andrieu , C. , & Godsill , S. ( 2000 ). On sequential Monte Carlo sampling methods for Bayesian fi ltering . Statistics and Computing , 10 , 197 – 208

Einhorn , H. J. , & Hogarth , R. M. ( 1978 ). Confi dence in judgment: Persistence of the illusion of validity . Psychological Review , 85 , 395 – 416 .

Elman , J. L. ( 1990 ). Finding structure in time . Cognitive Science , 14 , 179 – 211

Elomaa , T. , & Rousu , J. ( 1999 ). General and effi cient multisplitting of numerical attributes . Machine Learning , 36 , 201 – 244 .

Fayyad , U. M. , Piatetsky - Shapiro , G. , Smyth , P. , & Uthurusamy , R. (Eds.). ( 1996 ). Advances in knowledge discovery and data mining . Menlo Park, CA : AAAI Press/MIT Press .

Feldbaum , A. A. ( 1960a ). Dual control theory . Automation Remote Control , 21 , 1240 – 1249 .

Feldbaum , A. A. ( 1960b ). Dual control theory . Automation Remote Control , 21 , 1453 – 1464 .

Gahegan , M. ( 2003 ). Is inductive machine learning just another wild goose (or might it lay the golden egg)? International Journal of Geographical Information Science , 17 , 69 – 92 .

Gama , J. , & Brazdil , P. ( 1999 ). Linear tree . Intelligent Data Analysis , 3 , 1 – 22 . G ö del , K. ( 1931 ). Ü ber formal unentscheidbare S ä tze der Principia Mathe-

matica und verwandter Systeme, I . Monatshefte f ü r Mathematik und Physik , 38 , 173 – 198 .

Goldberg , D. E. ( 1989 ). Genetic algorithm in search, optimization, and machine learning . Reading, MA : Addison - Wesley .

Goldberg , D. E. , & Holland , J. H. ( 1988 ). Genetic algorithms and machine learning . Machine Learning , 3 , 95 – 99 .

Gollu , A. , & Varaiya , P. ( 1998 ). SmartAHS: A simulation framework for automated vehicles and highway systems . Mathematical and Computer Modelling , 27 , 103 – 128 .

Grush , R. ( 2004 ). The emulation theory of representation: Motor control, imagery, and perception . Behavioral and Brain Sciences , 27 , 377 – 396 .

Gureckis , T. M. , & Love , B. C. ( 2009 ). Learning in noise: Dynamic decision - making in a variable environment . Journal of Mathematical Psychology , 53 , 180 – 195 .

Hagan , M. T. , & Menaj , M. B. ( 1994 ). Training feedforward networks with the M algorithm . IEEE: Transactions of Neural Networks , 5 , 989 – 993 .

Haykin , S. ( 1994 ). Neural networks: A comprehensive foundation . New York : Macmillan .

Page 11: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

283

References

Hazen , H. L. ( 1934 ). Theory of servo - mechanisms . Journal of Franklin Institute , 218 , 279 – 331 .

Heylighen , F. , & Joslyn , C. ( 2001 ). The law of requisite variety . Principia Cybernetica Web . Retrieved March 22, 2010, from http://pespmc1.vub.ac.be/REQVAR.HTML .

Hokayem , P. , & Abdallah , C. T. ( 2004 , June 30 – July 2). Inherent issues in networked control systems: A survey . In Proceedings of the American Control Conference (pp. 4897 – 4902 ). Boston .

Ilg , W. , & Berns , K. ( 1995 ). A learning architecture based on reinforcement learning for adaptive control of the walking machine LAURON . Robotic Automated Systems , 15 , 321 – 334 .

Ishii , S. , Yoshida , W. , & Yokimoto , K. ( 2002 ). Control of exploitation – exploration meta parameter in reinforcement learning . Neural Networks , 15 , 665 – 687 .

Jensen , F. ( 1996 ). An introduction to Bayesian networks . New York : Springer . Jordan , M. I. ( 1986 ). Serial order: A parallel distributed processing approach

(Tech. Rep. No. 8604 ). San Diego : University of California, Institute for Cognitive Science .

Kleene , S. C. ( 1952 ). Introduction to metamathematics . New York : Van Nostrand . Kochenderfer , M. J. ( 2005 ). Adaptive modeling and planning for reactive

agents . In M. M. Veloso & S. Kambhampati (Eds.), Proceedings of the Twentieth National Conference on Artifi cial Intelligence and the Seventeenth Annual Conference on Innovative Applications of Artifi cial Intelligence (pp. 1648 – 1649 ). Menlo Park, CA : AAAI Press .

Kolmogoroff , A. N. ( 1941 ). Interpolation und Extrapolation von station ä ren zuf ä lligen Folgen . zv. Akad. Nauk SSSR Ser. Mat , 5 , 3 – 14 .

Kotsiantis , S. B. , Zahaakis , I. D. , & Pintelas , P. E. ( 2006 ). Machine learning: A review of classifi cation and combing techniques . Artifi cial Intelligence Review , 26 , 159 – 190 .

Leen , G. , & Heffernan , D. ( 2002 ). Expanding automotive electronic systems . IEEE , 35 , 88 – 93 .

Linsker , R. ( 2008 ). Neural network learning of optimal Kalman prediction and control . Neural Networks , 21 , 1328 – 1343 .

Love , T. , & Cooper , T. ( 2008 ). Complex built - environment design: For extensions to Ashby . Kybernetes , 36 , 1422 – 1435 .

Lucas , J. R. ( 1961 ). Mind, machines and G ö del . Philosophy , 36 , 112 – 127 . Mahadevan , S. ( 2009 ). Learning representation and control in Markov

decision processes: New frontiers . Foundations and Trends in Machine Learning , 1 , 403 – 565 .

Page 12: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

284

Melnik , R. V. N. ( 2009 ). Coupling control and human factors in mathemati-cal models of complex systems . Engineering Applications of Artifi cial Intelligence , 22 , 351 – 362 .

Mindell , D. ( 2002 ). Between human and machine: Feedback, control and comput-ing . Baltimore : John Hopkins University Press .

Mitchell , T. ( 2006 ). The discipline of machine learning (Carnegie Mellon University White Paper). Mountain View, CA: Carnegie Mellon.

Mitchell , T. , Buchanan , B. , DeJong , G. , Dietterich , T. , Rosenbloom , P. , & Waibel , A. ( 1990 ). Machine learning . Annual Review of Computer Science , 4 , 417 – 433 .

Motro , A. , & Smets , P. ( 1997 ). Uncertainty management information systems: From needs to solutions . Dordrecht : Kluwer Academic .

Mumford , L. ( 1934 ). Technics and civilization . New York : Harcourt Brace Jovanovich .

Putnam , H. ( 1960 ). Minds and machines . In S. Hook (Ed.), Dimensions of mind: A symposium . New York : New York University Press .

Quinlan , J. R. ( 1993 ). C4.5. programs for machine learning . San Francisco : Morgan Kaufman .

Rao , S. S. ( 1996 ). Engineering optimization: Theory and practice . Chichester : Wiley .

Reeves , C. R. , & Rowe , J. E. ( 2003 ). Genetic algorithms – principles and perspec-tives: A guide to GA theory . Dordrecht : Kluwer Academic .

Rosenblatt , F. ( 1958 ). The Perceptron: A probabilistic model for informa-tion storage and organization in the brain, Cornell Aeronautical Laboratory . Psychological Review , 65 , 386 – 408 .

Rosenblueth , A. , Wiener , N. , & Bigelow , J. ( 1943 ). Behavior, purpose, and teleology . Philosophy of Science , 10 , 18 – 24 .

Schaffer , J. , Burch , N. , Bj ö rnsson , Y. , Kishimoto , A. , M ü ller , M. , Lake , R. , Lu , P. , & Sutphen , S. ( 2007 ). Checkers is solved . Science , 317 , 1518 – 1522 .

Searle , J. ( 1980 ). Minds, brains and programs . Behavioral and Brain Sciences , 3 , 417 – 457 .

Shannon , C. E. , & Weaver , W. ( 1948 ). The mathematical theory of communica-tion . Chicago : University of Illinois Press .

Shevchenko , M. , Windridge , D. , & Kittler , J. ( 2009 ). A linear - complexity reparameterization strategy for the hierarchical bootstrapping of capabilities within perception - action architectures . Image and Vision Computing , 27 , 1702 – 1717 .

Page 13: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

285

References

Siddique , M. N. H. , & Tokhi , M. O. ( 2001 ). Training neural networks: Backpropagation vs. genetic algorithms . IEEE International Joint Conference of Neural Networks , 4 , 2673 – 2678 .

Simon , H. A. ( 1952 ). On the application of servomechanism theory in the study of production control . Econometrica , 20 , 247 – 268 .

Sivashankar , N. , & Sun , J. ( 1999 ). Development of model - based computer - aided engine control systems . International Journal of Vehicle Design , 21 , 325 – 343 .

Smart , J. J. C. ( 1961 ). G ö del ’ s theorem, Church ’ s theorem and Machinism . Synthese , 13 , 105 .

Smets , P. ( 1997 ). Imperfect information: Imprecision and uncertainty . In A. Motro & P. Smets (Eds.), Uncertainty management information systems: From needs to solutions (pp. 225 – 254 ). Dordrecht : Kluwer Academic .

Sutton , R. S. , & Barto , A. G. ( 1998 ). Reinforcement learning: An introduction . Cambridge, MA : MIT Press .

Tsao , Y. , Xiao , K. , & Soo , V. ( 2008 , May). Graph Laplacian based transfer learning in reinforcement learning . In AAMAS ’ 08: Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems (pp. 1349 – 1352 ), Estoril, Portugal .

Turing , A. M. ( 1936 ). On computable numbers with an application to the Entscheidungsproblem . Proceedings of the London Mathematical Society , 42 , 230 – 265 .

Turing , A. ( 1950 ). Computing machinery and intelligence . Mind , 236 , 433 – 460 .

Vivarelli , F. , & Williams , C. ( 2001 ). Comparing Bayesian neural network algorithms for classifying segmented outdoor images . Neural Networks , 14 , 427 – 437 .

Watkins , C. J. C. ( 1989 ). Learning from delayed rewards . Ph.D. dissertation, Cambridge University.

Watkins , C. J. C. , & Dayan , P. ( 1992 ). Q - Learning . Machine Learning , 8 , 279 – 292 .

Weng , J. , McClelland , J. , Pentland , A. , Sporns , O. , Stockman , I. , Sur , M. , & Thelen , E. ( 2001 ). Autonomous mental development by robots and animals . Science , 291 , 599 – 600 .

Wiener , N. ( 1930 ). Extrapolation, interpolation and smoothing of stationary time series with engineering applications . Cambridge, MA : MIT Press .

Wiener , N. ( 1948 ). Cybernetics: Or control and communication in the animal and the machine . New York : Wiley .

Page 14: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

286

Wieslander , J. , & Wittenmark , B. ( 1971 ). An approach to adaptive control using real time identifi cation . Automatica , 7 , 211 – 217 .

Williams , R. J. , & Zipser , D. ( 1989 ). A learning algorithm for continually running fully recurrent neural networks . Neural Computation , 1 , 270 – 280 .

Wolpert , D. ( 1997 ). Computational approaches to motor control . Trends in Cognitive Science , 1 , 209 – 216 .

Yager , R. ( 1991 ). Connectives and quantifi ers in fuzzy sets . International Journal of Fuzzy Sets and Systems , 40 , 39 – 76 .

Yu , A. , & Dayan , P. ( 2005 ). Uncertainty, neuromodualtion and attention . Neuron , 46 , 681 – 692 .

Zadeh , L. ( 1965 ). Fuzzy sets . Information and Control , 8 , 338 – 353 . Zhang , G. ( 2000 ). Neural network for classifi cation: A survey . IEEE:

Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews , 30 , 451 – 462 .

Chapter 5

Ammerman , M. ( 1998 ). The root cause analysis handbook . New York : Quality Resources .

Anderson , J. R. , & Bower , G. H. ( 1973 ). Human associative memory . Washington, DC : Winston .

Banbury , S. P. , & Triesman , S. ( 2004 ). Cognitive approaches in situation aware-ness . Brookfi eld, VT : Ashgate .

Bisantz , A. M. , Kirlik , A. , Gay , P. , Phipps , D. , Walker , N. , & Fisk , A. D. ( 2000 ). Modeling and analysis of a dynamic judgment task using a lens model approach . IEEE Transactions on Systems, Man and Cybernetics – Part A: Systems and Humans , 30 , 605 – 616 .

Boy , G. A. ( 1998 ). Cognitive function analysis . Stamford, CT : Ablex . Bucciarelli , I. L. ( 1994 ). Designing engineers . Cambridge, MA : MIT Press . Burns , C. M. , & Vicente , K. J. ( 1995 ). A framework for understanding inter-

disciplinary interactions in design . In Proceedings of DIS ’ 95: Symposium on Designing Interactive Systems (pp. 97 – 103 ). New York : Association for Computing Machinery .

Busby , J. S. , & Chung , P. W. H. ( 2003 ). In what ways are designers ’ and operators ’ reasonable - world assumptions not reasonable assump-tions? Transactions of Institution of Chemical Engineers , 81 , 114 – 120 .

Page 15: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

287

References

Busby , J. S. , & Hibberd , R. E. ( 2002 ). Mutual misconceptions between designers and operators of hazardous systems . Research in Engineering Design , 13 , 132 – 138 .

Card , S. K. , Moran , T. P. , & Newell , A. ( 1983 ). The psychology of human - computer interaction . Mahwah, NJ : Erlbaum .

Corning , P. A. ( 2007 ). Control information theory: The ‘ missing link ’ in the science of cybernetics . Systems Research and Behavioral Sciences , 24 , 297 – 311 .

Degani , A. ( 2004 ). Taming HAL: Designing interfaces beyond 2001 . New York : Palgrave Macmillan .

Degani , J. A. S. , Shafto , M. , & Kirlik , A. ( 2006 ). What makes vicarious functioning work? Exploring the geometry of human - technology interaction . In A. Kirlik (Ed.), Adaptive perspectives on human - technology interaction (pp. 179 – 196 ). New York : Oxford University Press .

Dekker , S. W. A. ( 2005 ). Ten questions about human error: A new view of human factors and system safety . Mahwah, NJ : Erlbaum .

Dekker , S. W. A. , & Woods , D. D. ( 2002 ). MABA - MABA or abracadabra? Progress on human – automation co - ordination . Cognition, Technology & Work , 4 , 240 – 244 .

Dettmer , H. W. ( 1997 ). Goldratt ’ s theory of constraints: A systems approach to continuous improvement . Milwaukee, WI : ASQC Quality Press .

D ö rner , D. ( 1989 ). The logic of failure . New York : Henry Holt . Duncan , K. D. ( 1987 ). Fault diagnosis training for advanced continuous

process installations . In J. Rasmussen , K. Duncan , & J. Leplat (Eds.), New technology and human error (pp. 209 – 221 ). New York : Wiley .

Elmaghraby , S. E. ( 1977 ). Activity networks: Project planning and control by network models . New York : Wiley .

Endsley , M. R. ( 1995 ). Measurement of situation awareness in dynamic systems . Human Factors , 37 , 65 – 84 .

Egeth , H. E. , & Yantis , S. ( 1997 ). Visual attention: Control, representation, and time course . Annual Review of Psychology , 48 , 269 – 297 .

Engh , T. , Yow , A. , & Walters , B. ( 1998 ). An evaluation of discrete event simulation for use in operator and crew performance evaluation (report to the Nuclear Regulatory Commission). Washington, DC : Nuclear Regulatory Commission .

Fisher , D. L. , & Goldstein , W. M. ( 1983 ). Stochastic PERT networks as models of cognition: Derivation of the mean variance, and variance, and distribution of reaction time using order - of - processing (OP) dia-grams . Journal of Mathematical Psychology , 27 , 121 – 155 .

Page 16: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

288

Fisher , D. L. , Schweickert , R. , & Drury , C. G. ( 2006 ). Mathematical models in engineering psychology: Optimizing performance . In G. Salvendy (Ed.), Handbook of human factors and ergonomics ( 3rd ed. , pp. 997 – 1024 ). Hoboken, NJ : Wiley .

Fitts , P. M. ( 1951 ). Human engineering for an effective air navigation and traffi c control system (Ohio State University Foundation report). Columbus : Ohio State University Foundation .

Fuchs , A. , & Jirsa , V. K. ( 2008 ). Coordination: Neural, behavioural and social dynamics . Berlin : Springer - Verlag .

Green , D. M. , & Swets , J. A. ( 1966 ). Signal detection theory and psychophysics . New York : Wiley .

Green , F. , Ashton , D. , & Felstead , A. ( 2001 ). Estimating the determinants of supply of computing, problem - solving, communication, social and teamworking skills . Oxford Economic Papers , 3 , 406 – 433 .

Hammer , W. ( 1985 ). Occupational safety management and engineering ( 3rd ed. ). Englewood Cliffs, NJ : Prentice Hall .

Hazen , H. L. ( 1934 ). Theory of servo - mechanisms . Journal of Franklin Institute , 218 , 279 – 331 .

Hazen , H. L. ( 1941 ). The human being is a fundamental link in auto-matic control systems, 13 May 1941 (OSRD7 GP, memorandum between Harold Hazen and Warren Weaver, offi ce fi les of Warren Weaver, Box 2). Washington, DC: Offi ce of Scientifi c Research and Development.

Hirschhorn , L. ( 1984 ). Beyond mechanization: Work and technology in a postin-dustrial age . Cambridge, MA : MIT Press .

Hollnagel , E. , & Woods , D. D. ( 1983 ). Cognitive systems engineering: New wine in new bottles . International Journal of Man – Machine Studies , 18 , 583 – 600 .

Jax , S. A. , Rosenbaum , D. A. , Vaughan , J. , & Meulenbroek , R. G. J. ( 2003 ). Computational motor control and human factors: Modeling move-ments in real and possible environment . Human Factors , 45 , 5 – 27 .

John , B. E. ( 1990 ). Extensions of GOMS analyses to expert performance requiring perception of dynamic visual and auditory information . In Proceedings of CHI ’ 90 Conference on Human Factors in Computing Systems (pp. 107 – 115 ). New York : Association for Computing Machinery .

Johnson , C. ( 2003 ). Failure in safety - critical systems: A handbook of accident and incident reporting . Glasgow : University of Glasgow Press .

Johnson , W. G. ( 1980 ). MORT safety assurance systems . New York : Decker .

Page 17: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

289

References

Kelly , M. R. ( 1989 ). Alternative forms of work organization under programmable automation: The transformation of work? Skill, fl exibility and the labour process . London : Unwin Hyman .

Lawless , M. L. , Laughery , K. R. , & Persensky , J. J. ( 1995 , August). Micro saint to predict performance in a nuclear power plant room: A test of validity and feasibility (NUREG/CR - 6159). Washington, DC: Nuclear Regulatory Commission.

Lipshitz , R. , & Strauss , O. ( 1997 ). Coping with uncertainty: A naturalistic decision - making analysis . Organizational Behavior and Human Decision Processes , 69 , 149 – 163 .

Macduffi e , J. P. ( 1995 ). Human resource bundles and manufacturing performance: Organization logic and fl exible production systems in the world auto industry . Industrial and Labor Relations Review , 48 , 197 – 221 .

McKenzie , C. R. M. ( 2003 ). Rational models as theories – not standards – of behavior . Trends in Cognitive Science , 7 , 403 – 406 .

Melnik , R. V. N. ( 2009 ). Coupling control and human factors in mathemati-cal models of complex systems . Engineering Applications of Artifi cial Intelligence , 22 , 351 – 362 .

Mindell , D. ( 2002 ). Between human and machine: Feedback, control and comput-ing . Baltimore : John Hopkins University Press .

Norman , D. A. ( 1981 ). Categorization of action slips . Psychological Review , 88 , 1 – 15 .

Norman , D. A. ( 1992 ). Design principles for cognitive artifacts . Research and Engineering Design , 4 , 43 – 50 .

Norris , G. ( 1995 ). Boeing ’ s seventh wonder . IEEE Spectrum , 32 , 20 – 23 . Parasuraman , R. , & Riley , V. A. ( 1997 ). Humans and automation: Use,

misuse, disuse, and abuse . Human Factors , 39 , 230 – 253 . Perrow , C. ( 1984 ). Normal accidents: Living with high - risk technologies . New

York : Basic Books . Phillips , C. A. ( 2000 ). Human factors engineering . New York : Wiley . Rasmussen , J. ( 1987 ). The defi nition of human error and a taxonomy for

technical system design . In J. Rasmussen , K. Duncan , & J. Leplat (Eds.), New technology and human error (pp. 23 – 30 ). Chichester : Wiley .

Reason , J. ( 1990a ). Human error . Cambridge : Cambridge University Press . Reason , J. ( 1990b ). The contribution of latent human failures to the break-

down of complex systems . Philosophical Transactions of the Royal Society of London , 327 , 475 – 484 .

Page 18: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

290

Redmill , F. , & Rajan , J. ( 1997 ). Human factors in safety - critical system . Oxford : Butterworth - Heinemann .

Repperger , D. W. ( 2004 ). Adaptive displays and controllers using alterna-tive feedback . CyberPsychology and Behavior , 7 , 645 – 652 .

Rothrock , L. , & Kirlik , A. ( 2003 ). Inferring rule - based strategies in dynamic judgment tasks: Towards a noncompensatory formulation of the lens model . IEEE Transactions on Systems, Man and Cybernetics – Part A: Systems and Humans , 33 , 58 – 72 .

Rumelhart , D. E. , & McClelland , J. L. ( 1986 ). Parallel distributed processing: Vol. 1. Exploration in the microstructure of cognition . Cambridge, MA : MIT Press .

Salvendy , G. ( 2006 ). Handbook of human factors and ergonomics ( 3rd ed. ). Hoboken, NJ : Wiley .

Sarter , N. , & Woods , D. D. ( 1995 ). How in the world did we ever get into that mode? Mode error and awareness in supervisory control . Human Factors , 37 , 5 – 19 .

Sarter , N. , Woods , D. , & Billings , C. E. ( 1997 ). Automation surprises . In G. Salvendy (Ed.), Handbook of human factors and ergonomics ( 2nd ed. , pp. 1926 – 1943 ). New York : Wiley .

Shannon , C. E. ( 1948 ). A mathematical theory of communication . Bell System Technical Journal , 27 , 379 – 423 , 623 – 656 .

Shannon , C. E. , & Weaver , W. ( 1949 ). The mathematical theory of communica-tion . Urbana : University of Illinois Press .

Sharit , J. ( 2006 ). Human error . In G. Salvendy (Ed.), Handbook of human factors and ergonomics ( 3rd ed. , pp. 708 – 760 ). Hoboken, NJ : Wiley .

Sheridan , T. B. ( 2000 ). Function allocation: Algorithm, alchemy or apostasy? International Journal of Human - Computer Studies , 52 , 203 – 216 .

Sheridan , T. B. ( 2002 ). Humans and automation: Systems design and research issues . Hoboken, NJ : Wiley .

Sheridan , T. B. ( 2004 ). Driver distraction from a control theory perspective . Human Factors , 46 , 587 – 599 .

Sheridan , T. B. , & Parasuraman , R. ( 2006 ). Human - automation interaction . In R. Nickerson (Ed.), Proceedings of the Human Factors and Ergonomics Society 46th annual meeting . Santa Monica, CA : Human Factors and Ergonomics Society .

Sherry , L. , & Polson , P. G. ( 1999 ). Shared models of fl ight management system vertical guidance . International Journal of Aviation Psychology , 9 , 139 – 153 .

Page 19: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

291

References

Smith , K. , & Hancock , P. A. ( 1995 ). Situation awareness is adaptive, exter-nally direct consciousness . Human Factors , 37 , 137 – 148 .

Smith , P. J. , & Geddes , N. D. ( 2003 ). A cognitive systems engineering approach to the design of decision support systems . In J. A. Jacko & A. Sears (Eds.), The human - computer interaction handbook: Funda-mentals, evolving technologies, and emerging applications . Mahwah, NJ : Erlbaum .

Smith , V. ( 1997 ). New forms of work organization . Annual Review of Sociology , 23 , 315 – 339 .

Spender , J. C. ( 1996 ). Making knowledge the basis of a dynamic theory of the fi rm . Strategic Management Journal , 17 , 45 – 62 .

Stanovich , K. E. ( 1999 ). Who is rational? Studies of individual differences in reasoning . Mahwah, NJ : Erlbaum .

Turing , A. ( 1950 ). Computing machinery and intelligence . Mind , 236 , 433 – 460 .

Vicente , K. J. ( 1999 ). Cognitive work analysis: Towards safe, productive, and healthy computer - based work . Mahwah, NJ : Erlbaum .

Vicente , K. J. , and Rasmussen , J. ( 1992 ). Ecological interface design: theo-retical foundations . IEEE Transactions on Systems, Man and Cybernetics – Part A: Systems and Humans , 22 , 589 – 606 .

Wickens , C. ( 1984 ). Engineering psychology and human performance . Columbus, OH : Merrill .

Wickens , C. , & Dixon , S. R. ( 2007 ). The benefi ts of imperfect diagnostic automation: A synthesis of the literature . Theoretical Issues in Ergonomics Science , 8 , 202 – 212 .

Wiener , N. ( 1930 ). Extrapolation, interpolation and smoothing of stationary time series with engineering applications . Cambridge, MA : MIT Press .

Wiener , N. ( 1948 ). Cybernetics: Or control and communication in the animal and the machine . New York : Wiley .

Wieslander , J. , & Wittenmark , B. ( 1971 ). An approach to adaptive control using real time identifi cation . Automatica , 7 , 211 – 217 .

Woods , D. D. ( 1988 ). Coping with complexity: The psychology of human behavior in complex systems . In L. P. Goodstein , H. B. Anderson , & S. E. Olsen (Eds.), Task, errors, and mental models: A festschrift to celebrate the 60th of Professor Jens Rasmussen (pp. 169 – 188 ). San Diego, CA : Academic Press .

Woods , D. D. ( 1996 ). Decomposing automation: Apparent simplicity, real complexity . In R. Parasuraman & M. Mouloua (Eds.), Automation and human performance: Theory and applications . London : Erlbaum .

Page 20: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

292

Chapter 6

Appley , M. H. ( 1991 ). Motivation, equilibration, and stress . In R. A. Dienstbier (Ed.), Perspectives on motivation (pp. 1 – 67 ). Lincoln : University of Nebraska Press .

Ashby , W. ( 1947 ). Principles of the self - organizing dynamic system . Journal of General Psychology , 37 , 125 – 128 .

Austin , J. , & Vancouver , J. ( 1996 ). Goal constructs in psychology: Structure, process, and content . Psychological Bulletin , 120 , 338 – 375 .

Azjen , I. ( 1991 ). The theory of planned behavior . Organizational Behavior and Human Decision Processes , 50 , 179 – 211 .

Bandura , A. ( 1977 ). Self - effi cacy: Towards a unifying theory of behavioral change . Psychological Review , 84 , 191 – 215 .

Bandura , A. ( 1989 ). Human agency in social cognitive theory . American Psychologist , 44 , 1175 – 1184 .

Bandura , A. ( 1991 ). Social cognitive theory of self - regulation . Organizational Behavior and Human Decision Processes , 50 , 248 – 287 .

Bandura , A. ( 2000 ). Exercise of human agency through collective effi cacy . Current Directions in Psychological Science , 9 , 75 – 78 .

Bandura , A. ( 2001 ). Social cognitive theory: An agentic perspective . Annual Review of Psychology , 52 , 1 – 26 .

Bandura , A. , & Cervone , D. ( 1986 ). Differential engagement of self - active infl uences in cognitive motivation . Organizational Behavior and Human Decision Processes , 38 , 92 – 113 .

Bandura , A. , & Locke , E. A. ( 2003 ). Negative self - effi cacy and goal effects revisited . Journal of Applied Psychology , 88 , 87 – 99 .

Bandura , A. , & Wood , R. E. ( 1989 ). Effect of perceived controllability and performance standards on self - regulation of complex decision making . Journal of Personality and Social Psychology , 56 , 805 – 814 .

Barker , V. , & Barr , P. ( 2002 ). Linking top manager attributions to strategic reorientation in declining fi rms attempting turnarounds . Journal of Business Research , 55 , 963 – 997 .

Barker , V. , & Patterson , P. ( 1996 ). Top management team tenure and top manager causal attributions at declining fi rms attempting turna-rounds . Group and Organization Management , 21 , 304 – 336 .

Barker , V. , Patterson , P. , & Mueller , G. ( 2001 ). Organizational causes and strategic consequences of the extent of top management team replace-

Page 21: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

293

References

ment during turnaround attempts . Journal of Management Studies , 38 , 235 – 269 .

Bouffard - Bouchard , T. ( 1990 ). Infl uence of self - effi cacy on performance in a cognitive task . Journal of Social Psychology , 130 , 353 – 363 .

Bunge , M. ( 1977 ). Emergence and the mind . Neuroscience , 2 , 501 – 509 . Campbell , N. K. , & Hackett , G. ( 1986 ). The effects of mathematics task

performance on math self - effi cacy and task interest . Journal of Vocational Behavior , 28 , 149 – 162 .

Cervone , D. ( 2000 ). Thinking about self - effi cacy . Behavior Modifi cation , 24 , 30 – 56 .

Cervone , D. , Jiwani , N. , & Wood , R. ( 1991 ). Goal setting on the differential infl uence of self - regulatory processes on complex decision - making performance . Journal of Personality and Social Psychology , 61 , 257 – 266 .

Chesney , A. , & Locke , E. ( 1991 ). An examination of the relationship among goal diffi culty, business strategies, and performance on a complex man-agement simulation task . Academy of Management Journal , 34 , 400 – 424 .

Crown , D. F. , & Rosse , J. G. ( 1995 ). Yours, mine and ours: Facilitating group productivity through the integration of individual and group goals . Organizational Behavior and Human Decision Processes , 64 , 138 – 150 .

David , N. , Newen , A. , & Vogeley , K. ( 2008 ). The ‘ sense of agency ’ and its underlying cognitive and neural mechanisms . Consciousness and Cognition , 17 , 523 – 534 .

Dayan , P. , & Niv , Y. ( 2008 ). Reinforcement learning: The good, the bad and the ugly . Current Opinion in Neurobiology , 18 , 185 – 196 .

DeCharms , R. ( 1979 ). Personal causation and perceived control . In L. C. Perlmuter & R. A. Monty (Eds.), Choice and perceived control . Hillsdale, NJ : Erlbaum .

Dehaene , S. , Naccache , L. , Cohen , L. , Bihan , D. , Mangin , J - F. , Poline , J - P. , & Rivi è re , D. ( 2001 ). Cerebral mechanisms of word masking and unconscious repetition priming . Nature Neuroscience , 4 , 752 – 758 .

DeShon , R. P. , & Alexander , R. A. ( 1996 ). Goal setting effects on implicit and explicit learning of complex tasks . Organizational Behavior and Human Decision Processes , 65 , 18 – 36 .

Dienes , Z. , & Perner , J. ( 1999 ). A theory of implicit and explicit knowledge . Behavioral and Brain Sciences , 22 , 735 – 808 .

Earley , P. C. , Connolly , T. , & Ekegren , G. ( 1989 ). Goals, strategy develop-ment and task performance: Some limits on the effi cacy of goal setting . Journal of Applied Psychology , 74 , 24 – 33 .

Page 22: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

294

Earley , P. C. , Northcraft , G. B. , Lee , C. , & Lituchy , T. R. ( 1990 ). Impact of process and outcome feedback on the relation of goal setting to task performance . Academy of Management Journal , 33 , 87 – 105 .

Eisenberg , L. ( 1995 ). The social construction of the human brain . American Journal of Psychiatry , 152 , 1563 – 1575 .

Elliott , E. S. , & Dweck , C. S. ( 1988 ). Goals: An approach to motivation and achievement . Journal of Personality and Social Psychology , 54 , 5 – 12 .

Endres , M. L. ( 2006 ). The effectiveness of assigned goals in complex fi nan-cial decision making and the importance of gender . Theory and Decision , 61 , 129 – 157 .

Frayne , C. A. , & Latham , G. P. ( 1987 ). Application of social learning theory to employee self - management of attendance . Journal of Applied Psychology , 72 , 387 – 392 .

Gecas , V. ( 1989 ). The social psychology of self - effi cacy . Annual Review of Sociology , 15 , 291 – 316 .

Gist , M. E. ( 1989 ). The infl uence of training method on self - effi cacy and idea generation among managers . Personal Psychology , 42 , 787 – 805 .

Gist , M. E. , & Mitchell , T. R. ( 1992 ). Self - effi cacy: A theoretical analysis of its determinants and malleability . Academy of Management Review , 17 , 183 – 211 .

Gist , M. E. , Schwoerer , C. , & Rosen , B. ( 1989 ). Effects of alternative training methods on self - effi cacy and performance in computer software train-ing . Journal of Applied Psychology , 74 , 884 – 891 .

Glymour , C. ( 2004 ). We believe in freedom of the will so that we can learn . Behavioral and Brain Sciences , 27 , 661 – 662 .

Haleblian , J. , & Rajagopalan , N. ( 2006 ). A cognitive model of CEO dis-missal: Understanding the infl uence of board perceptions, attributions and effi cacy beliefs . Journal of Management Studies , 43 , 1009 – 1026 .

Hill , T. , Smith , N. D. , & Mann , M. F. ( 1987 ). Role of effi cacy expectations in predicting the decision to use advanced technologies . Journal of Applied Psychology , 72 , 307 – 314 .

Hoc , J. M. ( 1993 ). Some dimensions of a cognitive typology of process - control situations . Ergonomics , 36 , 1445 – 1455 .

Hogarth , R. M. , Gibbs , B. J. , McKenzie , C. R. M. , & Marquis , M. A. ( 1991 ). Learning from feedback: Exactingness and incentives . Journal of Experimental Psychology: Learning, Memory, and Cognition , 17 , 734 – 752 .

Huber , V. ( 1985 ). Effects of task diffi culty, goal setting, and strategy on performance of a heuristic task . Journal of Applied Psychology , 70 , 492 – 504 .

Page 23: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

295

References

Huff , A. , & Schwenk , C. R. ( 1990 ). Bias and sense - making in good times and bad . In A. S. Huff (Ed.), Mapping strategic thought (pp. 89 – 108 ). Chichester : Wiley .

Inagaki , T. ( 2003 ). Automation and the cost of authority . International Journal of Industrial Ergonomics , 31 , 169 – 174 .

Jacobs , B. , Prentice - Dunn , S. , & Rogers , R. W. ( 1984 ). Understanding per-sistence: An interface of control theory and self - effi cacy theory . Basic and Applied Social Psychology , 5 , 333 – 347 .

Jones , G. R. ( 1986 ). Socialization tactics, self - effi cacy, and newcomers ’ adjustment to organizations . Academy of Management Journal , 29 , 262 – 279 .

Kanfer , R. , & Ackerman , P. L. ( 1989 ). Motivation and cognitive abilities: An integrative/aptitude - treatment interaction approach to skill acqui-sition [Monograph] . Journal of Applied Psychology , 74 , 657 – 690 .

Kanfer , R. , Ackerman , P. L. , Murtha , T. C. , Dugdale , B. , & Nelson , L. ( 1994 ). Goals setting, conditions of practice, and task performance: A resource allocation perspective . Journal of Applied Psychology , 79 , 826 – 835 .

Karoly , P. ( 1993 ). Mechanisms of self - regulation: A systems view . Annual Review of Psychology , 44 , 23 – 52 .

Kelley , H. H. ( 1967 ). Attribution theory in social psychology . Nebraska Symposium on Motivation , 15 , 192 – 238 .

Kelley , H. H. , & Michela , J. L. ( 1980 ). Attribution theory and research . Annual Review of Psychology , 31 , 457 – 501 .

Kirsch , I. ( 1985 ). Response expectancy as a determinant of experience and behavior . American Psychologist , 40 , 1189 – 1202 .

Kren , L. ( 1992 ). The moderating effects of locus of control on performance incentives and participation . Human Relations , 45 , 991 – 1012 .

Libet , B. ( 1985 ). Unconscious cerebral initiative and the role of conscious will in voluntary action . Behavioral and Brain Sciences , 8 , 529 – 566 .

Litt , M. D. ( 1988 ). Self - effi cacy and perceived control: Cognitive mediators of pain tolerance . Journal of Personality and Social Psychology , 54 , 149 – 160 .

Locke , E. A. ( 1991 ). Goal theory vs. control theory: Contrasting approaches to understanding work motivation . Motivation and Emotion , 15 , 9 – 28 .

Locke , E. A. ( 2000 ). Motivation, cognition, and action: An analysis of studies of task goals and knowledge . Applied Psychology: An International Review , 49 , 408 – 429 .

Locke , E. A. , & Latham , G. P. ( 1990 ). A theory of goal setting and task perform-ance . Englewood Cliffs, NJ : Prentice Hall .

Page 24: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

296

Locke , E. A. , & Latham , G. P. ( 2002 ). Building a practically useful theory of goal setting and task motivation . American Psychologist , 57 , 705 – 717 .

Locke , E. A. , Shaw , K. , Saari , L. , & Latham , G. ( 1981 ). Goal setting and task performance: 1968 – 1980 . Psychological Bulletin , 90 , 125 – 152 .

Maddux , J. E. ( 1995 ). Self - effi cacy theory: An introduction . In J. E. Maddux (Ed.), Self - effi cacy, adaptation, and adjustment: Theory, research, and appli-cation (pp. 3 – 34 ). New York : Plenum .

Maddux , J. E. , Norton , L. , & Stoltenberg , C. D. ( 1986 ). Self - effi cacy expect-ancy, outcome expectancy, and outcome value: Relative infl uences on behavioral intentions . Journal of Personality and Social Psychology , 51 , 783 – 789 .

Manning , M. M. , & Wright , T. L. ( 1983 ). Self effi cacy expectancies, outcome expectancies, and the perspective of pain control in childbirth . Journal of Personality and Social Psychology , 45 , 421 – 431 .

Marx , K. ( 1963 ). Early writings (Ed. & Trans. T. B. Bottomore). New York : McGraw - Hill . (Originally published in 1844)

Maynard , D. , & Hakel , M. ( 1997 ). Effects of objective and subjective task complexity on performance . Human Performance , 10 , 303 – 330 .

McClelland , D. C. ( 1975 ). Power: The inner experience . New York : Irvington . McClelland , D. C. ( 1985 ). How motives, skills, and values determine what

people do . American Psychologist , 40 , 812 – 825 . Mead , G. H. ( 1934 ). Mind, self, and society . Chicago : University of Chicago

Press . Mento , A. J. , Steel , R. P. , & Karren , R. J. ( 1987 ). A meta - analytic study of

the effects of goal setting on task performance: 1966 – 1984 . Organizational Behavior and Human Decision Processes , 39 , 52 – 83 .

Mesch , D. , Farh , J. , & Podsakoff , P. ( 1994 ). The effects of feedback sign on group goal - setting, strategies, and performance . Group and Organ-izational Management , 19 , 309 – 333 .

Moray , N. , Inagaki , T. , & Itoh , M. ( 2000 ). Adaptive automation, trust, and self - confi dence in fault management in time - critical tasks . Journal of Experimental Psychology: Applied , 6 , 45 – 58 .

Moritz , S. E. , Feltz , D. L. , Fahrbach , K. R. , & Mach , D. E. ( 2000 ). The relation of self - effi cacy measures to sport performance: A meta - analytic review . Research Quarterly for Exercise and Sport , 71 , 280 – 294 .

Murayama , I. ( 1994 ). Role of agency in causal understanding of natural phenomena . Human Development , 37 , 198 – 206 .

Page 25: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

297

References

Neubert , M. ( 1998 ). The value of feedback and goal setting over goal setting along and potential moderators of this effect: A meta - analysis . Human Performance , 11 , 321 – 335 .

Olson , J. M. , Roese , N. J. , & Zanna , M. P. ( 1996 ). Expectancies . In E. T. Higgins & A. W. Kurglanski (Eds.), Social psychology: Handbook of basic principles (pp. 211 – 238 ). New York : Guilford .

Powers , W. T. ( 1973 ). Behavior: The control of perception . Chicago : Aldine . Powers , W. T. ( 1978 ). Quantitative analysis of purposive systems: Some

spadework at the foundations of scientifi c psychology . Psychological Review , 85 , 417 – 435 .

Powers , W. T. ( 1989 ). Living control systems . Gravel Switch, KY : Control Systems Group .

Richardson , G. P. ( 1991 ). Feedback thought: In social science and systems theory . Philadelphia : University of Pennsylvania Press .

Rotter , J. B. ( 1966 ). Generalized expectancies for internal versus external control of reinforcement . Psychological Monographs , 80 , 1 – 28 .

Sexton , T. L. , Tuckman , B. W. , & Crehan , K. ( 1992 ). An investigation of the patterns of self - effi cacy, outcome expectation, outcome value, and performance across trials . Cognitive Therapy and Research , 16 , 329 – 348 .

Shebilske , W. L. , Jordan , J. A. , Goettl , B. P. , & Paulus , L. E. ( 1998 ). Observation versus hands - on practice of complex skills in dyadic, triadic and tetradic training - teams . Human Factors , 40 , 525 – 540 .

Shebilske , W. L. , Regian , J. W. , Arthur , W. , Jr ., & Jordan , J. A. ( 1992 ). A dyadic protocol for training complex skill . Human Factors , 34 , 369 – 374 .

Soon , C. S. , Brass , M. , Heinze , J - C. , & Hayes , J - D. ( 2008 ). Unconscious determinants of free decisions in the human brain . Nature Neuroscience , 11 , 543 – 545 .

Spering , M. , Wagener , D. , & Funke , J. ( 2005 ). The role of emotions in complex problem solving . Cognition and Emotion , 19 , 1252 – 1261 .

Stumpf , S. A. , Brief , A. P. , & Hartman , K. ( 1987 ). Self - effi cacy expectations and coping with career - related events . Journal of Vocational Behavior , 31 , 91 – 108 .

Sutton , R. , & McClure , J. ( 2001 ). Covariation infl uences on goal - based explanations: An integrative model . Journal of Personality and Social Psychology , 80 , 222 – 236 .

Thompson , S. C. ( 1991 ). Intervening to enhance perceptions of control . In C. R. Snyder & D. R. Forsyth (Eds.), Handbook of social and clinical psy-chology (pp. 607 – 623 ). New York : Pergamon .

Page 26: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

298

Tversky , A. , & Kahneman , D. ( 1974 ). Judgment under uncertainty: Heuristics and biases . Science , 185 , 1124 – 1131 .

Vancouver , J. B. ( 1996 ). Living systems theory as a paradigm for organiza-tional behaviour: Understanding humans . Behavioral Sciences , 41 , 165 – 204 .

Vancouver , J. B. ( 2000 ). Self - regulation in organizational settings: A tale of two paradigms . In M. Boekaerts , P. Pintrich , & M. Zeidner (Eds.), Handbook of self - regulation . New York : Academic Press .

Vancouver , J. B. ( 2005 ). The depth of history and explanation as benefi t and bane for psychological control theories . Journal of Applied Psychology , 90 , 38 – 52 .

Vancouver , J. B. , & Kendall , L. ( 2006 ). When self - effi cacy negatively relates to motivation and performance in a learning context . Journal of Applied Psychology , 91 , 1146 – 1153 .

Vancouver , J. B. , More , K. M. , & Yoder , R. J. ( 2008 ). Self - effi cacy and resource allocation: support for a nonmonotonic discontinuous model . Journal of Applied Psychology , 93 , 35 – 47 .

Vancouver , J. B. , & Putka , D. J. ( 2000 ). Analyzing goal - striving processes and a test of the generalizability of perceptual control theory . Organ-izational Behavior and Human Decision Processes , 82 , 334 – 362 .

Vigoda - Gadot , E. , & Angert , L. ( 2007 ). Goal setting theory, job feedback, and OCB: Lessons from a longitudinal study . Basic and Applied Social Psychology , 29 , 119 – 128 .

Wagner , J. A. , & Gooding , R. Z. ( 1997 ). Equivocal information and attribu-tion: An investigation of patterns of managerial sensemaking . Strategic Management Journal , 18 , 275 – 286 .

Wegner , D. M. ( 2004 ). Pr é cis of The illusion of conscious will . Behavioral and Brain Sciences , 27 , 649 – 659 .

Wiener , N. ( 1948 ). Cybernetics: Or control and communication in the animal and the machine . New York : Wiley .

Williams , S. L. , Kinney , P. J. , & Falbo , J. ( 1989 ). Generalization of therapeu-tic changes in agoraphobia: The role of perceived self - effi cacy . Journal of Consulting and Clinical Psychology , 57 , 436 – 442 .

Wood , R. E. , & Bandura , A. ( 1989 ). Impact of conceptions of ability on self - regulatory mechanisms and complex decision making . Journal of Personality and Social Psychology , 56 , 407 – 415 .

Wood , R. E. , & Locke , E. A. ( 1987 ). The relation of self - effi cacy and grade goals to academic performance . Educational and Psychological Measurement , 47 , 1013 – 1024 .

Page 27: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

299

References

Yeo , G. B. , & Neal , A. ( 2006 ). An examination of the dynamic relationship between self - effi cacy and performance across levels of analysis and levels of specifi city . Journal of Applied Psychology , 91 , 1088 – 1101 .

Chapter 7

Anderson , J. R. ( 1982 ). Acquisition of cognitive skill . Psychological Review , 89 , 369 – 406 .

Bandura , A. ( 1989 ). Human agency in social cognitive theory . American Psychologist , 44 , 1175 – 1184 .

Bandura , A. ( 2001 ). Social cognitive theory: An agentic perspective . Annual Review of Psychology , 52 , 1 – 26 .

Bandura , A. , & Locke , E. A. ( 2003 ). Negative self - effi cacy and goal effects revisited . Journal of Applied Psychology , 88 , 87 – 99 .

Barnes , G. R. ( 2008 ). Cognitive processes involved in smooth pursuit eye movements . Brain and Cognition , 68 , 309 – 326 .

Berry , D. ( 1991 ). The role of action in implicit learning . Quarterly Journal of Experimental Psychology , 43 , 881 – 906 .

Berry , D. , & Broadbent , D. E. ( 1984 ). On the relationship between task performance and associated verbalizable knowledge . Quarterly Journal of Experimental Psychology , 36 , 209 – 231 .

Berry , D. , & Broadbent , D. E. ( 1987 ). The combination of implicit and explicit knowledge in task control . Psychological Research , 49 , 7 – 15 .

Berry , D. C. , & Broadbent , D. E. ( 1988 ). Interactive tasks and the implicit – explicit distinction . British Journal of Psychology , 79 , 251 – 272 .

Bj ö rkman , M. ( 1971 ). Policy formation as a function of feedback in a non - metric CPL - task . Ume å Psychological Reports , 49 .

Bredereke , J. , & Lankenau , A. ( 2005 ). Safety - relevant mode confusions modelling and reducing them . Reliability Engineering and System Safety , 88 , 229 – 245 .

Brehmer , B. ( 1992 ). Dynamic decision making: Human control of complex systems . Acta Psychologica , 81 , 211 – 241 .

Broadbent , D. E. ( 1977 ). Levels, hierarchies and the locus of control . Quarterly Journal of Experimental Psychology , 32 , 109 – 118 .

Broadbent , D. , & Ashton , B. ( 1978 ). Human control of a simulated eco-nomic system . Ergonomics , 78 , 1035 – 1043 .

Page 28: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

300

Broadbent , D. , Fitzgerald , P. , & Broadbent , M. H. P. ( 1986 ). Implicit and explicit knowledge in the control of complex systems . British Journal of Psychology , 77 , 33 – 50 .

Buchner , A. , & Funke , J. ( 1993 ). Finite - state automata: Dynamic task envi-ronments in problem - solving research . Quarterly Journal of Experimental Psychology , 46 , 83 – 118 .

Burns , B. D. , & Vollmeyer , R. ( 2002 ). Goal specifi city effects on hypothesis testing in problem solving . Quarterly Journal of Experimental Psychology , 55 , 241 – 261 .

Busemeyer , J. R. ( 2002 ). Dynamic decision making . In N. J. Smelser & P. B. Bates (Eds.), International encyclopedia of the social and behavioral sciences: Methodology, mathematics and computer science (pp. 3903 – 3908 ). Oxford : Elsevier .

Camp , G. , Paas , F. , Rikers , R. , & Van Merri ë nboer , J. ( 2001 ). Dynamic problem selection in air traffi c control training: A comparison between performance, mental effort and mental effi ciency . Computers in Human Behavior , 17 , 575 – 595 .

Campbell , D. ( 1988 ). Task complexity: A review and analysis . Academy of Management Review , 13 , 40 – 52 .

Castellan , N. J. , Jr . ( 1973 ). Multiple - cue probability learning with irrelevant cues . Organizational Behavior and Human Performance , 9 , 16 – 29 .

Castellan , N. J. , Jr . ( 1977 ). Decision making with multiple probabilistic cues . In N. J. Castellan , B. B. Pisoni , & G. R. Potts (Eds.), Cognitive theory , vol. 2 . Hillsdale, NJ : Erlbaum .

Castellan , N. J. , Jr ., & Edgell , S. E. ( 1973 ). An hypothesis generation model for judgment in non - metric multiple - cue probability learning . Journal of Mathematical Psychology , 10 , 204 – 222 .

Chery , S. , Vicente , K. J. , & Farrell , P. ( 1999 ). Perceptual control theory and ecological interface design: Lessons learned from the CDU . In Proceedings of the Human Factors and Ergonomics Society 43rd annual meeting (pp. 389 – 393 ). Santa Monica, CA : Human Factors and Ergonomics Society .

Chmiel , N. , & Wall , T. ( 1994 ). Fault prevention, job design, and the adap-tive control of advance manufacturing technology . Applied Psychology: An International Review , 43 , 455 – 473 .

Cohen , M. S. , Freeman , J. T. , & Wolf , S. ( 1996 ). Meta - cognition in time stressed decision making: Recognizing, critiquing and correcting . Human Factors , 38 , 206 – 219 .

Cooper , G. , & Herskovits , E. ( 1992 ). A Bayesian method for the induction of probabilistic networks from data . Machine Learning , 9 , 309 – 347 .

Page 29: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

301

References

Degani , A. ( 2004 ). Taming HAL: Designing interfaces beyond 2001 . New York : Palgrave Macmillan .

Diehl , E. , & Sterman , J. D. ( 1995 ). Effects of feedback complexity on dynamic decision making . Organizational Behavior and Human Decision Processes , 62 , 198 – 215 .

Dienes , Z. , & Berry , D. ( 1997 ). Implicit learning: Below the subjective threshold . Psychonomic Bulletin and Review , 4 , 3 – 23 .

Dienes , Z. , & Fahey , R. ( 1995 ). Role of specifi c instances in controlling a dynamic system . Journal of Experimental Psychology: Learning, Memory, & Cognition , 21 , 848 – 862 .

Dienes , Z. , & Fahey , R. ( 1998 ). The role of implicit memory in controlling a dynamic system . Quarterly Journal of Experimental Psychology , 51 , 593 – 614 .

D ö rner , D. ( 1975 ). Wie Menschen eine Welt verbessern wollten und sie dabei zerst ö rten [How people wanted to improve a world and in the proc-ess destroyed it ]. Bild der Wissenschaft , 12 (Popul ä rwissenschaftlicher Aufsatz), 48 – 53 .

D ö rner , D. ( 1989 ). The logic of failure . New York : Henry Holt . Earley , P. C. , Northcraft , G. B. , Lee , C. , & Lituchy , T. R. ( 1990 ). Impact of

process and outcome feedback on the relation of goal setting to task performance . Academy of Management Journal , 33 , 87 – 105 .

Edgell , S. E. ( 1974 ). Confi gural information processing in decision mak-ing. Indiana Mathematical Psychology Program , Report no. 74 - 4 . Bloomington : Department of Psychology, Indiana University .

Eitam , B. , Hassan , R. , & Schul , Y. ( 2008 ). Nonconscious goal pursuit in novel environments: The case of implicit learning . Psychological Science , 19 , 261 – 267 .

Fitts , P. M. , & Posner , M. I. ( 1967 ). Human performance . Belmont, CA : Brooks/Cole .

Flanagan , J. R. , Vetter , P. , Johansson , R. S. , & Wolpert , D. M. ( 2003 ). Prediction precedes control in motor learning . Current Biology , 13 , 146 – 150 .

Funke , J. ( 2001 ). Dynamic systems as tools for analyzing human judgment . Thinking and Reasoning , 7 , 69 – 89 .

Gardner , P. H. , Chmiel , N. , & Wall , T. ( 1996 ). Implicit knowledge and fault diagnosis in the control of advanced manufacturing technology . Behaviour & Information Technology , 15 , 205 – 212 .

Gatfi eld , D. ( 1999 ). Can cognitive science improve the training of industrial process operators? Journal of Safety Research , 30 , 133 – 142 .

Gawthrop , P. , Lakie , M. , & Loram , I. ( 2008 ). Predictive feedback control and Fitts ’ law . Biological Cybernetics , 98 , 229 – 238 .

Page 30: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

302

Geddes , B. W. , & Stevenson , R. J. ( 1997 ). Explicit learning of a dynamic system with a non - salient pattern . Quarterly Journal of Experimental Psychology , 50A , 742 – 765 .

Gibson , F. P. ( 2007 ). Learning and transfer in dynamic decision environ-ments . Computational and Mathematical Organizational Theory , 13 , 39 – 61 .

Giesler , B. R. , Josephs , R. A. , & Swann , W. B. ( 1996 ). Self - verifi cation in clinical depression: The desire for negative evaluation . Journal of Abnormal Psychology , 105 , 358 – 368 .

Gonzales , C. , Lerch , F. J. , & Lebiere , C. ( 2003 ). Instance - based learning in dynamic decision making . Cognitive Science , 27 , 591 – 635 .

Gopnik , A. , Glymour , C. , Sobel , D. M. , Schulz , L. E. , Kushnir , T. , & Danks , D. ( 2004 ). A theory of causal learning in children: Causal maps and Bayes nets . Psychological Review , 111 , 3 – 32 .

Grafton , S. , Schmitt , P. , Van Horn , J. , & Diedrichsen , J. ( 2008 ). Neural sub-strates of visuomotor learning based on improved feedback control and prediction . NeuroImage , 39 , 1383 – 1395 .

Hagmayer , Y. , Meder , B. , Osman , M. , Mangold , S. , & Lagnado , D. (In press). Spontaneous causal learning while controlling a dynamic system . Open Psychology Journal .

Hill , R. J. , Gordon , A. , & Kim , J. ( 2004 ). Learning the lessons of leadership experience: Tools for interactive case method analysis . In Proceedings of the Twenty - Fourth Army Science Conference , Orlando, FL .

Holzworth , R. J. , & Doherty , M. E. ( 1976 ). Feedback effects in a metric multiple - cue probability learning task . Bulletin of the Psychonomic Society , 8 , 1 – 3 .

Hommel , B. ( 1998 ). Perceiving one ’ s own action – and what it leads to . In J. S. Jordan (Ed.), Systems theories and a priori aspects of perception . (pp 145 – 178 ). Amsterdam : Elsevier Science .

Howell , W. C. , & Funaro , J. F. ( 1965 ). Prediction on the basis of conditional probabilities . Journal of Experimental Psychology , 69 , 92 – 99 .

Jamieson , G. A. , Miller , C. M. , Ho , W. H. , & Vicente , K. J. ( 2007 ). Integrating task - and work domain - based work analysis in ecological interface design: A process control case study . IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans , 6 , 887 – 905 .

Jonassen , D. , & Hung , W. ( 2008 ). All problems are not equal: Implications for problem - based learning . Interdisciplinary Journal of Problem - Based Learning , 2 , 6 – 28 .

Page 31: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

303

References

Jungermann , H. , & Th ü ring , M. ( 1993 ). Causal knowledge and the expres-sion of uncertainty . In G. Strube & K. F. Wender (Eds.), The cognitive psychology of knowledge (pp. 53 – 73 ). Amsterdam : Elsevier Science .

Kanfer , R. , Ackerman , P. L. , Murtha , T. C. , Dugdale , B. , & Nelson , L. ( 1994 ). Goals setting, conditions of practice, and task performance: A resource allocation perspective . Journal of Applied Psychology , 79 , 826 – 835 .

Kerstholt , J. H. ( 1996 ). The effect of information cost on strategy selection in dynamic tasks . Acta Psychologia , 94 , 273 – 290 .

Kerstholt , J. H. , & Raaijmakers , J. G. W. ( 1997 ). Decision making in dynamic task environments . In R. Ranyard , R. W. Crozier , & O. Svenson (Eds.), Decision making: Cognitive models and explanations (pp. 205 – 217 ). New York : Routledge .

Klahr , D. , & Dunbar , K. ( 1988 ). Dual space search during scientifi c reason-ing . Cognitive Science , 12 , 1 – 55 .

Klein , G. ( 1997 ). Developing expertise in decision making . Thinking and Reasoning , 3 , 337 – 352 .

Knowlton , B. J. , Mangels , J. A. , & Squire , L. R. ( 1996 ). A neostriatal habit learning system in humans . Science , 273 , 1399 – 1402 .

Kornell , N. , Son , L. K. , & Terrace H. S. ( 2007 ). Transfer of metacognitive skills and hint seeking in monkeys . Psychological Science , 18 , 64 – 71 .

Krueger , G. P. ( 1989 ). Sustained work, fatigue, sleep loss and performance: A review of the issues . Work Stress , 3 , 129 – 141 .

Krynski , T. , & Tenenbaum , J. ( 2007 ). The role of causality in judgment under uncertainty . Journal of Experimental Psychology: General , 136I , 430 – 450 .

Lagnado , D. , Newell , B. R. , Kahan , S. , & Shanks , D. R. ( 2006 ). Insight and strategy in multiple cue learning . Journal of Experimental Psychology: General , 135 , 162 – 183 .

Lagnado , D. , & Sloman , S. A. ( 2004 ). The advantage of timely intervention . Journal of Experimental Psychology: Learning, Memory, and Cognition , 30 , 856 – 876 .

Langley , P. A. , & Morecroft , J. D. ( 2004 ). Decision aiding: Performance and learning in a simulation of oil industry dynamics . European Journal of Operational Research , 155 , 715 – 732 .

Lanzetta , J. T. , & Driscoll , J. M. ( 1966 ). Preference for information about an uncertain but unavoidable outcome . Journal of Personality and Social Psychology , 3 , 96 – 102 .

Page 32: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

304

Lee , Y. ( 1995 ). Effects of learning contexts on implicit and explicit learning . Memory and Cognition , 23 , 723 – 734 .

Lee , Y. , & Vakoch , D. ( 1996 ). Transfer and retention of implicit and explicit learning . British Journal of Psychology , 87 , 637 – 651 .

Leigh , J. R. ( 1992 ). Control theory: A guided tour . London : Peter Peregrinus . Lerch , F. J. , & Harter , D. E. ( 2001 ). Cognitive support for real - time dynamic

decision making . Information Systems Research , 12 , 63 – 82 . Lichacz , F. ( 2005 ). Examining the effects of combined stressors on dynamic

task performance . International Journal of Aviation Psychology , 15 , 45 – 66 .

Lipshitz , R. , Klein , G. , Orasanu , J. , & Salas , E. ( 2001 ). Taking stock of natu-ralistic decision making . Journal of Behavioral Decision Making , 14 , 332 – 251 .

Lipshitz , R. , & Strauss , O. ( 1997 ). Coping with uncertainty: A naturalistic decision - making analysis . Organizational Behavior and Human Decision Processes , 69 , 149 – 163 .

Locke , E. A. ( 1991 ). Goal theory vs. control theory: Contrasting approaches to understanding work motivation . Motivation and Emotion , 15 , 9 – 28 .

Locke , E. A. ( 2000 ). Motivation, cognition, and action: An analysis of studies of task goals and knowledge . Applied Psychology: An International Review , 49 , 408 – 429 .

Marescaux , P - J. , Luc , F. , & Karnas , G. ( 1989 ). Modes d ’ apprentissage s é lec-tif et nons é lectif et connaissances acquies au contr ô le d ’ un processes: É valuation d ’ un mod è le simul é [Selective and nonselective learning modes and acquiring knowledge of process control: Evaluation of a simulation model] . Cahiers de Psychologie Cognitive , 9 , 239 – 264 .

Meder , B. , Gersteberg , T. , Hagmayer , Y. , & Waldmann , M. R. (In press). Observing and intervening: Rational and heuristic models of causal decision making . Open Psychology Journal .

Meder , B. , Hagmayer , Y. , & Waldmann , M. R. ( 2008 ). Inferring interven-tional predictions from observational learning data . Psychonomic Bulletin & Review , 15 , 75 – 80 .

Moxnes , E. ( 2000 ). Not only the tragedy of the commons: Misperceptions of feedback and policies for sustainable development . System Dynamics Review , 16 , 325 – 348 .

Muchinsky , P. M. , & Dudycha , A. L. ( 1975 ). Human inference behavior in abstract and meaningful environments . Organizational Behavior and Human Performance , 13 , 377 – 391 .

Page 33: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

305

References

Nelson , T. O. ( 1996 ). Consciousness and metacognition . American Psychologist , 51 , 102 – 116 .

Orasanu , J. , & Connolly , T. ( 1993 ). The reinvention of decision making . In G. Klein , J. Orasanu , & R. Calderwood (Eds.), Decision making in action: Models and methods (pp. 3 – 20 ). Norwood, NJ : Ablex .

Osman , M. ( 2004 ). An evaluation of dual process theories of reasoning . Psychonomic Bulletin & Review , 11 , 998 – 1010 .

Osman , M. ( 2008a ). Evidence for positive transfer and negative transfer/anti - learning of problem solving skills . Journal of Experimental Psychology: General , 137 , 97 – 115 .

Osman , M. ( 2008b ). Observation can be as effective as action in problem solving . Cognitive Science , 32 , 162 – 183 .

Osman , M. ( 2008c ). Seeing is as good as doing . Journal of Problem Solving , 2 ( 1 ), art. 3 .

Osman , M. ( 2010 ). Controlling uncertainty: A review of human behavior in complex dynamic environments . Psychological Bulletin , 136 , 65 – 86 .

Osman , M. , & Stavy , R. ( 2006 ). Intuitive rules: From formative to devel-oped reasoning . Psychonomic Bulletin & Review , 13 , 935 – 953 .

Osman , M. , Wilkinson , L. , Beigi , M. , Parvez , C. , & Jahanshahi , M. ( 2008 ). The striatum and learning to control a complex system? Neuropsychologia , 46 , 2355 – 2363 .

Pacherie , E. ( 2008 ). The phenomenology of action: A conceptual frame-work . Cognition , 107 , 179 – 217 .

Pearl , J. ( 2000 ). Causality: Models, reasoning, and inference . Cambridge : Cambridge University Press .

Poldrack , R. , Clark , J. , Par é - Blagoev , E. J. , Shahomy , D. , Creso Moyano , J. , Myers , C. , & Gluck , M. ( 2001 ). Interactive memory systems in the human memory . Nature , 414 , 546 – 550 .

Price , A. ( 2009 ). Distinguishing the contributions of implicit and explicit processes to performance on the weather prediction task . Memory and Cognition , 37 , 210 – 222 .

Quesada , J. , Kintsch , W. , & Gonzales , E. ( 2005 ). Complex problem solving: A fi eld in search for a defi nition? Theoretical Issues in Ergonomic Science , 6 ( 1 ), 5 – 33 .

Randel , J. M. , Pugh , L. , & Reed , S. K. ( 1996 ). Differences in expert and novice situation awareness in naturalistic decision making . International Journal of Human Computer Studies , 45 , 579 – 597 .

Renkl , A. ( 1997 ). Learning from worked - out examples: A study on indi-vidual differences . Cognitive Science , 21 , 1 – 29 .

Page 34: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

306

Rothstein , H. G. ( 1986 ). The effects of time pressure on judgment in multiple cue probability learning . Organizational Behavior and Human Decision Processes , 37 , 83 – 92 .

Sanderson , P. M. ( 1989 ). Verbalizable knowledge and skilled task per-formance: Association, dissociation, and mental models . Journal of Experimental Psychology: Learning, Memory, & Cognition , 15 , 729 – 747 .

Sarter , N. B. , Mumaw , R. J. , & Wickens , C. D. ( 2007 ). Pilots ’ monitoring strategies and performance on automated fl ight decks: An empirical study combining behavioral and eye - tracking data . Human Factors , 49 , 347 – 357 .

Sauer , J. , Burkolter , D. , Kluge , A. , Ritzmann , S. , & Sch ü ler , K. ( 2008 ). The effects of heuristic rule training an operator performance in a simu-lated process control environment . Ergonomics , 7 , 953 – 967 .

Schoppek , W. ( 2002 ). Examples, rules and strategies in the control of dynamic systems . Cognitive Science Quarterly , 2 , 63 – 92 .

Shanks , D. R. , & St John , M. F. ( 1994 ). Characteristics of dissociable human learning systems . Behavioral & Brain Sciences , 17 , 367 – 447 .

Simon , H. A. , & Lea , G. ( 1974 ). Problem solving and rule induction: A unifi ed view . In L. W. Gregg (Ed.), Knowledge and cognition (pp. 105 – 127 ). Hillsdale, NJ : Lawrence Erlbaum Associates .

Skinner , B. F. ( 1953 ). Science and human behavior . New York : Free Press . Sloman , S. A. , & Lagnado , D. A. ( 2005 ). Do we ‘ do ’ ? Cognitive Science , 29 ,

5 – 39 . Slovic , P. , Rorer , L. G. , & Hoffman , P. J. ( 1971 ). Analyzing use of diagnostic

signs . Investigative Radiology , 6 , 18 – 26 . Speekenbrink , M. , Channon , S. , & Shanks , D. R. ( 2008 ). Learning strategies

in amnesia . Neuroscience & Biobehavioral Reviews , 32 , 292 – 310 . Spirtes , P. , Glymour , C. , & Schienes , P. ( 1993 ). Causation, prediction, and

search . New York : Springer Verlag . Stanley , W. B. , Mathews , R. C. , Buss , R. R. , & Kotler - Cope , S. ( 1989 ). Insight

without awareness: On the interaction of verbalization, instruction, and practice in a simulated process control task . Quarterly Journal of Experimental Psychology , 41 , 553 – 577 .

Stavy , R. , & Tirosh , D. ( 1996 ). Intuitive rules in science and mathematics: The case of ‘ more of A more of B ’ . International Journal of Science Education , 18 , 653 – 667 .

Stavy , R. , & Tirosh , D. ( 2000 ). How students (mis - )understand science and mathematics: Intuitive rules . New York : Teachers College Press .

Page 35: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

307

References

Sterman , J. D. ( 1989 ). Misperceptions of feedback in dynamic decision mak-ing . Organizational Behavior & Human Decision Processes , 43 , 301 – 335 .

Sterman , J. D. ( 1994 ). Learning in and about complex systems . System Dynamics Review , 10 , 291 – 330 .

Sterman , J. D. ( 2002 ). All models are wrong: Refl ections on becoming a systems scientist . System Dynamics Review , 18 , 501 – 531 .

Sternberg , R. J. ( 1989 ). Domain - generality versus domain - specifi city: The life and impending death of a false dichotomy . Merrill - Palmer Quarterly , 35 , 115 – 130 .

Steyvers , M. , Tenenbaum , J. B. , Wagenmakers , E. J. , & Blum , B. ( 2003 ). Inferring causal networks from observations and interventions . Cognitive Science , 27 , 453 – 489 .

Strohschneider , S. , & Guss , D. ( 1999 ). The fate of the MOROS: A cross - cultural exploration of strategies in complex and dynamic decision making . International Journal of Psychology , 34 , 235 – 252 .

Sun , R. , Merrill , E. , & Peterson , T. ( 2001 ). From implicit skills to explicit knowledge: A bottom - up model of skill learning . Cognitive Science , 25 , 203 – 244 .

Sun , R. , Slusarz , P. , & Terry , C. ( 2005 ). The interaction of the explicit and the implicit in skill learning: A dual - process approach . Psychological Review , 112 , 159 – 192 .

Sun , R. , Zhang , X. , Slusarz , P. , & Mathews , R. ( 2007 ). The interaction of implicit learning, explicit hypothesis testing learning and implicit - to - explicit knowledge extraction . Neural Networks , 20 , 34 – 47 .

Sweller , J. ( 1988 ). Cognitive load during problem solving: Effects of learn-ing . Cognitive Science , 12 , 257 – 285 .

Tenenbaum , J. B. , & Griffi ths , T. L. ( 2001 ). Generalization, similarity, and Bayesian inference . Behavioral and Brain Sciences , 24 , 629 – 641 .

Tenenbaum , J. B. , Griffi ths , T. L. , & Kemp , C. ( 2006 ). Theory - based Bayesian models for inductive learning and reasoning . Trends in Cognitive Sciences , 10 ( 7 ), 309 – 318 .

Toda , M. ( 1962 ). The design of the fungus eater: A model of human behav-ior in an unsophisticated environment . Behavioral Science , 7 , 164 – 183 .

Trumpower , D. L. , Goldsmith , T. E. , & Guynn , M. ( 2004 ). Goal specifi city and knowledge acquisition in statistics problem solving: Evidence for attentional focus . Memory & Cognition , 32 , 1379 – 1388 .

Vicente , K. J. ( 2002 ). Ecological interface design: Process and challenges . Human Factors , 44 , 62 – 78 .

Page 36: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

308

Vicente , K , J. , & Wang , J. H. ( 1998 ). An ecological theory of expertise effects in memory recall . Psychological Review , 105 , 33 – 57 .

Vlek , C. A. J. , & van der Heijden , L. H. C. ( 1970 ). Aspects of suboptimality in a multidimensional probabilistic information processing task . Acta Psychologia , 34 , 300 – 310 .

Vollmeyer , R. , Burns , B. D. , & Holyoak , K. J. ( 1996 ). The impact of goal specifi city and systematicity of strategies on the acquisition of problem structure . Cognitive Science , 20 , 75 – 100 .

Wilkinson , L. , Lagnado , D. A. , Quallo , M. , & Jahanashahi , M. ( 2008 ). The effect of feedback on non - motor probabilistic classifi cation learning in Parkinson ’ s disease . Neuropsychologia , 46 , 2683 – 2695 .

Witt , K. , Daniels , C. , Daniel , V. , Schmitt - Eliassen , J. , Volkmann , J. , & Deuschl , G. ( 2006 ). Patients with Parkinson ’ s disease learn to control complex systems: An indication for intact implicit cognitive skill learn-ing . Neuropsychologia , 44 , 2445 – 2451 .

Chapter 8

Banks , J. , Olson , M. , & Porter , D. ( 1997 ). An experimental analysis of the bandit problem . Economic Theory , 10 , 55 – 77 .

Behrens , T. E. , Woolrich , M. W. , Walton , M. E. , & Rushworth , M. F. ( 2007 ). Learning the value of information in an uncertain world . Nature Neuroscience , 10 , 1214 – 1221 .

Blaisdell , A. P. , Sawa , K. , Leising , K. , & Waldmann , M. ( 2006 ). Causal reasoning in rats . Science , 311 , 1020 – 1022 .

Boles , T. L. , & Messick , D. M. ( 1995 ). A reverse outcome bias: The infl uence of multiple reference points on the evaluation of outcomes and decisions . Organizational Behavior and Human Decision Processes , 61 , 262 – 275 .

Boorman , E. D. , Behrens , T. E. , Woolrich , M. W. , & Rushworth , M. F. ( 2009 ). How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action . Neuron , 62 , 733 – 743 .

Botvinick , M. M. , Cohen , J. D. , & Carter , C. S. ( 2004 ). Confl ict monitoring and anterior cingulate cortex: An update . Trends in Cognitive Science , 8 , 529 – 546 .

Brezzi , M. , & Lai , T. L. ( 2002 ). Optimal learning and experimentation in bandit problems . Journal of Economic Dynamics & Control , 27 , 87 – 108 .

Page 37: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

309

References

Bush , G. , Luu , P. , & Posner , M. I. ( 2000 ). Cognitive and emotional infl uences in anterior cingulate cortex . Trends in Cognitive Science , 4 , 215 – 222 .

Camerer , C. , Loewenstein , G. , & Prelec , D. ( 2004 ). Neuroeconomics: Why economics needs brains . Scandinavian Journal of Economics , 106 , 555 – 579 .

Camerer , C. , Loewenstein , G. , & Prelec , D. ( 2005 ). Neuroeconomics: How neuroscience can inform economics . Journal of Economic Literature , 43 , 9 – 64 .

Clark , L. , Lawrence , A. , Astley - Jones , F. , & Gray , N. ( 2009 ). Gambling near - misses enhance motivation to gamble and recruit win - related brain circuitry . Neuron , 61 , 481 – 490 .

Cohen , M. ( 2006 ). Individual differences and the neural representations of reward expectancy and reward error prediction . Scan , 2 , 20 – 30 .

Cohen , M. , Elger , C. E. , & Ranganath , C. ( 2007 ). Reward expectation modulates feedback - related negativity and EEG spectra . NeuroImage , 35 , 968 – 978 .

Cohen , M. , Elger , C. , & Weber , B. ( 2008 ). Amygdala tractography predicts functional connectivity and learning during feedback - guided decision making . NeuroImage , 39 , 1396 – 1407 .

Cohen , M. , McClure , S. M. , & Yu , A. ( 2007 ). Should I stay or should I go? How the human brain manages the trade - off between exploitation and exploration . Philosophical Transactions of the Royal Society , 362 , 933 – 942 .

Coltheart , M. ( 2006 ). What has functional neuroimaging told us about the mind (so far)? Cortex , 42 , 323 – 331 .

Critchley , H. D. , Mathias , C. J. , & Dolan , R. J. ( 2001 ). Neural activity in the human brain relating to uncertainty and arousal during anticipation . Neuron , 29 , 537 – 545 .

Dam , G. , & K ö rding , K. ( 2009 ). Exploration and exploitation during sequen-tial search . Cognitive Science , 33 , 530 – 541 .

Daw , N. D. , Niv , L. , & Dayan , P. ( 2005 ). Uncertainty - based competition between prefrontal and dorsolateral striatal systems for behavioral control . Nature Neuroscience , 8 , 1704 – 1711 .

Daw , N. D. , O ’ Doherty , J. P. , Dayan , P. , Seymour , B. , & Dolan , R. ( 2006 ). Cortical substrates for exploratory decisions in humans . Nature , 441 , 876 – 879 .

Dayan , P. , Kakade , S. , & Montague , P. R. ( 2000 ). Learning and selective attention . Nature Neuroscience , 3 , 1218 – 1223 .

Dayan , P. , & Niv , Y. ( 2008 ). Reinforcement learning: The good, the bad and the ugly . Current Opinion in Neurobiology , 18 , 185 – 196 .

Page 38: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

310

Devinsky , O. , Morrell , M. J. , & Vogt , B. A. ( 1995 ). Contributions of anterior cingulate cortex to behavior . Brain , 118 , 279 – 303 .

Doya , K. ( 2008 ). Modulators of decision making . Nature Neuroscience , 11 , 410 – 416 .

Fuster , J. M. ( 2003 ). Cortex and mind . Oxford : Oxford University Press . Gallistel , C. R. , Mark , T. A. , King , A. P. , & Latham , P. E. ( 2001 ). The

rat approximates an ideal detector of changes in rates of reward: Implications for the law of effect . Journal of Experimental Psychology: Animal Behavioral Processes , 27 , 354 – 372 .

Getting , P. ( 1989 ). Emergent principles governing the operation of neural networks . Annual Review of Neuroscience , 12 , 185 – 204 .

Gigerenzer , G. , & Todd , P. ( 1999 ). Simple heuristics that make us smart . New York : Oxford University Press .

Glimcher , P. ( 2003 ). Decisions, uncertainty, and the brain: The science of neur-oeconomics . Cambridge, MA : MIT Press .

Glimcher , P. , & Rustichini , A. ( 2004 ). Neuroeconomics: The consilience of brain and decision . Science , 306 , 447 – 452 .

Henson , R. ( 2005 ). What can functional neuroimaging tell the experimental psychologist ? Quarterly Journal of Experimental Psychology , 58A , 193 – 233 .

Henson , R. ( 2006 ). What has (neuro)psychology told us about the mind (so far)? Cortex , 42 , 387 – 392 .

Jocham , G. , Neumann , J. , Klein , T. , Danielmeier , C. , & Ullsperger , M. ( 2009 ). Adaptive coding of action values in the human rostral cingu-late zone . Journal of Neuroscience , 29 , 7489 – 7496 .

Kable , J. , & Glimcher , P. ( 2007 ). The neural correlates of subjective value during intertemporal choice . Nature Neuroscience , 10 , 1625 – 1633 .

Kahneman , D. , & Frederick , S. ( 2002 ). Representativeness revisited: Attribute substitution in intuitive judgement . In T. Gilovich , D. Griffi n , & D. Kahneman (Eds.), Heuristics and biases: The psychology of intuitive judgement (pp. 49 – 81 ). New York : Cambridge University Press .

Kheramin , S. , Body , S. , Ho , M. Y. , Velazquez - Martinez , D. N. , Bradshaw , C. M. , Szabadi , E. , Deakin , J. F. W. , & Anderson , I. M. ( 2004 ). Effects of orbital prefrontal cortex dopamine depletion on inter - temporal choice: A quantitative analysis . Psychopharmacology , 175 , 206 – 214 .

Koechlin , E. , & Summerfi eld , C. ( 2007 ). An information theoretical approach to prefrontal executive function . Trends in Cognitive Science , 11 , 229 – 235 .

Langer , E. J. ( 1975 ). The illusion of control . Journal of Personality and Social Psychology , 31 , 311 – 328 .

Page 39: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

311

References

Lennie , P. ( 2003 ). The cost of cortical computation . Current Biology , 13 , 493 – 497 .

Luu , P. , Shane , M. , Pratt , N. , & Tucker , D. ( 2008 ). Corticolimbic mecha-nisms in the control of trial and error learning . Brain Research , 1247 , 100 – 113 .

MacDonald , A. W. , Cohen , J. D. , Stenger , A. , & Carter , C. S. ( 2000 ). Dissociating the role of the dorsolateral prefrontal and anterior cingu-late cortex in cognitive control . Science , 288 , 1835 – 1838 .

Madden , G. J. , Dake , J. M. , Mauel , E. C. , & Rowe , R. R. ( 2005 ). Labor supply and consumption of food in a closed economy under a range of fi xed - and random - ratio schedules: Tests of unit price . Journal of the Experimental Analysis of Behavior , 83 , 99 – 118 .

Madden , G. J. , Ewan , E. E. , & Lagorio , C. H. ( 2007 ). Toward an animal model of gambling: Delay discounting and the allure of unpredictable outcomes . Journal of Gambling Studies , 23 , 63 – 83 .

Marco - Pallar é s , J. , M ü ller , A. V. , & M ü nte , T. ( 2007 ). Learning by doing: An fMRI study of feedback - related brain activations . NeuroReport , 14 , 1423 – 1426 .

Marcus , G. ( 2008 ). Kluge: The haphazard construction of the mind . Boston : Houghton - Miffl in .

Martinez , F. , Bonnefon , J - F. , & Hoskens , J. ( 2009 ). Active involvement, not illusory control, increases risk taking in a gambling game . Quarterly Journal of Experimental Psychology , 62 , 1063 – 1071 .

Matsumoto , K. , Suzuki , W. , & Tanaka , K. ( 2003 ). Neuronal correlates of goal - based motor selection in the prefrontal cortex . Science , 301 , 229 – 232 .

McClure , S. M. , Laibson , D. I. , Loewenstein , G. , & Cohen , J. D. ( 2004 ). Separate neural systems value immediate and delayed monetary rewards . Science , 306 , 503 – 507 .

Miller , E. K. , & Buschman , T. J. ( 2006 ). Bootstrapping your brain: How interactions between the frontal cortex and basal ganglia may produce organized actions and lofty thoughts . In J. L. Martinez & R. P. Kesner (Eds.), Neurobiology of learning and memory ( 2nd ed. ). Burlington, MA : Academic Press .

Miller , E. K. , & Cohen , J. D. ( 2001 ). An integrative theory of prefrontal cortical function . Annual Review of Neuroscience , 24 , 167 – 202 .

Montague , P. R. , Hyman , S. E. , & Cohen , J. D. ( 2004 ). Computational roles for dopamine in behavioural control . Nature , 431 , 760 – 767 .

Page 40: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

312

Morsella , E. ( 2009 ). The mechanisms of human action: Introduction and background . In E. Morsella , J. A. Bargh , & P. M. Gollwitzer (Eds.), Oxford handbook of human action . Oxford : Oxford University Press .

Nygren , T. E. , Isen , A. M. , Taylor , P. J. , & Dulin , J. ( 1996 ). The infl uence of positive affect on the decision rule in risk situations: Focus on outcome (and especially avoidance of loss) rather than probability . Organizational Behavior and Human Decision Processes , 66 , 59 – 72 .

O ’ Doherty , J. ( 2004 ). Reward representations and reward - related learning in the human brain: Insights from neuroimaging . Current Opinion in Neurobiology , 14 , 769 – 776 .

O ’ Doherty , J. , Kringelbach , M. L. , Rolls , E. T. , Hornak , J. , & Andrews , C. ( 2001 ). Abstract reward and punishment representations in the human orbitofrontal cortex . Nature Neuroscience , 4 , 95 – 102 .

Pado - Schiopp , C. , & Assad , J. ( 2006 ). Neurons in the orbitofrontal cortex encode economic value . Nature , 441 , 223 – 226 .

Philiastedies , M. G. , Ratcliff , R. , & Sajda , P. ( 2006 ). Neural representations of task diffi culty and decision making during perceptual categoriza-tion: A timing diagram . Journal of Neuroscience , 26 , 8965 – 8975 .

Platt , M. L. , & Glimcher , P. ( 1999 ). Neural correlates of decision variables in the parietal cortex . Nature , 400 , 233 – 238 .

Ratcliff , R. , Philiastides , M. G. , & Sajda , P. ( 2009 ). Quality of evidence for perceptual decision making is indexed by trial - to - trial variability of the EEG . Proceedings of the National Academy of Sciences of the United States of America , 106 , 6539 – 6544 .

Reddish , D. , Jensen , S. , Johnson , A. , & Kirth - Nelson , Z. ( 2007 ). Reconciling reinforcement learning models with behavioral extinction and renewal: Implication for addition, relapse, and problem gambling . Psychological Review , 114 , 784 – 805 .

Robbins , T. W. ( 2000 ). Chemical neuromodulation of frontal - executive functions in humans and other animals . Experimental Brain Research , 133 , 130 – 138 .

Rodriguez , P. F. ( 2009 ). Stimulus - outcome learnability differentially acti-vates anterior cingulate and hippocampus at feedback . Learning and Memory , 16 , 324 – 331 .

Rustichini , A. ( 2005 ). Neuroeconomics: Past and future . Games and Economic Behavior , 52 , 201 – 212 .

Sailer , U. , Robinson , S. , Fischmeister , F. , Moser , E. , Kryspin - Exner , I. , & Bauer , H. ( 2007 ). Imaging the changing role of feedback during learn-ing in decision making . NeuroImage , 37 , 1474 – 1486 .

Page 41: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

313

References

Schultz , W. ( 2006 ). Behavioral theories and the neurophysiology of reward . Annual Review of Psychology , 57 , 87 – 115 .

Schultz , W. , Dayan , P. , & Montague , P. R. ( 1997 ). A neural substrate of prediction and reward . Science , 275 , 1593 – 1599 .

Schultz , W. , Preuschoff , K. , Camerer , C. , Hsu , M. , Fiorillo , C. , Tobler , P. , & Bossaerts , P. ( 2008 ). Explicit neural signals refl ect reward uncer-tainty . Philosophical Transactions of the Royal Society B , 363 , 3801 – 3811 .

Segalowitz , S. J. , & Dywan , J. ( 2009 ). Individual differences and develop-mental change in the ERN response: Implications for models of ACC function . Psychological Research , 73 , 857 – 870 .

Seymour , B. , Daw , N. , Dayan , P. , Singer , T. , & Dolan , R. ( 2007 ). Differential encoding of losses and gains in the human striatum . Journal of Neuroscience , 27 , 4826 – 4831 .

Shea , N. , Krug , K. , & Tobler , P. ( 2008 ). Conceptual representations in goal - directed decision making . Cognitive, Affective, & Behavioral Neuroscience , 8 , 418 – 428 .

Stanovich , K. E. ( 1999 ). Who is rational? Studies of individual differences in reasoning . Mahwah, NJ : Erlbaum .

Stanovich , K. E. , & West , R. F. ( 2000 ). Individual differences in reasoning: Implications for the rationality debate . Behavioral and Brain Sciences , 23 , 645 – 726 .

Steyvers , M. , Lee , M. , & Wagenmakers , E - J. ( 2009 ). A Bayesian analysis of human decision making on bandit problems . Journal of Mathematical Psychology , 53 , 168 – 179 .

Tobler , P. , O ’ Doherty , J. P. , Dolan , R. , & Schultz , W. ( 2007 ). Reward value coding distinct from risk attitude - related uncertainty coding in human reward system . Journal of Neurophysiology , 97 , 1621 – 1632 .

Tremblay , L. , & Schultz , W. ( 2000 ). Reward - related neuronal activity during go - nogo task performance in primate orbitofrontal cortex . Journal of Neurophysiology , 83 , 1864 – 1876 .

Tullock , G. ( 1971 ). Biological externalities . Journal of Theoretical Biology , 33 , 379 – 392 .

Ullsperger , M. , & von Cramon , D. Y. ( 2003 ). Error monitoring using exter-nal feedback: Specifi c roles of the habenular complex, the reward system and the cingulate motor area revealed by functional magnetic resonance imaging . Journal of Neuroscience , 23 , 4308 – 4314 .

Uttal , W. R. ( 2001 ). The new phrenology: The limits of localizing cognitive proc-esses in the brain . Cambridge, MA : MIT Press .

Page 42: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

314

Vromen , J. ( 2007 ). Neuroeconomics as a natural extension of bioeconomics: The shifting scope of standard economic theory . Journal of Bioeconomics , 9 , 145 – 167 .

Walton , M. E. , Devlin , J. T. , & Rushworth , M. F. ( 2004 ). Interactions between decision making and performance monitoring within prefrontal cortex . Nature Neuroscience , 3 , 502 – 508 .

Watanabe , M. ( 1996 ). Reward expectancy in primate prefrontal neurons . Nature , 382 , 629 – 632 .

Watanabe , M. ( 2007 ). Role of anticipated reward in cognitive behavioral control . Current Opinion in Neurobiology , 17 , 213 – 279 .

Watanabe , M. , Hikosaka , K. , Sakagami , M. , & Shirakawa , S. ( 2002 ). Coding and monitoring of motivational context in the primate prefrontal cortex . Journal of Neuroscience , 22 , 2391 – 2400 .

Watanabe , M. , Hikosaka , K. , Sakagami , M. , & Shirakawa , S. ( 2005 ). Functional signifi cance of delay - period activity of primate prefrontal neurons in relation to spatial working memory and reward/omission - of reward expectancy . Experimental Brain Research , 166 , 263 – 276 .

Winter , S. , Dieckmann , M. , & Schwabe , K. ( 2009 ). Dopamine in the pre-frontal cortex regulates rats ’ behavioral fl exibility to changing reward value . Behavioral Brain Research , 198 , 206 – 213 .

Yu , A. ( 2007 ). Adaptive behavior: Humans act as Bayesian learners . Current Biology , 17 , 977 – 980 .

Yu , A. , & Dayan , P. ( 2005 ). Uncertainty, neuromodulation and attention . Neuron , 46 , 681 – 692 .

Chapter 9

Abbeel , P. , Quigley , M. , & Ng , A. Y. ( 2006 ). Using INAC curate models in reinforcement learning. Paper presented at the International Conference on Machine Learning (ICML), Pittsburgh, PA.

Agirre - Basurko , E. , Ibarra - Berastegi , G. , & Madariaga , I. ( 2006 ). Regression and multilayer Perceptron - based models to forecast hourly O3 and NO2 levels in the Bilbao area . Environmental Modelling Software , 21 , 430 – 446 .

Ashby , W. ( 1947 ). Principles of the self - organizing dynamic system . Journal of General Psychology , 37 , 125 – 128 .

Barto , A. G. ( 1994 ). Reinforcement learning control . Current Opinion in Neurobiology , 4 , 888 – 893 .

Page 43: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

315

References

Barto , A. G. , & Mahadevan , S. ( 2003 ). Recent advances in hierarchical reinforcement learning . Discrete Event Dynamic Systems - Theory and Applications , 13 , 41 – 77 .

Castanon , L. E. G. , Oritz , R. J. C. , Morales - Menendez , R. , & Ramirez , R. ( 2005 ). A fault detection approach based on machine learning models . MICAI 2005: Advances in Artifi cial Intelligence , 3789 , 583 – 592 .

Chau , K. W. ( 2006 ). Particle swarm optimization training algorithm for ANNs in stage prediction of Shing Mun River . Journal of Hydrology , 329 , 363 – 367 .

Chen , S. , Jakeman , A. , & Norton , J. ( 2008 ). Artifi cial intelligence techniques: An introduction to their use for modeling environmental systems . Mathematics and Computers in Simulation , 78 , 379 – 400 .

Dayan , P. , & Daw , N. ( 2008 ). Connections between computational and neurobiological perspectives on decision making . Cognitive, Affective, & Behavioural Neuroscience , 8 , 429 – 453 .

Griffi ths , T. , & Tenenbaum , K. B. ( 2005 ). Structure and strength in causal induction . Cognitive Psychology , 51 , 334 – 384 .

Hooker , C. A. , Penfold , H. B. , & Evans , R. J. ( 1992 ). Control, connectionism and cognition: Towards a new regulatory paradigm . British Journal for the Philosophy of Science , 43 , 517 – 536 .

Jain , A. K. , Mao , J. , & Mohiuddin , K. ( 1996 ). Artifi cial neural networks: A tutorial . IEEE Computation , 29 , 31 – 44 .

Kaelbling , L. , Littman , M. , & Moore , A. ( 1996 ). Reinforcement learning: A survey . Journal in Artifi cial Intelligence Research , 4 , 237 – 285 .

Kim , G. , & Barros , A. P. ( 2001 ). Quantitative fl ood forecasting using multi-sensor data and neural networks . Journal of Hydrology , 246 , 5 – 62 .

Konidaris , G. , & Barto , A. G. ( 2006 ). An adaptive robot motivational system . Proceedings of the 9th International Conference on Simulation of Adaptive Behaviour, Italian National Research Council, Rome, Italy, from Animals to Animats 9 , 4095 , 346 – 356 .

Linsker , R. ( 2008 ). Neural network learning of optimal Kalman prediction and control . Neural Networks , 21 , 1328 – 1343 .

Malikopoulos , A. , Papalmbros , P. , & Assanis , D. ( 2009 ). A real - time com-putational learning model for sequential decision - making problems under uncertainty . Journal of Dynamic Systems, Measurement, and Control , 131 , 041010 .

McKenzie , C. R. M. ( 2003 ). Rational models as theories – not standards – of behaviour . Trends in Cognitive Science , 7 , 403 – 406 .

Page 44: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

References

316

McKenzie , C. R. M. , & Mikkelsen , L. A. ( 2006 ). A Bayesian view of covaria-tion assessment . Cognitive Psychology , 54 , 33 – 61 .

Nelson , J. D. ( 2005 ). Finding useful questions: On Bayesian diagnosticity, probability, impact, and information gain . Psychological Review , 112 , 979 – 999 .

Onkal - Engin , G. , Demir , I. , & Engin , S. N. ( 2005 ). Determination of the relationship between sewage odour and BOD by neural networks . Environmental Modelling Software , 20 , 843 – 850 .

Osman , M. ( 2008 ). Evidence for positive transfer and negative transfer/anti - learning of problem solving skills . Journal of Experimental Psychology: General , 137 , 97 – 115 .

Osman , M. ( 2010 ). Controlling uncertainty: A review of human behavior in complex dynamic environments . Psychological Bulletin , 136 , 65 – 86 .

Santiago Barros , M. S. , & Rodrigues , V. ( 1994 ). Nonlinear aspects of data integration for land - cover classifi cation in a neural network environ-ment . Advances in Space Research , 14 , 265 – 268 .

Sheridan , T. B. ( 2000 ). Function allocation: Algorithm, alchemy or apos-tasy? International Journal of Human - Computer Studies , 52 , 203 – 216 .

Sheridan , T. B. ( 2002 ). Humans and automation: Systems design and research issues . New York : Wiley .

Sheridan , T. B. , & Parasuraman , R. ( 2006 ). Human - automation interaction . In R. Nickerson (Ed.), Proceedings of the Human Factors and Ergonomics Society 46th annual meeting . Santa Monica, CA : Human Factors and Ergonomics Society .

Sloman , A. ( 1993 ). The mind as a control system . In C. Hookway & D. Peterson (Eds.), Philosophy and the cognitive sciences (pp. 69 – 110 ). Cambridge : Cambridge University Press .

Sloman , A. ( 1994 ). Semantics in an intelligent control system . Philosophical Trans-actions of the Royal Society: Physical Sciences and Engineering , 349 , 43 – 58 .

Sloman , A. ( 1999 ). What sort of architecture is required for a human - like agent? In M. Wooldridge & A. Rao (Eds.), Foundations of rational agency (pp. 35 – 52 ). Dordrecht : Kluwer Academic .

Sloman , A. ( 2008 ). The well - designed young mathematician . AIJ , 172 , 2015 – 2034 .

Sutton , R. S. , & Barto , A. G. ( 1998 ). Reinforcement learning: An introduction . Cambridge, MA : MIT Press .

Tenenbaum , J. B. , Griffi ths , T. L. , & Kemp , C. ( 2006 ). Theory - based Bayesian models for inductive learning and reasoning . Trends in Cognitive Sciences , 10 , 309 – 318 .

Page 45: Controlling Uncertainty (Decision Making and Learning in Complex Worlds) || References

317

References

Vellido , A. , Marti , E. , Comas , J. , Rodriguez - Roda , I. , & Sabater , F. ( 2007 ). Exploring the ecological status of human altered streams through generative topographic mapping . Environmental Modelling Software , 22 , 1053 – 1065 .

Vromen , J. ( 2007 ). Neuroeconomics as a natural extension of bioeconomics: The shifting scope of standard economic theory . Journal of Bioeconomics , 9 , 145 – 167 .

Watkins , J. C. H. , & Dayan , P. ( 1992 ). Q - learning . Machine Learning , 8 , 55 – 68 .

Wiener , N. ( 1948 ). Cybernetics: Or control and communication in the animal and the machine . New York : Wiley .

W ö rg ö tter , F. , & Porr , B. ( 2005 ). Temporal sequence learning, prediction, and control: A review of different models and their relation to biologi-cal mechanisms . Neural Computation , 17 , 245 – 319 .

Zhang , Q. , & Stanley , S. J. ( 1997 ). Forecasting raw - water quality parameters for the North Saskatchewan River by neural network modeling . Water Research , 31 , 2340 – 2350 .