H. Simon, Models of bounded rationality: empirically grounded economic reason, 1997.

J. Cohen, S. Mcclure, and A. Yu, Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration, Philosophical Transactions of the Royal Society B: Biological Sciences, vol.46, issue.4, pp.933-942, 2007.
DOI : 10.1037/0033-295X.111.4.939

P. Glimcher, C. Camerer, E. Fehr, and R. Poldrack, Neuroeconomics, Scholarpedia, vol.3, issue.10, 2009.
DOI : 10.4249/scholarpedia.1759

H. Harlow, The formation of learning sets., Psychological Review, vol.56, issue.1, pp.51-65, 1949.
DOI : 10.1037/h0062474

R. Rogers and S. Monsell, Costs of a predictible switch between simple cognitive tasks., Journal of Experimental Psychology: General, vol.124, issue.2, pp.207-231, 1995.
DOI : 10.1037/0096-3445.124.2.207

E. Koechlin and C. Summerfield, An information theoretical approach to prefrontal executive function, Trends in Cognitive Sciences, vol.11, issue.6, pp.229-235, 2007.
DOI : 10.1016/j.tics.2007.04.005

K. Sakai, Task Set and Prefrontal Cortex, Annual Review of Neuroscience, vol.31, issue.1, pp.219-245, 2008.
DOI : 10.1146/annurev.neuro.31.060407.125642

D. Badre, A. Kayser, D. Esposito, and M. , Frontal Cortex and the Discovery of Abstract Action Rules, Neuron, vol.66, issue.2, pp.315-326, 2010.
DOI : 10.1016/j.neuron.2010.03.025

R. Sutton and A. Barto, Reinforcement learning, 1998.
DOI : 10.1007/978-1-4615-3618-5
URL : https://hal.archives-ouvertes.fr/hal-00764281

O. Doherty, J. Dayan, P. Schultz, J. Deichmann, R. Friston et al., Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning, Science, vol.304, issue.5669, pp.452-454, 2004.
DOI : 10.1126/science.1094285

A. Yu and P. Dayan, Uncertainty, Neuromodulation, and Attention, Neuron, vol.46, issue.4, pp.681-692, 2005.
DOI : 10.1016/j.neuron.2005.04.026

T. Behrens, M. Woolrich, M. Walton, and M. Rushworth, Learning the value of information in an uncertain world, Nature Neuroscience, vol.1104, issue.9, pp.1214-1221, 2007.
DOI : 10.1038/nn1954

K. Doya, Metalearning and neuromodulation, Neural Networks, vol.15, issue.4-6, pp.495-506, 2002.
DOI : 10.1016/S0893-6080(02)00044-8

K. Doya, K. Samejima, K. Katagiri, and M. Kawato, Multiple Model-Based Reinforcement Learning, Neural Computation, vol.3, issue.6, pp.1347-1369, 2002.
DOI : 10.1016/S1364-6613(98)01221-2

K. Samejima and K. Doya, Multiple Representations of Belief States and Action Values in Corticobasal Ganglia Loops, Annals of the New York Academy of Sciences, vol.20, issue.1, pp.213-228, 2007.
DOI : 10.1038/nrn1884

S. Gershman, D. Blei, and Y. Niv, Context, learning, and extinction., Psychological Review, vol.117, issue.1, pp.1997-1209, 2010.
DOI : 10.1037/a0017808

F. Doshi-velez, The infinite partially observable markov decision process, Adv Neural Inf Process Syst, vol.21, pp.477-485, 2009.

Y. Teh, M. Jordan, M. Beal, and D. Blei, Hierarchical Dirichlet Processes, Journal of the American Statistical Association, vol.101, issue.476, pp.1566-1581, 2006.
DOI : 10.1198/016214506000000302

N. Daw and A. Courville, The pigeon as particle filter, Adv Neural Inf Process Syst, vol.20, 2007.

N. Cowan, Working-memory capacity limits in a theoretical context, Human learning and memory: advances in theory and applications Erlbaum, pp.155-175, 2005.

S. Risse and K. Oberauer, Selection of objects and tasks in working memory, The Quarterly Journal of Experimental Psychology, vol.52, issue.4, pp.784-804, 2010.
DOI : 10.1016/S0010-0285(02)00520-0

K. Oberauer, Declarative and Procedural Working Memory: Common Principles, Common Capacity Limits?, Psychologica Belgica, vol.50, issue.3-4, pp.277-308, 2010.
DOI : 10.5334/pb-50-3-4-277

N. Burgess and G. Hitch, Computational models of working memory: putting long-term memory into context, Trends in Cognitive Sciences, vol.9, issue.11, pp.535-541, 2005.
DOI : 10.1016/j.tics.2005.09.011

B. Milner, Effects of Different Brain Lesions on Card Sorting, Archives of Neurology, vol.9, issue.1, pp.90-100, 1963.
DOI : 10.1001/archneur.1963.00460070100010

S. Konishi, K. Nakajima, I. Uchida, M. Kameyama, and K. Nakahara, Transient activation of inferior prefrontal cortex during cognitive set shifting, Nature Neuroscience, vol.1, issue.1, pp.80-84, 1998.
DOI : 10.1038/283

N. Daw, O. Doherty, J. Dayan, P. Seymour, B. Dolan et al., Cortical substrates for exploratory decisions in humans, Nature, vol.15, issue.7095, pp.876-879, 2006.
DOI : 10.1038/nature04766

J. Dreher and K. Berman, Fractionating the neural substrate of cognitive control processes, Proceedings of the National Academy of Sciences, vol.99, issue.22, pp.14595-14600, 2002.
DOI : 10.1073/pnas.222193299

A. Hyafil, C. Summerfield, and E. Koechlin, Two Mechanisms for Task Switching in the Prefrontal Cortex, Journal of Neuroscience, vol.29, issue.16, pp.5135-5142, 2009.
DOI : 10.1523/JNEUROSCI.2828-08.2009

R. Rescorla and A. Wagner, A theory of pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement, Classical conditioning II Appleton-Century- Crofts, pp.64-99, 1972.

E. Jaynes, Information Theory and Statistical Mechanics, Physical Review, vol.106, issue.4, pp.620-630, 1957.
DOI : 10.1103/PhysRev.106.620

N. Cowan, W. Sossin, J. Lacaille, and V. Castelluci, Chapter 20 What are the differences between long-term, short-term, and working memory?, Progress in brain research Elsevier, pp.323-338, 2008.
DOI : 10.1016/S0079-6123(07)00020-9

T. Ricker, N. Cowan, and C. Morey, Working memory, Wiley Interdisciplinary Reviews: Cognitive Science, vol.12, pp.573-585, 2010.
DOI : 10.1002/wcs.50

M. Nassar, R. Wilson, B. Heasly, and J. Gold, An Approximately Bayesian Delta-Rule Model Explains the Dynamics of Belief Updating in a Changing Environment, Journal of Neuroscience, vol.30, issue.37, pp.12366-12378, 2010.
DOI : 10.1523/JNEUROSCI.0822-10.2010

C. Mathys, J. Daunizeau, K. Friston, and K. Stephan, A Bayesian foundation for individual learning under uncertainty, Frontiers in Human Neuroscience, vol.5, p.39, 2011.
DOI : 10.3389/fnhum.2011.00039

T. Braver, M. Cole, and T. Yarkoni, Vive les differences! Individual variation in neural mechanisms of executive control, Current Opinion in Neurobiology, vol.20, issue.2, pp.242-250, 2010.
DOI : 10.1016/j.conb.2010.03.002

E. Mercado, Neural and cognitive plasticity: From maps to minds., Psychological Bulletin, vol.134, issue.1, pp.109-137, 2008.
DOI : 10.1037/0033-2909.134.1.109

C. Gallistel, S. Fairhurst, and P. Balsam, The learning curve: Implications of a quantitative analysis, Proceedings of the National Academy of Sciences, vol.101, issue.36, pp.13124-13131, 2004.
DOI : 10.1073/pnas.0404965101

S. Charron and E. Koechlin, Divided Representation of Concurrent Goals in the Human Frontal Lobes, Science, vol.328, issue.5976, pp.360-363, 2010.
DOI : 10.1126/science.1183614

M. Frank, B. Doll, J. Oas-terpstra, and F. Moreno, Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation, Nature Neuroscience, vol.23, issue.8, pp.1062-1068, 2009.
DOI : 10.1093/nar/29.17.e88

B. Balleine and A. Dickinson, Goal-directed instrumental action: contingency and incentive learning and their cortical substrates, Neuropharmacology, vol.37, issue.4-5, pp.407-419, 1998.
DOI : 10.1016/S0028-3908(98)00033-1

N. Daw, Y. Niv, and P. Dayan, Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control, Nature Neuroscience, vol.58, issue.12, pp.1704-1711, 2005.
DOI : 10.1038/nn1560

L. Corbit and B. Balleine, The role of prelimbic cortex in instrumental conditioning, Behavioural Brain Research, vol.146, issue.1-2, pp.145-157, 2003.
DOI : 10.1016/j.bbr.2003.09.023

P. Holland, Relations Between Pavlovian-Instrumental Transfer and Reinforcer Devaluation., Journal of Experimental Psychology: Animal Behavior Processes, vol.30, issue.2, pp.104-117, 2004.
DOI : 10.1037/0097-7403.30.2.104

E. Koechlin, C. Ody, and F. Kouneiher, The Architecture of Cognitive Control in the Human Prefrontal Cortex, Science, vol.302, issue.5648, pp.1181-1185, 2003.
DOI : 10.1126/science.1088545

E. Boorman, T. Behrens, M. Woolrich, and M. Rushworth, How Green Is the Grass on the Other Side? Frontopolar Cortex and the Evidence in Favor of Alternative Courses of Action, Neuron, vol.62, issue.5, pp.733-743, 2009.
DOI : 10.1016/j.neuron.2009.05.014

M. Rushworth and T. Behrens, Choice, uncertainty and value in prefrontal and cingulate cortex, Nature Neuroscience, vol.9, issue.4, pp.389-397, 2008.
DOI : 10.1038/nn2066

O. Doherty and J. , Lights, Camembert, Action! The Role of Human Orbitofrontal Cortex in Encoding Stimuli, Rewards, and Choices, Annals of the New York Academy of Sciences, vol.1121, issue.1, pp.254-272, 2007.
DOI : 10.1196/annals.1401.036

E. Koechlin, A. Danek, Y. Burnod, and J. Grafman, Medial Prefrontal and Subcortical Mechanisms Underlying the Acquisition of Motor and Cognitive Action Sequences in Humans, Neuron, vol.35, issue.2, pp.371-381, 2002.
DOI : 10.1016/S0896-6273(02)00742-0

W. Alexander and J. Brown, Computational Models of Performance Monitoring and Cognitive Control, Topics in Cognitive Sciences, pp.1-20, 2010.
DOI : 10.1111/j.1756-8765.2010.01085.x

E. Koechlin and A. Hyafil, Anterior Prefrontal Function and the Limits of Human Decision-Making, Science, vol.318, issue.5850, pp.594-598, 2007.
DOI : 10.1126/science.1142995

E. Koechlin, G. Basso, P. Pietrini, S. Panzer, and J. Grafman, The role of the anterior prefrontal cortex in human cognition, Nature, vol.399, pp.148-151, 1999.

P. Fletcher and R. Henson, Frontal lobes and human memory: Insights from functional neuroimaging, Brain, vol.124, issue.5, pp.849-881, 2001.
DOI : 10.1093/brain/124.5.849

K. Sakai, O. Hikosaka, S. Miyauchi, R. Takino, and Y. Sasaki, Transition of brain activation from frontal to parietal areas in visuomotor sequence learning, J Neurosci, vol.18, pp.1827-1840, 1998.

E. Boorman, T. Behrens, and M. Rushworth, Counterfactual Choice and Learning in a Neural Network Centered on Human Lateral Frontopolar Cortex, PLoS Biology, vol.21, issue.6, 2011.
DOI : 10.1371/journal.pbio.1001093.s007

J. Glascher, D. Rudrauf, R. Colom, L. Paul, and D. Tranel, Distributed neural system for general intelligence revealed by lesion mapping, Proceedings of the National Academy of Sciences, vol.107, issue.10, pp.4705-4709, 2010.
DOI : 10.1073/pnas.0910397107

A. Dietrich, The cognitive neuroscience of creativity, Psychonomic Bulletin & Review, vol.110, issue.6, pp.1011-1026, 2004.
DOI : 10.3758/BF03196731

D. Zabelina and M. Robinson, Creativity as flexible cognitive control., Psychology of Aesthetics, Creativity, and the Arts, vol.4, issue.3, pp.136-143, 2010.
DOI : 10.1037/a0017379

G. Wiggins, A preliminary framework for description, analysis and comparison of creative systems, Knowledge-Based Systems, vol.19, issue.7, pp.449-458, 2006.
DOI : 10.1016/j.knosys.2006.04.009

M. Boden, The creative mind: myths and mechanisms Weidenfeld, 1990.