A. J. Yu and P. Dayan, Uncertainty, neuromodulation, and attention, Neuron, vol.46, p.15944135, 2005.

T. Behrens, M. W. Woolrich, M. E. Walton, and M. Rushworth, Learning the value of information in an uncertain world, Nat Neurosci, vol.10, p.17676057, 2007.

A. J. Yu and J. D. Cohen, Sequential effects: Superstition or rational behavior?, Adv Neural Inf Process Syst, vol.21, p.26412953, 2008.

C. Mathys, J. Daunizeau, K. J. Friston, and K. E. Stephan, A bayesian foundation for individual learning under uncertainty, Front Hum Neurosci, vol.5, p.21629826, 2011.

M. R. Nassar, R. C. Wilson, B. Heasly, and J. I. Gold, An Approximately Bayesian Delta-Rule Model Explains the Dynamics of Belief Updating in a Changing Environment, J Neurosci, vol.30, p.20844132, 2010.

K. Iigaya, Adaptive learning and decision-making under uncertainty by metaplastic synapses guided by a surprise detection system, eLife, vol.5, p.27504806, 2016.

J. T. Mcguire, M. R. Nassar, J. I. Gold, and J. W. Kable, Functionally Dissociable Influences on Learning Rate in a Dynamic Environment, Neuron, vol.84, p.25459409, 2014.

F. Meyniel, D. Schlunegger, and S. Dehaene, The Sense of Confidence during Probabilistic Learning: A Normative Account, PLoS Comput Biol, vol.11, p.26076466, 2015.
URL : https://hal.archives-ouvertes.fr/inserm-02141610

E. Payzan-lenestour and B. P. Risk, Unexpected Uncertainty, and Estimation Uncertainty: Bayesian Learning in Unstable Settings, PLoS Comput Biol, vol.7, p.21283774, 2011.

S. Iglesias, C. Mathys, K. H. Brodersen, L. Kasper, M. Piccirelli et al., Hierarchical prediction errors in midbrain and basal forebrain during sensory learning, Neuron, vol.80, p.24139048, 2013.

R. P. Lawson, C. Mathys, and G. Rees, Adults with autism overestimate the volatility of the sensory environment, Nat Neurosci, vol.20, p.28758996, 2017.

A. R. Powers, C. Mathys, and P. R. Corlett, Pavlovian conditioning-induced hallucinations result from overweighting of perceptual priors, Science, vol.357, p.28798131, 2017.

H. Ritz, M. R. Nassar, M. J. Frank, and A. Shenhav, A control theoretic model of adaptive behavior in dynamic environments, 2017.

C. K. Ryali and A. J. Yu, Change-point detection without needing to detect change-points? bioRxiv, vol.077719, 2016.

R. Sutton, Gain Adaptation Beats Least Squares?, Proceedings of the 7th Yale Workshop on Adaptive and Learning Systems, pp.161-166, 1992.

V. Wyart and E. Koechlin, Choice variability and suboptimality in uncertain environments, Curr Opin Behav Sci, vol.11, pp.109-115, 2016.

A. H. Bell, C. Summerfield, E. L. Morin, N. J. Malecek, and L. G. Ungerleider, Encoding of Stimulus Probability in Macaque Inferior Temporal Cortex, Curr Biol, vol.26, p.27524483, 2016.

S. Farashahi, C. H. Donahue, P. Khorsand, H. Seo, D. Lee et al., Metaplasticity as a Neural Substrate for Adaptive Learning and Choice under Uncertainty, Neuron, vol.94, p.28426971, 2017.

R. Robert, A. , W. Allan, and R. , A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement, Classical conditioning II: Current research and theory, pp.64-99, 1972.

J. B. Tenenbaum, C. Kemp, T. L. Griffiths, and N. D. Goodman, How to grow a mind: statistics, structure, and abstraction, Science, vol.331, p.21393536, 2011.

K. Friston, Hierarchical models in the brain, PLoS Comput Biol, vol.4, p.18989391, 2008.

T. S. Lee and D. Mumford, Hierarchical Bayesian inference in the visual cortex, J Opt Soc Am A Opt Image Sci Vis, vol.20, p.12868647, 2003.

P. Khorsand and A. Soltani, Optimal structure of metaplasticity for adaptive learning, PLoS Comput Biol, vol.13, p.28658247, 2017.

F. Meyniel and S. Dehaene, Brain networks for confidence weighting and hierarchical inference during probabilistic learning, Proc Natl Acad Sci, p.28439014, 2017.

F. Vinckier, R. Gaillard, S. Palminteri, L. Rigoux, A. Salvador et al., Confidence and psychosis: a neuro-computational account of contingency learning disruption by NMDA blockade, Mol Psychiatry, vol.21, p.26055423, 2016.

C. Summerfield, T. E. Behrens, and E. Koechlin, Perceptual Classification in a Rapidly Changing Environment, Neuron, vol.71, p.21867887, 2011.

C. R. Gallistel, M. Krishan, Y. Liu, R. Miller, and P. E. Latham, The perception of probability, Psychol Rev, vol.121, p.24490790, 2014.

A. I. Jang, V. D. Costa, P. H. Rudebeck, Y. Chudasama, E. A. Murray et al., The Role of Frontal Cortical and Medial-Temporal Lobe Brain Areas in Learning a Bayesian Prior Belief on Reversals, J Neurosci Off J Soc Neurosci, vol.35, p.26290251, 2015.

F. Meyniel, M. Sigman, and Z. F. Mainen, Confidence as Bayesian Probability: From Neural Origins to Behavior, Neuron, vol.88, p.26447574, 2015.

S. Zhang, A. J. Yu, C. Burges, L. Bottou, M. Welling et al., Forgetful Bayes and myopic planning: Human learning and decision-making in a bandit setting, Advances in Neural Information Processing Systems 26, pp.2607-2615, 2013.

M. N. Shadlen and R. Kiani, Decision Making as a Window on Cognition, Neuron, vol.80, p.24183028, 2013.

F. Meyniel, M. Maheu, and S. Dehaene, Human Inferences about Sequences: A Minimal Transition Probability Model, PLoS Comput Biol, vol.12, p.28030543, 2016.
URL : https://hal.archives-ouvertes.fr/inserm-02143083

D. Dotan, F. Meyniel, and S. Dehaene, On-line confidence monitoring during decision making, Cognition, vol.171, p.29128659, 2017.

A. Kepecs and Z. F. Mainen, A computational framework for the study of confidence in humans and animals, Philos Trans R Soc B Biol Sci, vol.367, p.22492750, 2012.

A. Kepecs, N. Uchida, H. A. Zariwala, and Z. F. Mainen, Neural correlates, computation and behavioural impact of decision confidence, Nature, vol.455, p.18690210, 2008.

R. Kiani, L. Corthell, and M. N. Shadlen, Choice Certainty Is Informed by Both Evidence and Decision Time, Neuron, vol.84, p.25521381, 2014.

C. M. Glaze, J. W. Kable, and J. I. Gold, Normative evidence accumulation in unpredictable environments, eLife, vol.4, p.26322383, 2015.

J. V. Baranski and W. M. Petrusic, The calibration and resolution of confidence in perceptual judgments, Percept Psychophys, vol.55, p.8036121, 1994.

B. Maniscalco and H. Lau, A signal detection theoretic approach for estimating metacognitive sensitivity from confidence ratings, Conscious Cogn, vol.21, p.22071269, 2012.

A. Zylberberg, P. Barttfeld, and M. Sigman, The construction of confidence in a perceptual decision, Front Integr Neurosci, vol.6, p.23049504, 2012.

A. Gelman, J. B. Carlin, H. S. Stern, D. B. Dunson, A. Vehtari et al., Bayesian Data Analysis, Third Edition, 2013.

K. E. Stephan, W. D. Penny, J. Daunizeau, R. J. Moran, and K. J. Friston, Bayesian model selection for group studies, NeuroImage, vol.46, p.19306932, 2009.

S. Palminteri, V. Wyart, and E. Koechlin, The Importance of Falsification in Computational Cognitive Modeling, Trends Cogn Sci, vol.21, p.28476348, 2017.

C. Findling, V. Skvortsova, R. Dromnelle, S. Palminteri, and V. Wyart, Computational noise in reward-guided learning drives behavioral variability in volatile environments, bioRxiv, vol.439885, 2018.

S. Bouret and S. J. Sara, Network reset: a simplified overarching theory of locus coeruleus noradrenaline function, Trends Neurosci, vol.28, p.16165227, 2005.
URL : https://hal.archives-ouvertes.fr/hal-00088131

S. Nieuwenhuis, G. Aston-jones, and J. D. Cohen, Decision making, the P3, and the locus coeruleus-norepinephrine system, Psychol Bull, vol.131, p.16060800, 2005.

H. Salgado, M. Treviño, and M. Atzori, Layer-and area-specific actions of norepinephrine on cortical synaptic transmission, Brain Res, vol.1641, p.26820639, 2016.

J. Schomaker and M. Meeter, Short-and long-lasting consequences of novelty, deviance and surprise on brain and cognition, Neurosci Biobehav Rev, vol.55, p.25976634, 2015.

A. Kheifets and C. R. Gallistel, Mice take calculated risks, Proc Natl Acad Sci, vol.109, p.22592792, 2012.

A. C. Schapiro, T. T. Rogers, N. I. Cordova, N. B. Turk-browne, and M. M. Botvinick, Neural representations of events arise from temporal community structure, Nat Neurosci, vol.16, p.23416451, 2013.

A. Pouget, J. M. Beck, W. J. Ma, and P. E. Latham, Probabilistic brains: knowns and unknowns, Nat Neurosci, vol.16, p.23955561, 2013.

D. Tervo, J. B. Tenenbaum, and S. J. Gershman, Toward the neural implementation of structure learning, Curr Opin Neurobiol, vol.37, p.26874471, 2016.

J. Balaguer, H. Spiers, D. Hassabis, and C. Summerfield, Neural Mechanisms of Hierarchical Planning in a Virtual Subway Network, Neuron, vol.90, pp.893-903, 2016.

N. D. Daw, S. J. Gershman, B. Seymour, P. Dayan, and R. J. Dolan, Model-Based Influences on Humans' Choices and Striatal Prediction Errors, Neuron, vol.69, p.21435563, 2011.

Q. Huys, N. Eshel, E. O'nions, L. Sheridan, P. Dayan et al., Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees, PLoS Comput Biol, vol.8, p.22412360, 2012.

M. Keramati, P. Smittenaar, R. J. Dolan, and P. Dayan, Adaptive integration of habits into depth-limited planning defines a habitual-goal-directed spectrum, Proc Natl Acad Sci U S A, p.27791110, 2016.

K. Wunderlich, P. Dayan, and R. J. Dolan, Mapping value based planning and extensively trained choice in the human brain, Nat Neurosci, vol.15, p.22406551, 2012.

E. Koechlin, C. Ody, and F. Kouneiher, The Architecture of Cognitive Control in the Human Prefrontal Cortex, Science, vol.302, p.14615530, 2003.

B. A. Purcell and R. Kiani, Hierarchical decision processes that operate over distinct timescales underlie choice and changes in strategy, Proc Natl Acad Sci, vol.113, p.27432960, 2016.

A. Collins, J. F. Cavanagh, and M. J. Frank, Human EEG Uncovers Latent Generalizable Rule Structure during Learning, J Neurosci, vol.34, p.24672013, 2014.

A. Collins and M. J. Frank, Neural signature of hierarchically structured expectations predicts clustering and transfer of rule sets in reinforcement learning, Cognition, vol.152, p.27082659, 2016.

A. Boldt, C. Blundell, and B. D. Martino, Confidence modulates exploration and exploitation in value-based learning, vol.236026, 2017.

J. Navajas, C. Hindocha, H. Foda, M. Keramati, P. E. Latham et al., The idiosyncratic nature of confidence, Nat Hum Behav, vol.1, p.29152591, 2017.

N. Yeung and C. Summerfield, Metacognition in human decision-making: confidence and error monitoring, Philos Trans R Soc B Biol Sci, vol.367, p.22492749, 2012.