V. Skvortsova, S. Palminteri, and M. Pessiglione, Learning To Minimize Efforts versus Maximizing Rewards: Computational Principles and Neural Correlates, J Neurosci, vol.34, pp.15621-15630, 2014.

I. T. Kurniawan, B. Seymour, D. Talmi, W. Yoshida, N. Chater et al., Choosing to Make an Effort: The Role of Striatum in Signaling Physical Effort of a Chosen Action, J Neurophysiol, vol.104, pp.313-321, 2010.

E. Vassena, M. Silvetti, C. N. Boehler, E. Achten, W. Fias et al., Overlapping Neural Systems Represent Cognitive Effort and Reward Anticipation, PLoS ONE, vol.9, 2014.

M. Apps, L. L. Grima, S. Manohar, and M. Husain, The role of cognitive effort in subjective reward devaluation and risky decision-making, Sci Rep, vol.5, p.16880, 2015.

M. M. Botvinick, S. Huffstetler, and J. T. Mcguire, Effort discounting in human nucleus accumbens, Cogn Affect Behav Neurosci, vol.9, pp.16-27, 2009.

I. T. Kurniawan, M. Guitart-masip, P. Dayan, and R. J. Dolan, Effort and Valuation in the Brain: The Effects of Anticipation and Execution, J Neurosci, vol.33, pp.4777-4789, 2013.

W. H. Alexander and J. W. Brown, Computational Models of Performance Monitoring and Cognitive Control, Top Cogn Sci, vol.2, p.21359126, 2010.

M. M. Botvinick, Conflict monitoring and decision making: Reconciling two perspectives on anterior cingulate function, Cogn Affect Behav Neurosci, vol.7, pp.356-366, 2007.

M. Eimer and F. Schlaghecken, Response facilitation and inhibition in subliminal priming, Biol Psychol, vol.64, pp.7-26, 2003.

P. Klein, C. Petitjean, E. Olivier, and J. Duque, Top-down suppression of incompatible motor activations during response selection under conflict, NeuroImage, vol.86, pp.138-149, 2014.

C. Janssens, D. Loof, E. Boehler, C. N. Pourtois, G. Verguts et al., Occipital alpha power reveals fast attentional inhibition of incongruent distractors, Psychophysiology, 2017.

S. Scherbaum, R. Fischer, M. Dshemuchadse, and T. Goschke, The dynamics of cognitive control: Evidence for within-trial conflict adaptation from frequency-tagged EEG, Psychophysiology, vol.48, p.21044093, 2011.

B. Aben, T. Verguts, and E. Van-den-bussche, Beyond trial-by-trial adaptation: A quantification of the time scale of cognitive control, J Exp Psychol Hum Percept Perform, vol.43, pp.509-517, 2017.

T. Egner, Congruency sequence effects and cognitive control, Cogn Affect Behav Neurosci, vol.7, pp.380-390, 2007.

G. Gratton, M. G. Coles, and E. Donchin, Optimizing the use of information: strategic control of activation of responses, J Exp Psychol Gen, vol.121, pp.480-506, 1992.

T. S. Braver, The variable nature of cognitive control: a dual mechanisms framework, Trends Cogn Sci, vol.16, pp.106-113, 2012.

M. M. Botvinick and T. Braver, Motivation and Cognitive Control: From Behavior to Neural Mechanism, Annu Rev Psychol, vol.66, pp.83-113, 2015.

S. Braem, J. A. King, F. M. Korb, R. M. Krebs, W. Notebaert et al., The Role of Anterior Cingulate Cortex in the Affective Evaluation of Conflict, J Cogn Neurosci, vol.29, pp.137-149, 2016.

G. Dreisbach and R. Fischer, Conflicts as aversive signals, Brain Cogn, vol.78, pp.94-98, 2012.

W. Kool, J. T. Mcguire, Z. B. Rosen, and M. M. Botvinick, Decision Making and the Avoidance of Cognitive Demand, J Exp Psychol Gen, vol.139, pp.665-682, 2010.

D. Dignath, A. Kiesel, and A. B. Eder, Flexible conflict management: Conflict avoidance and conflict adjustment in reactive cognitive control, J Exp Psychol Learn Mem Cogn, vol.41, pp.975-988, 2015.

N. Schouppe, J. Demanet, C. N. Boehler, K. R. Ridderinkhof, and W. Notebaert, The Role of the Striatum in Effort-Based Decision-Making in the Absence of Reward, J Neurosci, vol.34, pp.2148-2154, 2014.

N. Schouppe, K. R. Ridderinkhof, T. Verguts, and W. Notebaert, Context-specific control and context selection in conflict tasks, Acta Psychol (Amst), vol.146, pp.63-66, 2014.

K. Desender, B. Calderon, C. Van-opstal, F. Van-den-bussche, and E. , Avoiding the conflict: Metacognitive awareness drives the selection of low-demand contexts, J Exp Psychol Hum Percept Perform, vol.43, pp.1397-1410, 2017.

J. A. Olson, A. A. Amlani, A. Raz, and R. A. Rensink, Influencing choice without awareness, Conscious Cogn, 2015.

N. Sidarus and P. Haggard, Difficult action decisions reduce the sense of agency: A study using the Eriksen flanker task, Acta Psychol (Amst), vol.166, pp.1-11, 2016.

A. Kiesel, A. Wagener, W. Kunde, J. Hoffmann, and A. J. Fallgatter, Stö cker C. Unconscious manipulation of free choice in humans, Conscious Cogn, vol.15, pp.397-408, 2006.

S. T. Klapp and L. B. Hinkley, The negative compatibility effect: Unconscious inhibition influences reaction time and response selection, J Exp Psychol Gen, vol.131, pp.255-269, 2002.

P. A. O'connor and W. T. Neill, Does subliminal priming of free response choices depend on task set or automatic response activation?, Conscious Cogn, vol.20, pp.280-287, 2011.

F. Schlaghecken and M. Eimer, Masked prime stimuli can bias "free" choices between response alternatives, Psychon Bull Rev, vol.11, pp.463-468, 2004.

N. Sidarus, M. Vuorre, and P. Haggard, How action selection influences the sense of agency: An ERP study, NeuroImage, vol.150, pp.1-13, 2017.

M. Teuchies, J. Demanet, N. Sidarus, P. Haggard, M. A. Stevens et al., Influences of unconscious priming on voluntary actions: Role of the rostral cingulate zone, NeuroImage, vol.135, pp.243-252, 2016.

M. Voss, V. Chambon, D. Wenke, S. Kü-hn, and P. Haggard, In and out of control: brain mechanisms linking fluency of action selection to self-agency in patients with schizophrenia, Brain, vol.140, pp.2226-2239, 2017.

M. Brass, M. T. Lynn, J. Demanet, and D. Rigoni, Imaging volition: what the brain can tell us about the will, Exp Brain Res, p.23515626, 2013.

M. M. Botvinick, J. D. Cohen, and C. S. Carter, Conflict monitoring and anterior cingulate cortex: an update, Trends Cogn Sci, vol.8, pp.539-546, 2004.

M. Silvetti, W. Alexander, T. Verguts, and J. W. Brown, From conflict management to reward-based decision making: Actors and critics in primate medial frontal cortex, Neurosci Biobehav Rev, vol.46, pp.44-57, 2014.

J. F. Cavanagh, A. J. Bismark, M. J. Frank, and J. Allen, Larger Error Signals in Major Depression are Associated with Better Avoidance Learning, Front Psychol, vol.2, 2011.

J. F. Cavanagh, T. V. Wiecki, M. X. Cohen, C. M. Figueroa, J. Samanta et al., Subthalamic nucleus stimulation reverses mediofrontal influence over decision threshold, Nat Neurosci, vol.14, pp.1462-1467, 2011.

J. F. Cavanagh, T. V. Wiecki, A. Kochar, and M. J. Frank, Eye Tracking and Pupillometry are Indicators of Dissociable Latent Decision Processes, J Exp Psychol Gen, vol.143, pp.1476-1488, 2014.

M. J. Frank, Hold your horses: A dynamic computational role for the subthalamic nucleus in decision making, Neural Netw, vol.19, pp.1120-1136, 2006.

M. J. Frank, C. Gagne, E. Nyhus, S. Masters, T. V. Wiecki et al., fMRI and EEG Predictors of Dynamic Decision Parameters during Human Reinforcement Learning, J Neurosci, vol.35, pp.485-494, 2015.

M. J. Frank, B. S. Woroch, and T. Curran, Error-Related Negativity Predicts Reinforcement Learning and Conflict Biases, Neuron, vol.47, pp.495-501, 2005.

A. Shenhav, M. M. Botvinick, and J. D. Cohen, The Expected Value of Control: An Integrative Theory of Anterior Cingulate Cortex Function, Neuron, vol.79, pp.217-240, 2013.

C. B. Holroyd and S. M. Mcclure, Hierarchical control over effortful behavior by rodent medial frontal cortex: A computational model, Psychol Rev, vol.122, pp.54-83, 2015.

T. Verguts, E. Vassena, and M. Silvetti, Adaptive effort investment in cognitive and physical tasks: a neurocomputational model, Front Behav Neurosci, vol.9, 2015.

A. Westbrook and M. Frank, Dopamine and proximity in motivation and cognitive control, Curr Opin Behav Sci, vol.22, pp.28-34, 2018.

M. C. Klein-flügge, S. W. Kennerley, K. Friston, and S. Bestmann, Neural Signatures of Value Comparison in Human Cingulate Cortex during Decisions Requiring an Effort-Reward Trade-off, J Neurosci, vol.36, pp.10002-10015, 2016.

W. H. Alexander and J. W. Brown, The Role of the Anterior Cingulate Cortex in Prediction Error and Signaling Surprise, Top Cogn Sci, pp.1-17, 2017.

J. Pinner and J. F. Cavanagh, Frontal theta accounts for individual differences in the cost of conflict on decision making, Brain Res, vol.1672, pp.73-80, 2017.

J. F. Cavanagh, S. E. Masters, K. Bath, and M. J. Frank, Conflict acts as an implicit cost in reinforcement learning, Nat Commun, vol.5, 2014.

R. D. Luce, Individual Choice Behavior: A Theoretical analysis, 1959.

D. A. Markowitz, R. A. Shewcraft, Y. T. Wong, and B. Pesaran, Competition for Visual Selection in the Oculomotor System, J Neurosci, vol.31, pp.9298-9306, 2011.

X. Chen, S. Mihalas, E. Niebur, and V. Stuphorn, Mechanisms underlying the influence of saliency on valuebased decisions, J Vis, vol.13, pp.18-18, 2013.

V. Li, E. Michael, J. Balaguer, S. H. Castañón, and C. Summerfield, Gain control explains the effect of distraction in human perceptual, cognitive, and economic decision making, Proc Natl Acad Sci, vol.115, pp.8825-8834, 2018.

S. Itthipuripat, K. Cha, N. Rangsipat, and J. T. Serences, Value-based attentional capture influences contextdependent decision-making, J Neurophysiol, vol.114, pp.560-569, 2015.

S. S. Iyengar and M. R. Lepper, When choice is demotivating: Can one desire too much of a good thing, J Pers Soc Psychol, vol.79, pp.995-1006, 2000.

L. A. Leotti, S. S. Iyengar, and K. N. Ochsner, Born to choose: the origins and value of the need for control, Trends Cogn Sci, vol.14, pp.457-463, 2010.

S. Lau, A. Hiemisch, and R. F. Baumeister, The experience of freedom in decisions-Questioning philosophical beliefs in favor of psychological determinants, Conscious Cogn, vol.33, pp.30-46, 2015.

J. Fritz and G. Dreisbach, Conflicts as aversive signals: Conflict priming increases negative judgments for neutral stimuli, Cogn Affect Behav Neurosci, vol.13, p.23307475, 2013.

J. Fritz and G. Dreisbach, The Time Course of the Aversive Conflict Signal, Exp Psychol, vol.62, pp.30-39, 2015.

D. Wenke, S. M. Fleming, and P. Haggard, Subliminal priming of actions influences sense of control over effects of action, Cognition, vol.115, pp.26-38, 2010.

V. Chambon, N. Sidarus, and P. Haggard, From action intentions to action effects: how does the sense of agency come about?, Front Hum Neurosci, vol.8, issue.320, 2014.

J. R. Simon and A. P. Rudell, Auditory S-R compatibility: The effect of an irrelevant cue on information processing, J Appl Psychol, vol.51, pp.300-304, 1967.

M. Guitart-masip, Q. Huys, L. Fuentemilla, P. Dayan, E. Duzel et al., Go and no-go learning in reward and punishment: Interactions between affect and effect, NeuroImage, vol.62, pp.154-166, 2012.

J. C. Swart, M. I. Froböse, J. L. Cook, D. E. Geurts, M. J. Frank et al., Catecholaminergic challenge uncovers distinct Pavlovian and instrumental mechanisms of motivated (in)action. eLife, vol.6, p.22169, 2017.

J. C. Swart, M. J. Frank, J. I. Määttä, and O. Jensen, Cools R, den Ouden HEM . Frontal network dynamics reflect neurocomputational mechanisms for reducing maladaptive biases in motivated action, PLOS Biol, vol.16, p.2005979, 2018.

J. F. Cavanagh, I. Eisenberg, M. Guitart-masip, Q. Huys, and M. J. Frank, Frontal Theta Overrides Pavlovian Learning Biases, J Neurosci, vol.33, pp.8541-8548, 2013.

J. F. Cavanagh and M. J. Frank, Frontal theta as a mechanism for cognitive control, Trends Cogn Sci, vol.18, pp.414-421, 2014.

R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, 1998.

C. Watkins, P. Dayan, and . Q-learning, Mach Learn, vol.8, pp.279-292, 1992.

S. Palminteri, V. Wyart, and E. Koechlin, The Importance of Falsification in Computational Cognitive Modeling, Trends Cogn Sci, 2017.

W. Kool and M. Botvinick, The intrinsic cost of cognitive control, Behav Brain Sci, vol.36, pp.697-698, 2013.

M. J. Mulder, L. Van-maanen, and B. U. Forstmann, Perceptual decision neurosciences-A model-based review, Neuroscience, vol.277, pp.872-884, 2014.

R. Ratcliff, P. L. Smith, S. D. Brown, and G. Mckoon, Diffusion Decision Model: Current Issues and History, Trends Cogn Sci, vol.20, pp.260-281, 2016.

T. D. Hanks, M. E. Mazurek, R. Kiani, E. Hopp, and M. N. Shadlen, Elapsed Decision Time Affects the Weighting of Prior Probability in a Perceptual Decision Task, J Neurosci, vol.31, pp.6339-6352, 2011.

J. O'doherty, P. Dayan, J. Schultz, R. Deichmann, K. Friston et al., Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning, Science, vol.304, pp.452-454, 2004.

W. Kool, S. J. Getz, and M. M. Botvinick, Neural Representation of Reward Probability: Evidence from the Illusion of Control, J Cogn Neurosci, vol.25, pp.852-861, 2013.

L. A. Leotti and M. R. Delgado, The Inherent Reward of Choice, Psychol Sci, vol.22, pp.1310-1318, 2011.

E. J. Langer, The illusion of control, J Pers Soc Psychol, vol.32, pp.311-328, 1975.

G. Lefebvre, M. Lebreton, F. Meyniel, S. Bourgeois-gironde, and S. Palminteri, Behavioural and neural characterization of optimistic reinforcement learning, Nat Hum Behav, vol.1, p.67, 2017.

T. Sharot, The optimism bias, Curr Biol, vol.21, pp.941-945, 2011.

N. Kornell and J. Metcalfe, Study efficacy and the region of proximal learning framework, J Exp Psychol Learn Mem Cogn, vol.32, pp.609-622, 2006.

V. P. Murty, S. Dubrow, and L. Davachi, The Simple Act of Choosing Influences Declarative Memory, J Neurosci, vol.35, pp.6255-6264, 2015.

T. M. Gureckis and D. B. Markant, Self-Directed Learning: A Cognitive and Computational Perspective. Perspect, Psychol Sci, vol.7, pp.464-481, 2012.

C. Bellebaum, D. Jokisch, E. R. Gizewski, M. Forsting, and I. Daum, The neural coding of expected and unexpected monetary performance outcomes: Dissociations between active and observational learning, Behav Brain Res, vol.227, pp.241-251, 2012.

S. Kobza and C. Bellebaum, Processing of action-but not stimulus-related prediction errors differs between active and observational feedback learning, Neuropsychologia, vol.66, pp.75-87, 2015.

S. Palminteri, G. Lefebvre, E. J. Kilford, and S. Blakemore, Confirmation bias in human reinforcement learning: Evidence from counterfactual feedback processing, PLoS Comput Biol, vol.13, 2017.

D. H. Brainard, The Psychophysics Toolbox. Spat Vis, vol.10, pp.433-436, 1997.

M. Kleiner, D. H. Brainard, and D. G. Pelli, What's new in Psychtoolbox-3? Perception, vol.36, 2007.

D. G. Pelli, The VideoToolbox software for visual psychophysics: transforming numbers into movies, Spat Vis, vol.10, pp.437-442, 1997.

G. Schwarz, Estimating the Dimension of a Model, Ann Stat, vol.6, pp.461-464, 1978.

J. Daunizeau, V. Adam, and L. Rigoux, VBA: A Probabilistic Treatment of Nonlinear Models for Neurobiological and Behavioural Data, PLoS Comput Biol, vol.10, p.1003441, 2014.

K. E. Stephan, W. D. Penny, J. Daunizeau, R. J. Moran, and K. J. Friston, Bayesian Model Selection for Group Studies, NeuroImage, vol.46, pp.1004-1017, 2009.

N. D. Daw, S. J. Gershman, B. Seymour, P. Dayan, and R. J. Dolan, Model-Based Influences on Humans' Choices and Striatal Prediction Errors, Neuron, vol.69, pp.1204-1215, 2011.