Importantly, abstract action sets spontaneously develop for controlling action selection even when their formation provides no immediate behavioral advantages 28 and 29]. Thus, lPFC activations often reported in simple choice tasks suggest that whenever possible, subjects build abstract action sets and primarily choose between these sets for subsequently selecting simple actions, especially in sequential decision tasks facilitating the formation of stable sets across trials. Abstract action sets thus Sirolimus cost comprise multiple stimulus-action and (stimulus)-action-outcome associations, which are learned and continuously adjusted online for maximizing rewards. Computational

modeling suggest that stimulus-action and (stimulus)-action-outcome associations are learned and adjusted through reinforcement and statistical learning UMI-77 research buy respectively 33• and 34], while abstract action sets emerge through probabilistic clustering processes [29]. Collectively, these

flexible representations invoked together for driving action selection while the same external situation perpetuates, constitute a consistent behavioral strategy also referred to as a task set ( Figure 1). Task sets are critical executive units for efficient adaptive behavior in everyday environments featuring external situations that often change and may reoccur periodically and where new situations may always arise. Task sets are formed and stored as mentally instantiating external situations Benzatropine for possibly exploiting them when these situations reoccur [33•]. This adaptive capacity requires continuously arbitrating between exploiting/adjusting previously learned task sets vs. exploring/creating new ones. The PFC has likely evolved to make this arbitration online [35•].

The arbitration however is a complex probabilistic reasoning problem, which optimal solution is actually computationally intractable [33•]. Accordingly, we recently proposed that the core PFC executive system comprising the ventromedial, dorsomedial, lateral and frontopolar PFC regions has primarily evolved as implementing an approximate algorithmic solution to this problem [35•]: the solution especially assumes that the executive system infers online the absolute reliability of the current task set driving ongoing behavior (i.e. the actor task set): this quantity measures the probability that given external evidence, this task set is still applicable to the situation or equivalently, that the situation remains unchanged (considering that the range of external situation is potentially infinite). The concept of absolute reliability generalizes the notion of expected/unexpected uncertainty [36] to open-ended environments and is related to the psychological notion of metacognition and confidence [37].