Optimizing motor decision-making through competition with opponents.
Ontology highlight
ABSTRACT:
SUBMITTER: Ota K
PROVIDER: S-EPMC6976621 | biostudies-literature | 2020 Jan
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:A presumption in previous work has been that sub-optimality in competitive performance following loss is the result of a reduction in decision-making time (i.e., post-error speeding). The main goal of this paper is to test the relationship between decision-making speed and quality, with the hypothesis that slowing down decision-making should increase the likelihood of successful performance in cases where a model of opponent domination can be implemented. Across Experiments 1-3, the speed and quality of competitive decision-making was examined in a zero-sum game as a function of the nature of the opponent (unexploitable, exploiting, exploitable). Performance was also examined against the nature of a credit (or token) system used as a within-experimental manipulation (no credit, fixed credit, variable credit). To compliment reaction time variation as a function of outcome, both the fixed credit and variable credit conditions were designed to slow down decision-making, relative to a no credit condition where the game could be played in quick succession and without interruption. The data confirmed that (a) self-imposed reductions in processing time following losses (post-error speeding) were causal factors in determining poorer-quality behaviour, (b) the expression of lose-shift was less flexible than the expression of win-stay, and, (c) the use of a variable credit system may enhance the perceived control participants have against exploitable opponents. Future work should seek to disentangle temporal delay and response interruption as determinants of decision-making quality against numerous styles of opponency.
| S-EPMC7859242 | biostudies-literature
Project description:Plants can plastically respond to light competition in three strategies, comprising vertical growth, which promotes competitive dominance; shade tolerance, which maximises performance under shade; or lateral growth, which offers avoidance of competition. Here, we test the hypothesis that plants can 'choose' between these responses, according to their abilities to competitively overcome their neighbours. We study this hypothesis in the clonal plant Potentilla reptans using an experimental setup that simulates both the height and density of neighbours, thus presenting plants with different light-competition scenarios. Potentilla reptans ramets exhibit the highest vertical growth under simulated short-dense neighbours, highest specific leaf area (leaf area/dry mass) under tall-dense neighbours, and tend to increase total stolon length under tall-sparse neighbours. These responses suggest shifts between 'confrontational' vertical growth, shade tolerance and lateral-avoidance, respectively, and provide evidence that plants adopt one of several alternative plastic responses in a way that optimally corresponds to prevailing light-competition scenarios.
| S-EPMC5740169 | biostudies-literature
Project description:The control of behaviour is usually understood in terms of three distinct components: sensory processing, decision making and movement control. Recently, this view has been questioned on the basis of physiological and behavioural data, blurring the distinction between these three stages. This raises the question to what extent the motor system itself can contribute to the interpretation of behavioural situations. To investigate this question we use a neural model of sensory motor integration applied to a behaving mobile robot performing a navigation task. We show that the population response of the motor system provides a substrate for the categorization of behavioural situations. This categorization allows for the assessment of the complexity of a behavioural situation and regulates whether higher-level decision making is required to resolve behavioural conflicts. Our model lends credence to an emerging reconceptualization of behavioural control where the motor system can be considered as part of a high-level perceptual system.
| S-EPMC1809980 | biostudies-literature
Project description:A fundamental problem faced by humans is learning to select motor actions based on noisy sensory information and incomplete knowledge of the world. Recently, a number of authors have asked whether this type of motor learning problem might be very similar to a range of higher-level decision-making problems. If so, participant behaviour on a high-level decision-making task could be predictive of their performance during a motor learning task. To investigate this question, we studied performance during an explorative motor learning task and a decision-making task which had a similar underlying structure with the exception that it was not subject to motor (execution) noise. We also collected an independent measurement of each participant's level of motor noise. Our analysis showed that explorative motor learning and decision-making could be modelled as the (approximately) optimal solution to a Partially Observable Markov Decision Process bounded by noisy neural information processing. The model was able to predict participant performance in motor learning by using parameters estimated from the decision-making task and the separate motor noise measurement. This suggests that explorative motor learning can be formalised as a sequential decision-making process that is adjusted for motor noise, and raises interesting questions regarding the neural origin of explorative motor learning.
| S-EPMC5421818 | biostudies-literature
Project description:Motor decision-making is an essential component of everyday life which requires weighing potential rewards and punishments against the probability of successfully executing an action. To achieve this, humans rely on two key mechanisms; a flexible, instrumental, value-dependent process and a hardwired, Pavlovian, value-independent process. In economic decision-making, age-related decline in risk taking is explained by reduced Pavlovian biases that promote action toward reward. Although healthy ageing has also been associated with decreased risk-taking in motor decision-making, it is currently unknown whether this is a result of changes in Pavlovian biases, instrumental processes or a combination of both. Using a newly established approach-avoidance computational model together with a novel app-based motor decision-making task, we measured sensitivity to reward and punishment when participants (n = 26,532) made a 'go/no-go' motor gamble based on their perceived ability to execute a complex action. We show that motor decision-making can be better explained by a model with both instrumental and Pavlovian parameters, and reveal age-related changes across punishment- and reward-based instrumental and Pavlovian processes. However, the most striking effect of ageing was a decrease in Pavlovian attraction towards rewards, which was associated with a reduction in optimality of choice behaviour. In a subset of participants who also played an independent economic decision-making task (n = 17,220), we found similar decision-making tendencies for motor and economic domains across a majority of age groups. Pavlovian biases, therefore, play an important role in not only explaining motor decision-making behaviour but also the changes which occur through normal ageing. This provides a deeper understanding of the mechanisms which shape motor decision-making across the lifespan.
| S-EPMC6051643 | biostudies-literature
Project description:It is well-established that people can factor into account the distribution of their errors in motor performance so as to optimize reward. Here we asked whether, in the context of motor learning where errors decrease across trials, people take into account their future, improved performance so as to make optimal decisions to maximize reward. One group of participants performed a virtual throwing task in which, periodically, they were given the opportunity to select from a set of smaller targets of increasing value. A second group of participants performed a reaching task under a visuomotor rotation in which, after performing a initial set of trials, they selected a reward structure (ratio of points for target hits and misses) for different exploitation horizons (i.e., numbers of trials they might be asked to perform). Because movement errors decreased exponentially across trials in both learning tasks, optimal target selection (task 1) and optimal reward structure selection (task 2) required taking into account future performance. The results from both tasks indicate that people anticipate their future motor performance so as to make decisions that will improve their expected future reward.
| S-EPMC7065812 | biostudies-literature
Project description:There is considerable evidence that human economic decision-making deviates from the predictions of expected utility theory (EUT) and that human performance conforms to EUT in many perceptual and motor decision tasks. It is possible that these results reflect a real difference in decision-making in the 2 domains but it is also possible that the observed discrepancy simply reflects typical differences in experimental design. We developed a motor task that is mathematically equivalent to choosing between lotteries and used it to compare how the same subject chose between classical economic lotteries and the same lotteries presented in equivalent motor form. In experiment 1, we found that subjects are more risk seeking in deciding between motor lotteries. In experiment 2, we used cumulative prospect theory to model choice and separately estimated the probability weighting functions and the value functions for each subject carrying out each task. We found no patterned differences in how subjects represented outcome value in the motor and the classical tasks. However, the probability weighting functions for motor and classical tasks were markedly and significantly different. Those for the classical task showed a typical tendency to overweight small probabilities and underweight large probabilities, and those for the motor task showed the opposite pattern of probability distortion. This outcome also accounts for the increased risk-seeking observed in the motor tasks of experiment 1. We conclude that the same subject distorts probability, but not value, differently in making identical decisions in motor and classical form.
| S-EPMC2669401 | biostudies-literature
Project description:Recent studies have implicated the subthalamic nucleus (STN) in decisions that involve inhibiting movements. Many of the decisions that we make in our daily lives, however, do not involve any motor actions. We studied non-motor decision making by recording intraoperative STN and prefrontal cortex (PFC) electrophysiology as participants perform a novel task that required them to decide whether to encode items into working memory. During all encoding trials, beta band (15-30 Hz) activity decreased in the STN and PFC, and this decrease was progressively enhanced as more items were stored into working memory. Crucially, the STN and lateral PFC beta decrease was significantly attenuated during the trials in which participants were instructed not to encode the presented stimulus. These changes were associated with increase lateral PFC-STN coherence and altered STN neuronal spiking. Our results shed light on why states of altered basal ganglia activity disrupt both motor function and cognition.
| S-EPMC5780045 | biostudies-literature
Project description:A central aim of research in the psychological and decision sciences is to establish interventions that enhance performance, investigating the efficacy of modern approaches to improve human inference and decision-making. Whereas the decision sciences have established interventions to reduce decision biases by promoting strategies for critical thought and reasoning, methods from psychology have instead focused on enhancing cognition through skill-based training of executive functions. Contemporary research in psychology has engaged these operations through multi-modal interventions designed to enhance cognition and physical health through training of executive functions, mindfulness meditation, and physical fitness. Despite the comparable aims of research in the psychological and decision sciences, the efficacy of multi-modal interventions to enhance decision-making remain to be established. We therefore conducted a comprehensive, 16-week, randomized controlled trial (RCT) to investigate this issue, enrolling 160 healthy adults in one of four interventions: (1) high-intensity cardioresistance fitness training (HICRT); (2) HICRT and cognitive training of core executive functions; (3) HICRT and cognitive training, along with mindfulness meditation training; or (4) active control training. The results of our RCT demonstrate that HICRT training and multi-modal interventions that also incorporate cognitive training and mindfulness meditation have beneficial effects on decision-making competence. The observed pattern of findings motivate the application of modern interventions from psychology and cognitive neuroscience to enhance human judgment and decision-making in complex, real-world environments.
| S-EPMC6683193 | biostudies-literature
Project description:History matching is the process of modifying the uncertain attributes of a reservoir model to reproduce the real reservoir performance. It is a classical reservoir engineering problem and plays an important role in reservoir management since the resulting models are used to support decisions in other tasks such as economic analysis and production strategy. This work introduces a dynamic decision-making optimization framework for history matching problems in which new models are generated based on, and guided by, the dynamic analysis of the data of available solutions. The optimization framework follows a 'learning-from-data' approach, and includes two optimizer components that use machine learning techniques, such as unsupervised learning and statistical analysis, to uncover patterns of input attributes that lead to good output responses. These patterns are used to support the decision-making process while generating new, and better, history matched solutions. The proposed framework is applied to a benchmark model (UNISIM-I-H) based on the Namorado field in Brazil. Results show the potential the dynamic decision-making optimization framework has for improving the quality of history matching solutions using a substantial smaller number of simulations when compared with a previous work on the same benchmark.
| S-EPMC5459344 | biostudies-literature