Online Testing Yields the Same Results as Lab Testing: A Validation Study With the False Belief Task
Ontology highlight
ABSTRACT:
SUBMITTER: Schidelko L
PROVIDER: S-EPMC8548716 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Traditionally, it had been assumed that meta-representational Theory of Mind (ToM) emerges around the age of 4 when children come to master standard false belief (FB) tasks. More recent research with various implicit measures, though, has documented much earlier competence and thus challenged the traditional picture. In interactive FB tasks, for instance, infants have been shown to track an interlocutor's false or true belief when interpreting her ambiguous communicative acts (Southgate et al. 2010 Dev. Sci. 13, 907-912. (doi:10.1111/j.1467-7687.2009.00946.x)). However, several replication attempts so far have produced mixed findings (e.g. Dörrenberg et al. 2018 Cogn. Dev. 46, 12-30. (doi:10.1016/j.cogdev.2018.01.001); Grosse Wiesmann et al. 2017 Dev. Sci. 20, e12445. (doi:10.1111/desc.12445); Király et al. 2018 Proc. Natl Acad. Sci. USA 115, 11 477-11 482. (doi:10.1073/pnas.1803505115)). Therefore, we conducted a systematic replication study, across two laboratories, of an influential interactive FB task (the so-called 'Sefo' tasks by Southgate et al. 2010 Dev. Sci. 13, 907-912. (doi:10.1111/j.1467-7687.2009.00946.x)). First, we implemented close direct replications with the original age group (17-month-olds) and compared their performance to those of 3-year-olds. Second, we designed conceptual replications with modifications and improvements regarding pragmatic ambiguities for 2-year-olds. Third, we validated the task with explicit verbal test versions in older children and adults. Results revealed the following: the original results could not be replicated, and there was no evidence for FB understanding measured by the Sefo task in any age group except for adults. Comparisons to explicit FB tasks suggest that the Sefo task may not be a sensitive measure of FB understanding in children and even underestimate their ToM abilities. The findings add to the growing replication crisis in implicit ToM research and highlight the challenge of developing sensitive, reliable and valid measures of early implicit social cognition.
| S-EPMC7657934 | biostudies-literature
Project description:Empathic brain responses are characterized by overlapping activations between active experience and observation of an emotion in another person, with the pattern for observation being modulated by trait empathy. Also for self-performed and observed errors, similar brain activity has been described, but findings concerning the role of empathy are mixed. We hypothesized that trait empathy modulates the processing of observed responses if expectations concerning the response are based on the beliefs of the observed person. In the present study, we utilized a false-belief task in which observed person's and observer's task-related knowledge were dissociated and errors and correct responses could be expected or unexpected. While theta power was generally modulated by the expectancy of the observed response, a negative mediofrontal event-related potential (ERP) component was more pronounced for unexpected observed actions only in participants with higher trait empathy (assessed by the Empathy Quotient), as revealed by linear mixed effects analyses. Cognitive and affective empathy, assessed by the Interpersonal Reactivity Index, were not significantly related to the ERP component. The results suggest that trait empathy can facilitate the generation of predictions and thereby modulate specific aspects of the processing of observed actions, while the contributions of specific empathy components remain unclear.
| S-EPMC7171373 | biostudies-literature
Project description:To investigate whether people can implicitly learn regularities in a social context, we developed a new implicit sequence learning task combining elements from classic false belief and serial reaction time tasks. Participants learned that protagonists were offered flowers at four locations. The protagonists' beliefs concerning the flowers were true or false, depending on their orientation, respectively, toward the scene (so that the flowers could be seen) or away from it. Unbeknown to the participants, there was a fixed belief-related sequence involving three dimensions (identity of the two protagonists, true-false belief orientation held by the protagonists, and flower location as believed by the protagonists). Participants had to indicate as fast as possible where the flowers were located (Experiment 1), or how many flowers were given (Experiment 2) according to the protagonists. Experiment 1 combined perceptual and motor processes (as both the belief-related sequence and motor responses referred to location), whereas Experiment 2 unconfounded the sequence and motor responses, allowing to investigate pure perceptual implicit learning. For reasons of comparison, two non-social conditions were created in Experiment 2 by replacing the protagonists with two non-social objects-colored cameras or shapes. Results revealed significant implicit sequence learning of all belief-related dimensions in Experiment 1, and of true-false belief orientation in Experiment 2, even without a motor confound. Importantly, there were faster reaction times and stronger sequence learning effects in the social than in the non-social conditions. The present findings demonstrate for the first time that people are able to implicitly learn belief-related sequences.
| S-EPMC8032999 | biostudies-literature
Project description:Anticipatory looking on mindreading tasks can indicate our expectation of an agent's action. The challenge is that social situations are often more complex, involving instances where we need to track an agent's false belief to successfully identify the outcome to which an action is directed. If motor processes can guide how action goals are understood, it is conceivable-where that kind of goal ascription occurs in false-belief tasks-for motor representations to account for someone's belief-like state. Testing adults (N = 42) in a real-time interactive helping scenario, we discovered that participants' early mediolateral motor activity (leftwards-rightwards leaning on balance board) foreshadowed the agent's belief-based action preparation. These results suggest fast belief-tracking can modulate motor representations generated in the course of one's interaction with an agent. While adults' leaning, and anticipatory looking, revealed the contribution of fast false-belief tracking, participants did not correct the agent's mistake in their final helping action. These discoveries suggest that adults may not necessarily use another's belief during overt social interaction or find reflecting on another's belief as being normatively relevant to one's own choice of action. Our interactive task design offers a promising way to investigate how motor and mindreading processes may be variously integrated.
| S-EPMC7029919 | biostudies-literature
Project description:Objectives: With the worldwide spread of coronavirus disease 2019 (COVID-19) caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), various antibody detection kits have been developed to test for SARS-CoV-2- specific IgG, IgM, and total antibody. However, the use of different testing methods under various heat-inactivation conditions might affect the COVID-19 detection results. Methods: Seven different antibody detection kits produced by four manufacturers for detection of SARS-CoV-2 IgG, IgM, and total antibody were tested at Wuhan Huoshenshan Hospital, China. Most of the kits used the indirect immunity, capture, and double-antigen sandwich methods. The effects of various heat-inactivation conditions on SARS-CoV-2-specific IgG, IgM, and total antibody detection were analyzed for the different test methods. Results: Using the indirect immunity method, values for SARS-CoV-2 IgG antibody significantly increased and those for IgM antibody decreased with increasing temperature of heat-inactivation using indirect immunity method. However, values for SARS-CoV-2 IgM and total antibody showed no change when the capture and double-antigen sandwich methods were used. The changes in IgG and IgM antibody values with the indirect immunity method indicated that heat-inactivation could affect COVID-19 detection results obtained using this method. In particular, 18 (22.2%) SARS-CoV-2 IgM positive samples were detected as negative with heat-inactivation at 65°C for 30 min, and one (25%) IgG negative sample was detected as positive after heat-inactivation at 56°C for 60 min and 60°C for 30 min. Conclusions: Heat-inactivation could increase SARS-CoV-2 IgG antibody values, and decrease IgM antibody values, causing potential false-positive or false-negative results for COVID-19 antibody detection using the indirect immunity method. Thus, before conducting antibody testing, the testing platforms should be evaluated in accordance with the relevant requirements to ensure accurate COVID-19 detection results.
| S-EPMC7849051 | biostudies-literature
Project description:Rapid HIV tests provide same-day results and are widely used in HIV testing programs in areas with limited personnel and laboratory infrastructure. The Uganda Ministry of Health currently recommends the serial rapid testing algorithm with Determine, STAT-PAK, and Uni-Gold for diagnosis of HIV infection. Using this algorithm, individuals who test positive on Determine, negative to STAT-PAK and positive to Uni-Gold are reported as HIV positive. We conducted further testing on this subgroup of samples using qualitative DNA PCR to assess the potential for false positive tests in this situation.Of the 3388 individuals who were tested, 984 were HIV positive on two consecutive tests, and 29 were considered positive by a tiebreaker (positive on Determine, negative on STAT-PAK, and positive on Uni-Gold). However, when the 29 samples were further tested using qualitative DNA PCR, 14 (48.2%) were HIV negative.Although this study was not primarily designed to assess the validity of rapid HIV tests and thus only a subset of the samples were retested, the findings show a potential for false positive HIV results in the subset of individuals who test positive when a tiebreaker test is used in serial testing. These findings highlight a need for confirmatory testing for this category of individuals.
| S-EPMC3392728 | biostudies-other
Project description:Laboratory experiments have been often replaced by online experiments in the last decade. This trend has been reinforced when academic and research work based on physical interaction had to be suspended due to restrictions imposed to limit the spread of Covid-19. Therefore, data quality and results from web experiments have become an issue which is currently investigated. Are there significant differences between lab experiments and online findings? We contribute to this debate via an experiment aimed at comparing results from a novel online protocol with traditional laboratory settings, using the same pool of participants. We find that participants in our experiment behave in a similar way across settings and that there are at best weakly significant and quantitatively small differences in behavior observed using our online protocol and physical laboratory setting. Supplementary Information The online version contains supplementary material available at 10.1007/s40881-021-00114-8.
| S-EPMC8683827 | biostudies-literature
Project description:False-belief reasoning, defined as the ability to reason about another person's beliefs and appreciate that beliefs can differ from reality, is an important aspect of perspective taking. We tested 266 individuals, at various ages ranging from 3 to 92 years, on a continuous measure of false-belief reasoning (the Sandbox task). All age groups had difficulty suppressing their own knowledge when estimating what a naïve person knew. After controlling for task-specific memory, our results showed similar false-belief reasoning abilities across the preschool years and from older childhood to younger adulthood, followed by a small reduction in this ability from younger to older adulthood. These results highlight the relative similarity in false-belief reasoning abilities at different developmental periods across the lifespan.
| S-EPMC5619768 | biostudies-literature
Project description:Perceptual decisions about the state of the environment are often made in the face of uncertain evidence. Internal uncertainty signals are considered important regulators of learning and decision-making. A growing body of work has implicated the brain's arousal systems in uncertainty signaling. Here, we found that two specific computational variables, postulated by recent theoretical work, evoke boosts of arousal at different times during a perceptual decision: decision confidence (the observer's internally estimated probability that a choice was correct given the evidence) before feedback, and prediction errors (deviations from expected reward) after feedback. We monitored pupil diameter, a peripheral marker of central arousal state, while subjects performed a challenging perceptual choice task with a delayed monetary reward. We quantified evoked pupil responses during decision formation and after reward-linked feedback. During both intervals, decision difficulty and accuracy had interacting effects on pupil responses. Pupil responses negatively scaled with decision confidence prior to feedback and scaled with uncertainty-dependent prediction errors after feedback. This pattern of pupil responses during both intervals was in line with a model using the observer's graded belief about choice accuracy to anticipate rewards and compute prediction errors. We conclude that pupil-linked arousal systems are modulated by internal belief states.
| S-EPMC6135755 | biostudies-literature
Project description:Prior to age four, children succeed in non-elicited-response false-belief tasks but fail elicited-response false-belief tasks. To explain this discrepancy, the processing-load account argues that the capacity to represent beliefs emerges in infancy, as indicated by early success on non-elicited-response tasks, but that children's ability to demonstrate this capacity depends on the processing demands of the task and children's processing skills. When processing demands exceed young children's processing abilities, such as in standard elicited-response tasks, children fail despite their capacity to represent beliefs. Support for this account comes from recent evidence that reducing processing demands improves young children's performance: when demands are sufficiently reduced, 2.5-year-olds succeed in elicited-response tasks. Here we sought complementary evidence for the processing-load account by examining whether increasing processing demands impeded children's performance in a non-elicited-response task. 3-year-olds were tested in a preferential-looking task in which they heard a change-of-location false-belief story accompanied by a picture book; across children, we manipulated the amount of linguistic ambiguity in the story. The final page of the book showed two images: one that was consistent with the main character's false belief and one that was consistent with reality. When the story was relatively unambiguous, children looked reliably longer at the false-belief-consistent image, successfully demonstrating their false-belief understanding. When the story was ambiguous, however, this undermined children's performance: looking times to the belief-consistent image were correlated with verbal ability, and only children with verbal skills in the upper quartile of the sample demonstrated a significant preference for the belief-consistent image. These results support the processing-load account by demonstrating that regardless of whether a task involves an elicited response, children's performance depends on the processing demands of the task and their processing skills. These findings also have implications for alternative, deflationary accounts of early false-belief understanding.
| S-EPMC4642936 | biostudies-literature