Tool-Use Model to Reproduce the Goal Situations Considering Relationship Among Tools, Objects, Actions and Effects Using Multimodal Deep Neural Networks.
Ontology highlight
ABSTRACT:
SUBMITTER: Saito N
PROVIDER: S-EPMC8510504 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Recent behavioural evidence suggests that when processing others' actions, motor acts and goal-related information both contribute to action recognition. Yet the neuronal mechanisms underlying the dynamic integration of the two action dimensions remain unclear. This study aims to elucidate the ERP components underlying the processing and integration of grip and goal-related information. The electrophysiological activity of 28 adults was recorded during the processing of object-directed action photographs (e.g., writing with pencil) containing either grip violations (e.g. upright pencil grasped with atypical-grip), goal violations (e.g., upside-down pencil grasped with typical-grip), both grip and goal violations (e.g., upside-down pencil grasped with atypical-grip), or no violations. Participants judged whether actions were overall typical or not according to object typical use. Brain activity was sensitive to the congruency between grip and goal information on the N400, reflecting the semantic integration between the two dimensions. On earlier components, brain activity was affected by grip and goal typicality independently. Critically, goal typicality but not grip typicality affected brain activity on the N300, supporting an earlier role of goal-related representations in action recognition. Findings provide new insights on the neural temporal dynamics of the integration of motor acts and goal-related information during the processing of others' actions.
| S-EPMC7081278 | biostudies-literature
Project description:New Caledonian crows (Corvus moneduloides) rely heavily on a range of tools to extract prey. They manufacture novel tools, save tools for later use, and have morphological features that facilitate tool use. We report six observations, in two individuals, of a novel tool-use mode not previously reported in non-human animals. Insert-and-transport tool use involves inserting a stick into an object and then moving away, thereby transporting both object and tool. All transported objects were non-food objects. One subject used a stick to transport an object that was too large to be handled by beak, which suggests the tool facilitated object control. The function in the other cases is unclear but seems to be an expression of play or exploration. Further studies should investigate whether it is adaptive in the wild and to what extent crows can flexibly apply the behaviour in experimental settings when purposive transportation of objects is advantageous.
| S-EPMC5054045 | biostudies-literature
Project description:Developments in high-throughput sequencing (HTS) result in an exponential increase in the amount of data generated by sequencing experiments, an increase in the complexity of bioinformatics analysis reporting and an increase in the types of data generated. These increases in volume, diversity and complexity of the data generated and their analysis expose the necessity of a structured and standardized reporting template. BioCompute Objects (BCOs) provide the requisite support for communication of HTS data analysis that includes support for workflow, as well as data, curation, accessibility and reproducibility of communication. BCOs standardize how researchers report provenance and the established verification and validation protocols used in workflows while also being robust enough to convey content integration or curation in knowledge bases. BCOs that encapsulate tools, platforms, datasets and workflows are FAIR (findable, accessible, interoperable and reusable) compliant. Providing operational workflow and data information facilitates interoperability between platforms and incorporation of future dataset within an HTS analysis for use within industrial, academic and regulatory settings. Cloud-based platforms, including High-performance Integrated Virtual Environment (HIVE), Cancer Genomics Cloud (CGC) and Galaxy, support BCO generation for users. Given the 100K+ userbase between these platforms, BioCompute can be leveraged for workflow documentation. In this paper, we report the availability of platform-dependent and platform-independent BCO tools: HIVE BCO App, CGC BCO App, Galaxy BCO API Extension and BCO Portal. Community engagement was utilized to evaluate tool efficacy. We demonstrate that these tools further advance BCO creation from text editing approaches used in earlier releases of the standard. Moreover, we demonstrate that integrating BCO generation within existing analysis platforms greatly streamlines BCO creation while capturing granular workflow details. We also demonstrate that the BCO tools described in the paper provide an approach to solve the long-standing challenge of standardizing workflow descriptions that are both human and machine readable while accommodating manual and automated curation with evidence tagging. Database URL: https://www.biocomputeobject.org/resources.
| S-EPMC8009203 | biostudies-literature
Project description:Humans interpret others' goals based on motion information, and this capacity contributes to our mental reasoning. The present study sought to determine whether Japanese macaques (Macaca fuscata) perceive goal-directedness in chasing events depicted by two geometric particles. In Experiment 1, two monkeys and adult humans were trained to discriminate between Chasing and Random sequences. We then introduced probe stimuli with various levels of correlation between the particle trajectories to examine whether participants performed the task using higher correlation. Participants chose stimuli with the highest correlations by chance, suggesting that correlations were not the discriminative cue. Experiment 2 examined whether participants focused on particle proximity. Participants differentiated between Chasing and Control sequences; the distance between two particles was identical in both. Results indicated that, like humans, the Japanese macaques did not use physical cues alone to perform the discrimination task and integrated the cues spontaneously. This suggests that goal attribution resulting from motion information is a widespread cognitive phenotype in primate species.
| S-EPMC5215463 | biostudies-literature
Project description:Understanding of other's actions as goal-directed is considered a fundamental ability underlying cognitive and social development in human infants. A number of studies using the habituation-dishabituation paradigm have shown that the ability to discern intentional relations, in terms of goal-directedness of an action towards an object, appears around 5 months of age. The question of whether non-human species can perceive other's actions as goal-directed has been more controversial, however there is mounting evidence that at least some primates species do. Recently domestic dogs have been shown to be particularly sensitive to human communicative cues and more so in cooperative and intentional contexts. Furthermore, they have been shown to imitate selectively. Taken together these results suggest that dogs may perceive others' actions as goal-directed, however no study has investigated this issue directly. In the current study, adopting an infant habituation-dishabituation paradigm, we investigated whether dogs attribute intentions to an animate (a human) but not an inanimate (a black box) agent interacting with an object. Following an habituation phase in which the agent interacted always with one of two objects, two sets of 3 trials were presented: new side trials (in which the agent interacted with the same object as in the habituation trial but placed in a novel location) and new goal trials (in which the agent interacted with the other object placed in the old location). Dogs showed a similar pattern of response to that shown in infants, looking longer in the new goal than new side trials when they saw the human agent interact with the object. No such difference emerging with the inanimate agent (the black box). Results provide the first evidence that a non-primate species can perceive another individual's actions as goal-directed. We discuss results in terms of the prevailing mentalisitic and non-mentalistic hypotheses regarding goal-attribution.
| S-EPMC4167693 | biostudies-literature
Project description:Most neuroimaging studies are performed using one imaging method only, either functional magnetic resonance imaging (fMRI), electroencephalography (EEG), or magnetoencephalography (MEG). Information on both location and timing has been sought by recording fMRI and EEG, simultaneously, or MEG and fMRI in separate sessions. Such approaches assume similar active areas whether detected via hemodynamic or electrophysiological signatures. Direct comparisons, after independent analysis of data from each imaging modality, have been conducted primarily on low-level sensory processing. Here, we report MEG (timing and location) and fMRI (location) results in 11 subjects when they named pictures that depicted an action or an object. The experimental design was exactly the same for the two imaging modalities. The MEG data were analyzed with two standard approaches: a set of equivalent current dipoles and a distributed minimum norm estimate. The fMRI blood-oxygen-level dependent (BOLD) data were subjected to the usual random-effect contrast analysis. At the group level, MEG and fMRI data showed fairly good convergence, with both overall activation patterns and task effects localizing to comparable cortical regions. There were some systematic discrepancies, however, and the correspondence was less compelling in the individual subjects. The present analysis should be helpful in reconciling results of fMRI and MEG studies on high-level cognitive functions.
| S-EPMC6870641 | biostudies-literature
Project description:Facial emotional expressions are a salient source of information for nonverbal social interactions. However, their impact on action planning and execution is highly controversial. In this vein, the effect of the two threatening facial expressions, i.e., angry and fearful faces, is still unclear. Frequently, fear and anger are used interchangeably as negative emotions. However, they convey different social signals. Unlike fear, anger indicates a direct threat toward the observer. To provide new evidence on this issue, we exploited a novel design based on two versions of a Go/No-go task. In the emotional version, healthy participants had to perform the same movement for pictures of fearful, angry, or happy faces and withhold it when neutral expressions were presented. The same pictures were shown in the control version, but participants had to move or suppress the movement, according to the actor's gender. This experimental design allows us to test task relevance's impact on emotional stimuli without conflating movement planning with target detection and task switching. We found that the emotional content of faces interferes with actions only when task-relevant, i.e., the effect of emotions is context-dependent. We also showed that angry faces qualitatively had the same effect as fearful faces, i.e., both negative emotions decreased response readiness with respect to happy expressions. However, anger has a much greater impact than fear, as it increases both the rates of mistakes and the time of movement execution. We interpreted these results, suggesting that participants have to exploit more cognitive resources to appraise threatening than positive facial expressions, and angry than fearful faces before acting.
| S-EPMC7694135 | biostudies-literature
Project description:With advances in technology, artificial agents such as humanoid robots will soon become a part of our daily lives. For safe and intuitive collaboration, it is important to understand the goals behind their motor actions. In humans, this process is mediated by changes in activity in fronto-parietal brain areas. The extent to which these areas are activated when observing artificial agents indicates the naturalness and easiness of interaction. Previous studies indicated that fronto-parietal activity does not depend on whether the agent is human or artificial. However, it is unknown whether this activity is modulated by observing grasping (self-related action) and pointing actions (other-related action) performed by an artificial agent depending on the action goal. Therefore, we designed an experiment in which subjects observed human and artificial agents perform pointing and grasping actions aimed at two different object categories suggesting different goals. We found a signal increase in the bilateral inferior parietal lobule and the premotor cortex when tool versus food items were pointed to or grasped by both agents, probably reflecting the association of hand actions with the functional use of tools. Our results show that goal attribution engages the fronto-parietal network not only for observing a human but also a robotic agent for both self-related and social actions. The debriefing after the experiment has shown that actions of human-like artificial agents can be perceived as being goal-directed. Therefore, humans will be able to interact with service robots intuitively in various domains such as education, healthcare, public service, and entertainment.
| S-EPMC6866499 | biostudies-literature
Project description:Before the 6-months of age, infants succeed to learn words associated with objects and actions when the words are presented isolated or embedded in short utterances. It remains unclear whether such type of learning occurs from fluent audiovisual stimuli, although in natural environments the fluent audiovisual contexts are the default. In 4 experiments, we evaluated if 8-month-old infants could learn word-action and word-object associations from fluent audiovisual streams when the words conveyed either vowel or consonant harmony, two phonological cues that benefit word learning near 6 and 12 months of age, respectively. We found that infants learned both types of words, but only when the words contained vowel harmony. Because object- and action-words have been conceived as rudimentary representations of nouns and verbs, our results suggest that vowels contribute to shape the initial steps of the learning of lexical categories in preverbal infants.
| S-EPMC8154951 | biostudies-literature
Project description:Background and objectivesAlong with the rapid improvement of imaging technology, convex probe endobronchial ultrasound (CP-EBUS) sonographic features play an increasingly important role in the diagnosis of intrathoracic lymph nodes (LNs). Conventional qualitative and quantitative methods for EBUS multimodal imaging are time-consuming and rely heavily on the experience of endoscopists. With the development of deep-learning (DL) models, there is great promise in the diagnostic field of medical imaging.Materials and methodsWe developed DL models to retrospectively analyze CP-EBUS images of 294 LNs from 267 patients collected between July 2018 and May 2019. The DL models were trained on 245 LNs to differentiate benign and malignant LNs using both unimodal and multimodal CP-EBUS images and independently evaluated on the remaining 49 LNs to validate their diagnostic efficiency. The human comparator group consisting of three experts and three trainees reviewed the same test set as the DL models.ResultsThe multimodal DL framework achieves an accuracy of 88.57% (95% confidence interval [CI] [86.91%-90.24%]) and area under the curve (AUC) of 0.9547 (95% CI [0.9451-0.9643]) using the three modes of CP-EBUS imaging in comparison to the accuracy of 80.82% (95% CI [77.42%-84.21%]) and AUC of 0.8696 (95% CI [0.8369-0.9023]) by experts. Statistical comparison of their average receiver operating curves shows a statistically significant difference (P < 0.001). Moreover, the multimodal DL framework is more consistent than experts (kappa values 0.7605 vs. 0.5800).ConclusionsThe DL models based on CP-EBUS imaging demonstrated an accurate automated tool for diagnosis of the intrathoracic LNs with higher diagnostic efficiency and consistency compared with experts.
| S-EPMC8544010 | biostudies-literature