Increasing the degree of parallelism using speculative execution in task-based runtime systems.
Ontology highlight
ABSTRACT:
SUBMITTER: Bramas B
PROVIDER: S-EPMC7924448 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:The task-based approach is a parallelization paradigm in which an algorithm is transformed into a direct acyclic graph of tasks: the vertices are computational elements extracted from the original algorithm and the edges are dependencies between those. During the execution, the management of the dependencies adds an overhead that can become significant when the computational cost of the tasks is low. A possibility to reduce the makespan is to aggregate the tasks to make them heavier, while having fewer of them, with the objective of mitigating the importance of the overhead. In this paper, we study an existing clustering/partitioning strategy to speed up the parallel execution of a task-based application. We provide two additional heuristics to this algorithm and perform an in-depth study on a large graph set. In addition, we propose a new model to estimate the execution duration and use it to choose the proper granularity. We show that this strategy allows speeding up a real numerical application by a factor of 7 on a multi-core system.
| S-EPMC7924455 | biostudies-literature
Project description:With the widespread of multicore systems, automatic parallelization becomes more pronounced, particularly for legacy programs, where the source code is not generally available. An essential operation in any parallelization system is detecting data dependence among parallelization candidate instructions. Conducting dependence analysis at the binary-level is more challenging than that at the source-level due to the much lower semantics of the binary code. In this paper, we consider using the elaborate 'static' analysis of abstract interpretation, for the first time, at runtime for data dependence detection. Specifically, our system interprets instructions at a hot region, while at the same time, collect programs semantics for seen program points, thereby conducting abstract interpretation analysis dynamically. The analysis is guaranteed to be correct as long as execution does not exit the region prematurely. Moreover, successive hot region re-entries will resume previous analysis, albeit much faster in case no major change in the program semantics. Such approach provides for more rigorous analysis than other simple dynamic analysis which would typically miss parallelization opportunities. The proposed approach also does not require any hardware support, availability of the source code, as well as any code re-compilation. To study the performance and accuracy of our approach, we have extended the Padrone dynamic code modification framework, and conduct an initial study on a set of PolyBench kernels and selected programs from SPEC CPU. Experimental results show accurate dependence detection with low overhead.
| S-EPMC7144976 | biostudies-literature
Project description:With the gradual popularization of Internet-of-Things (IoT) applications and the development of wireless networking technologies, the use of heterogeneous devices and runtime verification of task fulfillment with different constraints are required in real-world IoT scenarios. As far as IoT systems are concerned, most of them are built on centralized architectures, which reveal various assailable points in data security and privacy threats. Hence, this paper aims to investigate these issues by delegating the responsibility of a verification monitor from a centralized architecture to a decentralized manner using blockchain technology. We present a smart contract-based task management scheme to provide runtime verification of device behaviors and allows trustworthy access control to these devices. The business logic of the proposed system is specified by the smart contract, which automates all time-consuming processes cryptographically and correctly. The usability of the proposed solution is further demonstrated by implementing a prototype application in which the Hyperledger Fabric is utilized to implement the business logic for runtime verification and access control with one desktop and one Raspberry Pi. A comprehensive evaluation experiment is conducted, and the results indicate the effectiveness and efficiency of the proposed system.
| S-EPMC7070672 | biostudies-literature
Project description:Differentiating errors on the basis of the distinct cognitive mechanisms that may have generated them has provided neuropsychologists with useful diagnostic tools. For example, perseverative errors arising from the inability of the patient to set a new criterion for responding are considered one of the hallmarks of cognitive inflexibility. Similarly, in the task-switching paradigm it is possible to distinguish between task-confusion errors, produced by a failure in task selection, and response-confusion errors, arising when the correct task is selected, but the wrong response is given. Nonetheless, only a few studies so far have exploited the existence of different kinds of errors in multitasking situations to inform theories of cognitive flexibility. In the present study, we set out to use a variety of methodologies employed so far in the literature for disentangling errors due to task-selection failure from errors due to task-execution failure. In three experiments, we assessed the capacity of each method to produce error categories that can be mapped as clearly as possible to the cognitive mechanism(s) underlying them using multinomial processing tree modelling. Subsequently, the distinction between task- and response-confusion errors was used to test their differential impact on inhibitory mechanisms in task switching as measured by N-2 repetition costs. Our results are encouraging regarding the possibility of correctly detecting response- and task-selection failures, thus allowing us to assess their differential impact on N-2 repetition costs.
| S-EPMC10017612 | biostudies-literature
Project description:How strategies are formulated during a performance is an important aspect of motor control. Knowledge of the strategy employed in a task may help subjects achieve better performances, as it would help to evidence other possible strategies that could be used as well as help perfect a certain strategy. We sought to investigate how much of a performance is conditioned by the initial state and whether behavior throughout the performance is modified within a short timescale. In other words, we focus on the process of execution and not on the outcome. To this scope we used a repeated continuous circle tracing task. Performances were decomposed into different components (i.e., execution variables) whose combination is able to numerically determine movement outcome. By identifying execution variables of speed and duration, we created an execution space and a solution manifold (i.e., combinations of execution variables yielding zero discrepancy from the desired outcome) and divided the subjects according to their initial performance in that space into speed preference, duration preference, and no-preference groups. We demonstrated that specific strategies may be identified in a continuous task, and strategies remain relatively stable throughout the performance. Moreover, as performances remained stable, the initial location in the execution space can be used to determine the subject's strategy. Finally, contrary to other studies, we demonstrated that, in a continuous task, performances were associated with reduced exploration of the execution space.
| S-EPMC7921105 | biostudies-literature
Project description:BackgroundThe anterior prefrontal cortex (PFC) exhibits activation during some cognitive tasks, including episodic memory, reasoning, attention, multitasking, task sets, decision making, mentalizing, and processing of self-referenced information. However, the medial part of anterior PFC is part of the default mode network (DMN), which shows deactivation during various goal-directed cognitive tasks compared to a resting baseline. One possible factor for this pattern is that activity in the anterior medial PFC (MPFC) is affected by dynamic allocation of attentional resources depending on task demands. We investigated this possibility using an event related fMRI with a face working memory task.Methodology/principal findingsSixteen students participated in a single fMRI session. They were asked to form a task set to remember the faces (Face memory condition) or to ignore them (No face memory condition), then they were given 6 seconds of preparation period before the onset of the face stimuli. During this 6-second period, four single digits were presented one at a time at the center of the display, and participants were asked to add them and to remember the final answer. When participants formed a task set to remember faces, the anterior MPFC exhibited activation during a task preparation period but deactivation during a task execution period within a single trial.Conclusions/significanceThe results suggest that the anterior MPFC plays a role in task set formation but is not involved in execution of the face working memory task. Therefore, when attentional resources are allocated to other brain regions during task execution, the anterior MPFC shows deactivation. The results suggest that activation and deactivation in the anterior MPFC are affected by dynamic allocation of processing resources across different phases of processing.
| S-EPMC3148238 | biostudies-literature
Project description:Patients with Parkinson's disease have difficulties with self-initiating a task and maintaining a steady task performance. We hypothesized that these difficulties relate to reorganization in the sensorimotor execution, cingulo-opercular task-set maintenance, and frontoparietal adaptive control networks. We tested this hypothesis using graph theory-based network analysis of a composite network including a total of 86 nodes, derived from the three networks of interest. Resting-state functional magnetic resonance images were collected from 30 patients with Parkinson's disease (age 42-75 years, 11 females; Hoehn and Yahr score 2-3, average 2.4 ± 0.4) in their off-medication state and 30 matched control subjects (age 44-75 years, 10 females). For each node, we calculated strength as a general measure of connectivity, global efficiency and betweenness centrality as measures of functional integration, and clustering coefficient and local efficiency as measures of functional segregation. We found reduced node strength, clustering, and local efficiency in sensorimotor and posterior temporal nodes. There was also reduced node strength and betweenness centrality in the dorsal anterior insula and temporoparietal junction nodes of the cingulo-opercular network. These nodes are involved in integrating multimodal information, specifically related to self-awareness, sense of agency, and ultimately to intact perception of self-in-action. Moreover, we observed significant correlations between global disease severity and averaged graph metrics of the whole network. In addition to the well-known task-related frontostriatal mechanisms, we propose that the resting-state reorganization in the composite network can contribute to problems with self-initiation and task-set maintenance in Parkinson's disease.
| S-EPMC5565229 | biostudies-literature
Project description:Motor preparation typically precedes movement and is thought to determine properties of upcoming movements. However, preparation has mostly been studied in point-to-point delayed reaching tasks. Here, we ask whether preparation is engaged during mid-reach modifications. Monkeys reach to targets that occasionally jump locations prior to movement onset, requiring a mid-reach correction. In motor cortex and dorsal premotor cortex, we find that the neural activity that signals when to reach predicts monkeys' jump responses on a trial-by-trial basis. We further identify neural patterns that signal where to reach, either during motor preparation or during motor execution. After a target jump, neural activity responds in both preparatory and movement-related dimensions, even though error in preparatory dimensions can be small at that time. This suggests that the same preparatory process used in delayed reaching is also involved in reach correction. Furthermore, it indicates that motor preparation and execution can be performed simultaneously.
| S-EPMC6586876 | biostudies-literature
Project description:Deep learning has been transformative in many fields, motivating the emergence of various optical computing architectures. Diffractive optical network is a recently introduced optical computing framework that merges wave optics with deep-learning methods to design optical neural networks. Diffraction-based all-optical object recognition systems, designed through this framework and fabricated by 3D printing, have been reported to recognize hand-written digits and fashion products, demonstrating all-optical inference and generalization to sub-classes of data. These previous diffractive approaches employed monochromatic coherent light as the illumination source. Here, we report a broadband diffractive optical neural network design that simultaneously processes a continuum of wavelengths generated by a temporally incoherent broadband source to all-optically perform a specific task learned using deep learning. We experimentally validated the success of this broadband diffractive neural network architecture by designing, fabricating and testing seven different multi-layer, diffractive optical systems that transform the optical wavefront generated by a broadband THz pulse to realize (1) a series of tuneable, single-passband and dual-passband spectral filters and (2) spatially controlled wavelength de-multiplexing. Merging the native or engineered dispersion of various material systems with a deep-learning-based design strategy, broadband diffractive neural networks help us engineer the light-matter interaction in 3D, diverging from intuitive and analytical design methods to create task-specific optical components that can all-optically perform deterministic tasks or statistical inference for optical machine learning.
| S-EPMC6885516 | biostudies-literature
Project description:Throughout mammalian neocortex, layer 5 pyramidal (L5) cells project via the pons to a vast number of cerebellar granule cells (GrCs), forming a fundamental pathway. Yet, it is unknown how neuronal dynamics are transformed through the L5→GrC pathway. Here, by directly comparing premotor L5 and GrC activity during a forelimb movement task using dual-site two-photon Ca2+ imaging, we found that in expert mice, L5 and GrC dynamics were highly similar. L5 cells and GrCs shared a common set of task-encoding activity patterns, possessed similar diversity of responses, and exhibited high correlations comparable to local correlations among L5 cells. Chronic imaging revealed that these dynamics co-emerged in cortex and cerebellum over learning: as behavioral performance improved, initially dissimilar L5 cells and GrCs converged onto a shared, low-dimensional, task-encoding set of neural activity patterns. Thus, a key function of cortico-cerebellar communication is the propagation of shared dynamics that emerge during learning.
| S-EPMC6500577 | biostudies-literature