PecanPy: a fast, efficient, and parallelized Python implementation of node2vec.
Ontology highlight
ABSTRACT: Summary
Learning low-dimensional representations (embeddings) of nodes in large graphs is key to applying machine learning on massive biological networks. Node2vec is the most widely used method for node embedding. However, its original Python and C ++ implementations scale poorly with network density, failing for dense biological networks with hundreds of millions of edges. We have developed PecanPy, a new Python implementation of node2vec that uses cache-optimized compact graph data structures and precomputing/parallelization to result in fast, high-quality node embeddings for biological networks of all sizes and densities.Availability
PecanPy software is freely available at https://github.com/krishnanlab/PecanPy.Supplementary information
Supplementary data are available at Bioinformatics online.
SUBMITTER: Liu R
PROVIDER: S-EPMC8504639 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:In fluorescence microscopy, the serial acquisition of 2D images to form a 3D volume limits the maximum imaging speed. This is particularly evident when imaging adherent cells in a light-sheet fluorescence microscopy format, as their elongated morphologies require ~200 image planes per image volume. Here, by illuminating the specimen with three light-sheets, each independently detected, we present a light-efficient, crosstalk free, and volumetrically parallelized 3D microscopy technique that is optimized for high-speed (up to 14 Hz) subcellular (300 nm lateral, 600 nm axial resolution) imaging of adherent cells. We demonstrate 3D imaging of intracellular processes, including cytoskeletal dynamics in single cell migration and collective wound healing for 1500 and 1000 time points, respectively. Further, we capture rapid biological processes, including trafficking of early endosomes with velocities exceeding 10 microns per second and calcium signaling in primary neurons.
| S-EPMC5609504 | biostudies-literature
Project description:Multi-label classification has recently gained great attention in diverse fields of research, e.g., in biomedical application such as protein function prediction or drug resistance testing in HIV. In this context, the concept of Classifier Chains has been shown to improve prediction accuracy, especially when applied as Ensemble Classifier Chains. However, these techniques lack computational efficiency when applied on large amounts of data, e.g., derived from next-generation sequencing experiments. By adapting algorithms for the use of graphics processing units, computational efficiency can be greatly improved due to parallelization of computations.Here, we provide a parallelized and optimized graphics processing unit implementation (eccCL) of Classifier Chains and Ensemble Classifier Chains. Additionally to the OpenCL implementation, we provide an R-Package with an easy to use R-interface for parallelized graphics processing unit usage.eccCL is a handy implementation of Classifier Chains on GPUs, which is able to process up to over 25,000 instances per second, and thus can be used efficiently in high-throughput experiments. The software is available at http://www.heiderlab.de .
| S-EPMC5561639 | biostudies-other
Project description:MotivationRecently, Lemoine et al. suggested the transfer bootstrap expectation (TBE) branch support metric as an alternative to classical phylogenetic bootstrap support for taxon-rich datasets. However, the original TBE implementation in the booster tool is compute- and memory-intensive.ResultsWe developed a fast and memory-efficient TBE implementation. We improve upon the original algorithm by Lemoine et al. via several algorithmic and technical optimizations. On empirical as well as on random tree sets with varying taxon counts, our implementation is up to 480 times faster than booster. Furthermore, it only requires memory that is linear in the number of taxa, which leads to 10× to 40× memory savings compared with booster.Availability and implementationOur implementation has been partially integrated into pll-modules and RAxML-NG and is available under the GNU Affero General Public License v3.0 at https://github.com/ddarriba/pll-modules and https://github.com/amkozlov/raxml-ng. The parallel version that also computes additional TBE-related statistics is available at: https://github.com/lutteropp/raxml-ng/tree/tbe.Supplementary informationSupplementary data are available at Bioinformatics online.
| S-EPMC7141843 | biostudies-literature
Project description:We introduce PxBLAT, a Python library designed to enhance usability and efficiency in interacting with the BLAST-like alignment tool (BLAT). PxBLAT provides an intuitive Application Programming Interface (API) design, allowing the incorporation of its functionality directly into Python-based bioinformatics workflows. Moreover, PxBLAT's design philosophy emphasizes ease of use, memory efficiency, and the elimination of intermediary files and unnecessary system calls, thereby enhancing computational speed and user experience. Benchmark tests reveal its superior performance across various datasets, illustrating its capacity to maintain correctness. PxBLAT supports Python (version 3.9+), and pre-compiled packages are released via PyPI (https://pypi.org/project/pxblat/) and Bioconda (https://anaconda.org/bioconda/pxblat). The source code and executable are freely available for academic, nonprofit, and personal use. Its documentation is available on ReadTheDocs (https://pxblat.readthedocs.io/en/latest/).
| S-EPMC10418261 | biostudies-literature
Project description:We developed FLIE (Fast Low-Input Efficient) Hi-C, a highly optimized and simplified version of Hi-C. Our method shortens the duration of Hi-C from five days to two days and decreases key reagent amounts 5-20 fold, while maintaining experimental controls and data quality. Importantly, the method also reduces the required input material by 100-1000 fold, as we demonstrate by generating detailed high complexity interaction maps from low-input sorted mouse frozen neuron nuclei and from 5,000-10,000 human Hap1 cells.
2024-09-06 | GSE276553 | GEO
Project description:MotivationHi-C is the most widely used assay for investigating genome-wide 3D organization of chromatin. When working with Hi-C data, it is often useful to calculate the similarity between contact matrices in order to asses experimental reproducibility or to quantify relationships among Hi-C data from related samples. The HiCRep algorithm has been widely adopted for this task, but the existing R implementation suffers from run time limitations on high resolution Hi-C data or on large single-cell Hi-C datasets.ResultsWe introduce a Python implementation of HiCRep and demonstrate that it is much faster and consume much less memory than the existing R implementation. Furthermore, we give examples of HiCRep's ability to accurately distinguish replicates from non-replicates and to reveal cell type structure among collections of Hi-C data.AvailabilityHiCRep.py and its documentation are available with a GPL license at https://github.com/Noble-Lab/hicrep. The software may be installed automatically using the pip package installer.Supplementary informationSupplementary methods and results are included in an appendix at Bioinformatics online.
| S-EPMC8479650 | biostudies-literature
Project description:Time-frequency analysis of EEG data is a key step in exploring the internal activities of the human brain. Studying oscillations is an important part of the analysis, as they are thought to provide the underlying mechanism for communication between neural assemblies. Traditional methods of analysis, such as Short-Time FFT and Wavelet Transforms, are not ideal for this task due to the time-frequency uncertainty principle and their reliance on predefined basis functions. Empirical Mode Decomposition and its variants are more suited to this task as they are able to extract the instantaneous frequency and phase information but are too time consuming for practical use. Our aim was to design and develop a massively parallel and performance-optimized GPU implementation of the Improved Complete Ensemble EMD with the Adaptive Noise (CEEMDAN) algorithm that significantly reduces the computational time (from hours to seconds) of such analysis. The resulting GPU program, which is publicly available, was validated against a MATLAB reference implementation and reached over a 260× speedup for actual EEG measurement data, and provided predicted speedups in the range of 3000-8300× for longer measurements when sufficient memory was available. The significance of our research is that this implementation can enable researchers to perform EMD-based EEG analysis routinely, even for high-density EEG measurements. The program is suitable for execution on desktop, cloud, and supercomputer systems and can be the starting point for future large-scale multi-GPU implementations.
| S-EPMC10611056 | biostudies-literature
Project description:BackgroundDuring the last decade, the use of microarrays to assess the transcriptome of many biological systems has generated an enormous amount of data. A common technique used to organize and analyze microarray data is to perform cluster analysis. While many clustering algorithms have been developed, they all suffer a significant decrease in computational performance as the size of the dataset being analyzed becomes very large. For example, clustering 10000 genes from an experiment containing 200 microarrays can be quite time consuming and challenging on a desktop PC. One solution to the scalability problem of clustering algorithms is to distribute or parallelize the algorithm across multiple computers.ResultsThe software described in this paper is a high performance multithreaded application that implements a parallelized version of the K-means Clustering algorithm. Most parallel processing applications are not accessible to the general public and require specialized software libraries (e.g. MPI) and specialized hardware configurations. The parallel nature of the application comes from the use of a web service to perform the distance calculations and cluster assignments. Here we show our parallel implementation provides significant performance gains over a wide range of datasets using as little as seven nodes. The software was written in C# and was designed in a modular fashion to provide both deployment flexibility as well as flexibility in the user interface.ConclusionParaKMeans was designed to provide the general scientific community with an easy and manageable client-server application that can be installed on a wide variety of Windows operating systems.
| S-EPMC2375128 | biostudies-literature
Project description:Computational models of multicellular systems require solving systems of PDEs for release, uptake, decay and diffusion of multiple substrates in 3D, particularly when incorporating the impact of drugs, growth substrates and signaling factors on cell receptors and subcellular systems biology.We introduce BioFVM, a diffusive transport solver tailored to biological problems. BioFVM can simulate release and uptake of many substrates by cell and bulk sources, diffusion and decay in large 3D domains. It has been parallelized with OpenMP, allowing efficient simulations on desktop workstations or single supercomputer nodes. The code is stable even for large time steps, with linear computational cost scalings. Solutions are first-order accurate in time and second-order accurate in space. The code can be run by itself or as part of a larger simulator.BioFVM is written in C?++ with parallelization in OpenMP. It is maintained and available for download at http://BioFVM.MathCancer.org and http://BioFVM.sf.net under the Apache License (v2.0).paul.macklin@usc.eduSupplementary data are available at Bioinformatics online.
| S-EPMC4824128 | biostudies-literature
Project description:Likelihood-free inference for simulator-based models is an emerging methodological branch of statistics which has attracted considerable attention in applications across diverse fields such as population genetics, astronomy and economics. Recently, the power of statistical classifiers has been harnessed in likelihood-free inference to obtain either point estimates or even posterior distributions of model parameters. Here we introduce PYLFIRE, an open-source Python implementation of the inference method LFIRE (likelihood-free inference by ratio estimation) that uses penalised logistic regression. PYLFIRE is made available as part of the general ELFI inference software http://elfi.ai to benefit both the user and developer communities for likelihood-free inference.
| S-EPMC7041362 | biostudies-literature