Search PubMedSearch

SEARCH · Search PubMed

Results for “High-performance computing”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

18 recordsLinked to original sources

Easy and interactive taxonomic profiling with Metabuli App.

SUMMARY: Accurate metagenomic taxonomic profiling is critical for understanding microbial communities. However, computational analysis often requires command-line proficiency and high-performance computing resources. To lower these barriers, we developed Metabuli App, an all-in-one desktop application that efficiently runs taxonomic profiling locally on a consumer-grade computer. It features user-friendly graphical interfaces for custom database curation, raw read quality control (QC), taxonomic profiling, and interactive result visualization. AVAILABILITY AND IMPLEMENTATION: GPLv3-licensed source code and prebuilt apps for Windows, macOS, and Linux are available at https://github.com/steineggerlab/Metabuli-App and are archived at https://doi.org/10.5281/zenodo.15876171. Analysis scripts are available at https://github.com/jaebeom-kim/metabuli-app-analysis. The Sankey-based taxonomy visualization component is available at https://github.com/steineggerlab/taxoview for easy integration into other web projects.

Software

HI-FEVER: a Nextflow pipeline for the high-throughput discovery and annotation of endogenous viral elements.

SUMMARY: Endogenous viral elements (EVEs) offer valuable insights into virus and host evolution, but their detection remains computationally and biologically challenging. We present HI-FEVER, a user-friendly Nextflow pipeline for the discovery of EVEs in eukaryotic host genomes. HI-FEVER is highly parallelizable and customizable, ensuring computational efficiency while allowing researchers to fine-tune parameters to their specific needs. Its output provides a comprehensive analysis of discovered EVEs, including detailed annotations which can provide evolutionary insights. HI-FEVER scales seamlessly to handle millions of viral protein queries across multiple host genomes on both laptops and high-performance computing nodes. AVAILABILITY AND IMPLEMENTATION: The HI-FEVER source code is available on GitHub at https://github.com/PaleovirologyLab/hi-fever. Minimal reference databases, test datasets and benchmarking results are hosted on the Open Science Framework at https://osf.io/y357r. A detailed wiki is available at https://github.com/PaleovirologyLab/hi-fever/wiki, including usage instructions, parameter descriptions, and guidance on interpreting outputs. The pipeline includes a Pixi environment compatible with Conda and Apptainer containerization, and Docker images. HI-FEVER has been tested on Linux, Windows (via WSL2), and macOS (Intel and ARM64).

Software

Profiler: an open web platform for multi-omics analysis.

MOTIVATION: High-throughput multi-omics technologies produce increasingly large and heterogeneous datasets that are difficult to analyze without advanced computational expertise. Existing bioinformatics tools are often fragmented or limited to specific omics types, hindering reproducibility and accessibility. There is a critical need for an integrated, user-friendly, and scalable platform capable of supporting multi-omics analyses across different data modalities. RESULTS: We present Profiler, an open-source, modular platform that unifies data import, quality control, preprocessing, statistical testing, machine and deep learning, biomarker discovery, pathway and drug-target enrichment, and survival modeling within a single reproducible environment. Built in Python with Streamlit, Profiler is available as both a web-based platform deployed on high-performance computing and a desktop version for local execution, enabling flexible usage across computational infrastructures. Profiler supports diverse omics modalities, including proteomics, transcriptomics, lipidomics, and electroencephalogram data. Through applications to glioblastoma proteomic, pancancer, and multi-omics datasets, Profiler reproduced known molecular subtypes, revealed potential therapeutic targets, and generated fully traceable analysis reports within minutes. By integrating advanced analytics behind an intuitive interface, Profiler democratizes multi-omics analysis and provides a robust, scalable foundation for systems biology and precision medicine research. AVAILABILITY AND IMPLEMENTATION: Profiler is open-source and freely available via its web platform (https://prism-profiler.univ-lille.fr) and GitHub (web version: https://github.com/yanisZirem/Profiler_v1_requests_datatests, desktop version: https://github.com/yanisZirem/prism-profiler), and archived on Zenodo (DOI: https://doi.org/10.5281/zenodo.17478158).

Software

A scalable HPC framework for bioinformatics in resource-limited settings: design principles, implementation, and sustainability from the UVRI experience.

MOTIVATION: Building and sustaining High-Performance Computing (HPC) infrastructure for bioinformatics research in resource-limited settings presents significant technical, financial and operational challenges. Institutions in low-and middle-income regions often face constraints such as limited technical expertise, unstable infrastructure and restricted funding which can hinder the deployment of large-scale computational platforms necessary for modern genomics and bioinformatics analyses. RESULTS: We present a scalable and modular HPC framework developed at the Uganda Virus Research Institute (UVRI) to support large-scale genomics and other omics data analyses in resource-limited settings. The framework integrates open-source HPC management tools, infrastructure automation, and reproducible configuration management to enable reliable deployment and maintenance. Optimized storage and networking configurations combined with a phased capacity-building strategy support high-throughput genomic workflows while strengthening local technical expertise. From our implementation experience, we derive ten practical design and operational rules that provide a transferable methodology for establishing and sustaining in-house HPC infrastructure. These rules emphasize strategic investment in human capacity, structured planning, leveraging collaborations, adoption of open-source technologies and service management practices to improve operational resilience and long-term sustainability. AVAILABILITY: The design principles, automation strategies and implementation guidelines described in this work are applicable to institutions seeking to establish sustainable HPC resources for bioinformatics research in resource-constrained environments.

Computational Biology

Meta2DB: curated shotgun metagenomic feature sets and metadata for health state prediction.

SUMMARY: Meta2DB is a curated metagenomic and metadata database that provides structurally consistent microbiome taxonomy feature count tables for 13 897 samples across 84 studies, 23 disease states, and 34 geographical locations. All samples were uniformly processed using a streamlined metagenomic classification pipeline that employs a unique and comprehensive reference database indexed to contain all sequences across all kingdoms of life that were present in the NCBI Nucleotide (nt) database retrieved on 4 January 2023. This pipeline leverages high-performance computing (HPC) resources at Lawrence Livermore National Laboratory and was used to process 50TB of publicly available raw metagenomic sequence data. Extensive metadata curation was carried out through a combination of manual curation and automated parsing, producing a consistent inter-study metadata table specifically structured to facilitate training of ML models for prediction of human health. AVAILABILITY: Data is available at https://gdo-meta2db.llnl.gov/ and https://zenodo.org/records/17315984.

Metadata

Phylogenomic subsampling and upsampling for efficient evolutionary analyses of big data.

Long runtimes, high memory demands, and reliance on high-performance computing impede phylogenomic analyses. We review a scalable phylogenomic subsampling with upsampling (PSU) framework to address this challenge, which reduces runtime and memory requirements by orders of magnitude. In PSU, small subsamples of sites from a concatenated alignment are analyzed, which are expanded by upsampling before inference, and the resulting inferences are aggregated to obtain evolutionary estimates. PSU harnesses the fact that the computational cost of maximum likelihood analysis is strongly influenced by the number of distinct site patterns in the concatenated alignment, whereas statistical power depends primarily on the amount of evolutionary information represented by the total number of sites and substitutions. By reducing the former while restoring the latter through upsampling, PSU can approximate many full-alignment analyses at substantially lower computational cost. Analysis of simulated and empirical datasets shows that PSU can accurately estimate bootstrap support values, select the optimal substitution model, test evolutionary hypotheses, and infer branch lengths, divergence times, and associated uncertainty measures. PSU also provides distributions of inferred clade support across independent subsamples, enabling detection of conflicting phylogenetic signals that may remain hidden in conventional bootstrap analysis of concatenated alignments. Automated tuning of subsample size, the number of subsamples, and the number of upsampling replicates make PSU practical. We suggest that PSU is a general approach for scalable phylogenomic inference using a broad range of statistical methods. By enabling analyses of genome-scale alignments on commodity hardware, PSU broadens research access and reduces environmental and infrastructural costs of big-data phylogenomics.

Phylogeny

Phylogenomic subsampling and upsampling for efficient evolutionary analyses of big data.

Long runtimes, high memory demands, and reliance on high-performance computing impede phylogenomic analyses. We review a scalable phylogenomic subsampling with upsampling (PSU) framework, in which small subsamples of sites from a concatenated alignment are expanded by upsampling before inference, and the resulting analyses are then aggregated to obtain evolutionary estimates. PSU harnesses the fact that the computational cost of maximum likelihood analysis is strongly influenced by the number of distinct site patterns in the concatenated alignment, whereas statistical power depends primarily on the amount of evolutionary information represented by the total number of sites and substitutions. By reducing the former while restoring the latter through upsampling, PSU can approximate many full-data analyses at substantially lower computational cost. Analysis of simulated and empirical datasets shows that PSU can accurately estimate bootstrap support values, select the optimal substitution model, test evolutionary hypotheses, and infer branch lengths, divergence times, and associated uncertainty measures, while reducing runtime and memory requirements by orders of magnitude. PSU also provides distributions of inferred clade support across independent subsamples, enabling detection of conflicting phylogenetic signals that may remain hidden in conventional bootstrap analysis. Automated tuning of subsample size, the number of subsamples, and the number of upsampling replicates make PSU practical across diverse datasets. We suggest that PSU is a general strategy for scalable phylogenomic inference using a broad range of statistical methods. By enabling analyses of genome-scale alignments on commodity hardware, PSU broadens research access and reduces environmental and infrastructural costs of big-data phylogenomics.

confidence limits

Spatial Genomic Approaches to Investigate HOX Genes in Mouse Brain Tissues.

Spatial transcriptomic tools are an upcoming and powerful way to investigate targeted gene expression patterns within tissues. These tools offer the unique advantage of visualizing and understanding gene expression while preserving tissue integrity, thereby maintaining the spatial context of genes. Curio is a robust spatial transcriptomic tool that facilitates high throughput comprehensive spatial gene expression analysis across the entir e transcriptome with high efficiency. Here, we present a bioinformatics protocol for performing whole transcriptome gene expression analysis of mouse brain tissue using Curio. Specifically, we demonstrate using computational techniques to visualize expression patterns of various HOX genes in the mouse brain.

Animals

Semiparametric efficient estimation of small genetic effects in large-scale population cohorts.

Population genetics seeks to quantify DNA variant associations with traits or diseases, as well as interactions among variants and with environmental factors. Computing millions of estimates in large cohorts in which small effect sizes and tight confidence intervals are expected, necessitates minimizing model-misspecification bias to increase power and control false discoveries. We present TarGene, a unified statistical workflow for the semi-parametric efficient and double robust estimation of genetic effects including $ k $-point interactions among categorical variables in the presence of confounding and weak population dependence. $ k $-point interactions, or Average Interaction Effects (AIEs), are a direct generalization of the usual average treatment effect (ATE). We estimate genetic effects with cross-validated and/or weighted versions of Targeted Minimum Loss-based Estimators (TMLE) and One-Step Estimators (OSE). The effect of dependence among data units on variance estimates is corrected by using sieve plateau variance estimators based on genetic relatedness across the units. We present extensive realistic simulations to demonstrate power, coverage, and control of type I error. Our motivating application is the targeted estimation of genetic effects on trait, including two-point and higher-order gene-gene and gene-environment interactions, in large-scale genomic databases such as UK Biobank and All of Us. All cross-validated and/or weighted TMLE and OSE for the AIE $ k $-point interaction, as well as ATEs, conditional ATEs and functions thereof, are implemented in the general purpose Julia package TMLE.jl. For high-throughput applications in population genomics, we provide the open-source Nextflow pipeline and software TarGene which integrates seamlessly with modern high-performance and cloud computing platforms.

Humans

Atlas-level single-cell integration and clustering-free differential expression analysis with GEDI 2.0.

MOTIVATION: GEDI is a generative framework for multi-sample, multi-condition single-cell analysis that performs batch correction, latent representation learning, and clustering-free differential expression within a unified model. However, the original implementation suffered from prohibitive memory use and runtime, preventing its application to modern atlas-scale datasets. RESULTS: We present GEDI 2.0, a complete high-performance reimplementation featuring a standalone C++ computational core with pre-allocated workspaces, strict sparse-matrix preservation, optimized BLAS routines, and multi-threaded block-coordinate descent. Across extensive benchmarks spanning up to 500 000 cells and 10 000 features, GEDI 2.0 achieves 40%-63.6% mean reduction in peak memory, 2.98× mean single-threaded speedups, and up to 11.5× acceleration with parallel execution, while maintaining full numerical equivalence to the original method. These improvements enable GEDI 2.0 to analyze million-cell datasets, a scale not achievable with the legacy implementation. GEDI 2.0 provides R and Python interfaces and seamless interoperability with common single-cell workflows. AVAILABILITY AND IMPLEMENTATION: Source code, documentation, reproducible codebase, and tutorials are available at https://github.com/csglab/gedi2.

Single-Cell Analysis

Tracking-seq: a universal off-target detection approach for CRISPR-Cas genome editing.

Tracking-seq is a highly sensitive method for genome-wide detection of off-target effects in cells edited with diverse genome editing modalities, including Cas9, cytosine base editors, adenine base editors and prime editors. Since most genome editors induce DNA repair pathways and generate single-stranded DNA (ssDNA) intermediates, Tracking-seq leverages this process by tracking replication protein A-a key protein that binds and protects ssDNA-to identify on-target and off-target events. Here we provide a detailed protocol for Tracking-seq, covering genome editing of cells, extraction of replication protein A-bound ssDNA, sequencing library construction and data analysis using our custom computational tool Offtracker. Tracking-seq is applicable to various genome editing scenarios with low cell input, delivering high-performance results. The entire workflow, from genome editing to data analysis, can be completed within 1-2 weeks, making it a rapid solution for assessing genome-wide off-target activity.

CRISPR-Cas Systems

Advancing proteomic discovery through optimized multi-stage scoring and deep learning-enhanced open search.

MOTIVATION: Protein search engines are essential for interpreting mass spectrometry data into biological insight. Current tools often face limitations in sensitivity when analyzing complex modern datasets, and lack a unified framework that effectively integrates deep learning features for both restricted and open searches, especially for scenarios aimed at discovering unknown modifications. RESULTS: We present pFind+, a high-performance search engine for data-dependent acquisition (DDA) proteomics, extending pFind. It introduces an enhanced raw scoring that delivers substantially improved pre-filtering ability, while recovering most of the computational overhead through a tailored acceleration strategy. Coupled with an enhanced rescoring framework that effectively integrates deep learning features, pFind+ uniquely supports high-sensitivity, DL-enhanced open search, enabling comprehensive PTM discovery while incorporating hardware-aware inference optimizations for practical deployment. Evaluations across diverse datasets demonstrate its superior sensitivity, with gains of 12.7%-29.3% (average 17.9%) in restricted search and 8.0%-38.4% (average 25.8%) in open search over the best existing tools.

Deep Learning

An automated geometric modeling framework in GATE for the design and optimization of high-sensitivity converging-beam SPECT collimators.

Objective.The trade-off between detection sensitivity and spatial resolution is a fundamental challenge in designing organ-dedicated Single-photon emission computed tomography (SPECT) collimators. While converging-hole geometries offer a solution, their optimization is often hindered by the lack of flexible computational tools capable of modeling large-scale, non-parallel hole arrays. This study aims to develop an automated geometric modeling framework to facilitate the design and evaluation of complex converging- and diverging-hole collimators within standard Monte Carlo environments.Approach.We developed a specialized modeling framework by implementing custom C++ classes and a vector-based alignment algorithm within GATE. This platform enables automated, orientation-consistent construction of large-scale converging arrays not natively supported by standard implementations. A high-sensitivity pure cone-beam collimator (CBC) was designed using this framework. The evaluation used hot-rod, disc, and Jaszczak phantoms for physical characterization, while XCAT and dedicated brain models were employed for clinical tasks, including cardiac, brain perfusion, and DaTscan SPECT simulations.Main results.The CBC achieved a nearly fourfold sensitivity increase compared to a conventional low-energy high-resolution parallel-hole collimator at a 20 cm radius of rotation, while maintaining comparable spatial resolution. Despite a 52.3% field of view reduction, the CBC yielded a 2.2-fold noise reduction (CV: 11.7% vs 25.9%) and mitigated partial volume effects via geometric magnification. XCAT and brain phantom simulations confirmed enhanced anatomical definition and contrast recovery in cardiac, perfusion, and DaTscan tasks.Significance.This work provides an efficient computational tool for rapid design space exploration of advanced collimator geometries. The results demonstrate that the proposed CBC design offers a significant sensitivity advantage, making it highly suitable for high-performance, small-volume clinical applications such as brain and cardiac molecular imaging.

Tomography, Emission-Computed, Single-Photon

Odon: an ultra-fast viewer for spatial proteomics.

MOTIVATION: Multiplexed spatial proteomics and spatial transcriptomics generate large, high-dimensional imaging datasets that are challenging to visualize efficiently, particularly at whole-slide and cohort scale. Visualization is an essential step for rapid detection of staining artefacts, such as protein aggregates or non-specific staining. RESULTS: Here, we present Odon, a native Rust desktop viewer designed for rapid, interactive exploration of multiplex imaging data on a standard laptop. Odon is primarily built around the OME-Zarr imaging format, and supports annotations via GeoJSON and GeoParquet, with secondary support for SpatialData, Xenium containers, and TIFF. Data can be stored locally or streamed directly from HTTP or S3-compatible object storage using viewport-driven tile loading. Odon incorporates a highly optimized rendering engine designed for viewport-driven tile loading and GPU-based compositing. In scripted benchmarks using synthetic multiplex OME-Zarr datasets, Odon showed lower peak memory use, lower affine-derived zoom-step error, and faster warm-start image loading than napari and QuPath under the tested conditions. Its GPU-based compositing pipeline also enables smooth rendering and interaction with >1 000 000 segmented cells. Odon further supports integrated visual analytics, including live thresholding and cell selection, and a mosaic mode for simultaneous viewing of hundreds of regions of interest in cohort and tissue microarray studies. Together, these features establish Odon as a high-performance platform for scalable visualization of spatial proteomics data. AVAILABILITY AND IMPLEMENTATION: Source code and compiled installers are available at https://github.com/alexcoulton/odon.

Proteomics

A study on the directed engineering and multiple transformations of cannabidiolic acid synthase to enhance the expression level of the recombinant enzyme.

To increase the activity of cannabidiolic acid synthase (CBDAS) and its expression levels in yeast, this study focused on the CBDASG183V-N482W mutant. Using computer-aided techniques and literature reviews, four mutation sites were further identified, resulting in the mutant CBDASH114E-S116A-C176Y-G183V-N328Q-N482W. The CBDAS gene was integrated into the Pichia pastoris genome via multiple transformation rounds, and relative enzyme activity was analyzed using high-performance liquid chromatography. The results of the molecular docking analysis revealed factors such as increased intermolecular forces, shorter bond lengths, and an increased number of amino acid-substrate interaction sites, which may have contributed to the enhanced catalytic activity of the mutant. The concentrations of CBDA and CBD produced by the CBDASH114E-S116A-C176Y-G183V-N328Q-N482W mutant were 71.543 ng/mL and 75.163 ng/mL, respectively, which were 11.87% and 11.53% greater than those produced by the CBDASG183V-N482W mutant. The recombinant CBDAS strain obtained after two consecutive transformations of the CBDASH114E-S116A-C176Y-G183V-N328Q-N482W vector presented the highest CBDAS expression levels and CBD and CBDA yields; compared with those obtained after a single transformation, the CBDA and CBD yields increased by 9.77% and 12.65%, respectively. In addition, the tolerance of the recombinant strain to induction culture conditions was analyzed, revealing that the strain could be induced to express the protein at temperatures ranging from 20 to 45 °C and at pH values ranging from 3 to 9, with optimal expression observed at 30 °C and pH 6. These findings provide theoretical and technical support for the production of enzyme preparations for the in vitro-directed biosynthesis of cannabidiol.

Molecular Docking Simulation

CaXML: Chemistry-informed machine learning explains mutual changes between protein conformations and calcium ions in calcium-binding proteins using structural and topological features.

Proteins' flexibility is a feature in communicating changes in cell signaling instigated by binding with secondary messengers, such as calcium ions, associated with the coordination of muscle contraction, neurotransmitter release, and gene expression. When binding with the disordered parts of a protein, calcium ions must balance their charge states with the shape of calcium-binding proteins and their versatile pool of partners depending on the circumstances they transmit. Accurately determining the ionic charges of those ions is essential for understanding their role in such processes. However, it is unclear whether the limited experimental data available can be effectively used to train models to accurately predict the charges of calcium-binding protein variants. Here, we developed a chemistry-informed, machine-learning algorithm that implements a game theoretic approach to explain the output of a machine-learning model without the prerequisite of an excessively large database for high-performance prediction of atomic charges. We used the ab initio electronic structure data representing calcium ions and the structures of the disordered segments of calcium-binding peptides with surrounding water molecules to train several explainable models. Network theory was used to extract the topological features of atomic interactions in the structurally complex data dictated by the coordination chemistry of a calcium ion, a potent indicator of its charge state in protein. Our design created a computational tool of CaXML, which provided a framework of explainable machine learning model to annotate ionic charges of calcium ions in calcium-binding proteins in response to the chemical changes in an environment. Our framework will provide new insights into protein design for engineering functionality based on the limited size of scientific data in a genome space.

Machine Learning

Columba: fast approximate pattern matching with optimized search schemes.

MOTIVATION: Aligning sequencing reads to reference genomes is a fundamental task in bioinformatics. Aligners can be classified as lossy or lossless: lossy aligners prioritize speed by reporting only one or a few high-scoring alignments, whereas lossless aligners output all optimal alignments, ensuring completeness and sensitivity. RESULTS: This paper introduces Columba, a high-performance lossless aligner tailored for Illumina sequencing data. Columba processes single or paired-end reads in FASTQ format and outputs alignments in SAM format. By utilizing advanced search schemes and bit-parallel alignment techniques, Columba achieves exceptional speed. Columba is available in two variants. The first, based on the bidirectional FM-index, prioritizes speed. The second, Columba RLC, uses run-length compression using a bidirectional move structure, significantly reducing memory usage for large, repetitive datasets like pan-genomes. Benchmarks on the human genome, as well as bacterial and human pan-genome datasets, demonstrate that Columba is much faster than existing lossless aligners and even competitive with lossy tools. We integrated Columba into the OptiType HLA genotyping pipeline, where it substantially reduced computational time while maintaining accuracy. These results position Columba as a versatile, state-of-the-art tool for high-sensitivity genomic analyses. AVAILABILITY AND IMPLEMENTATION: The source code of Columba is available at https://github.com/biointec/columba under AGPL license. Scripts to reproduce the benchmarks and analyses are available at https://doi.org/10.5281/zenodo.15849246.

Software

Vcfexpress: flexible, rapid user-expressions to filter and format VCFs.

MOTIVATION: Variant call format (VCF) files are the standard output format for various software tools that identify genetic variation from DNA sequencing experiments. Downstream analyses require the ability to query, filter, and modify them simply and efficiently. Several tools are available to perform these operations from the command line, including BCFTools, vembrane, slivar, and others. RESULTS: Here, we introduce vcfexpress, a new, high-performance toolset for the analysis of VCF files, written in the Rust programming language. It is nearly as fast as BCFTools, but adds functionality to execute user expressions in the lua programming language for precise filtering and reporting of variants from a VCF or BCF file. We demonstrate performance and flexibility by comparing vcfexpress to other tools using the vembrane benchmark. AVAILABILITY AND IMPLEMENTATION: vcfexpress is available under the MIT license at https://github.com/brentp/vcfexpress with code used for the manuscript deposited in https://doi.org/10.5281/zenodo.14756838.

Software