Introduction

The Benchmarking Special Interest Group provides a centralized home within nf-core for performance and accuracy testing across all bioinformatics workflows. While initiated by the development of the nf-core/variantbenchmarking pipeline, this group expands the scope to include any type of method comparison, validation, or resource efficiency study.

Core Objectives

• Software Development: Modularizing benchmarking components in nf-core so other developers can easily plug-and-play validation steps into their pipelines.
• Community Needs Forum: Identifying what researchers need to compare (ranging from metagenomics and spatial transcriptomics to drug response prediction) and prioritizing tool development accordingly.
• Network Syntonization: Keeping nf-core aligned with external benchmarking standards and platforms like NCBench, openEBench, and Open Problems in Single-Cell Analysis.

Activities

Activities will involve monthly meetings with pre-selected topics and a presentation for an in-depth discussion. Suggestions and feedback are welcome for anyone and everyone!