diff --git a/.pre-commit-config.yaml b/.pre-commit-config.yaml new file mode 100644 index 0000000..f394726 --- /dev/null +++ b/.pre-commit-config.yaml @@ -0,0 +1,6 @@ +repos: +- repo: https://github.com/TurtleTech-ehf/snapper + rev: v0.9.1 + hooks: + - id: snapper + files: ^2026-usrse/stamped-abcd-poster-draft\.md$ diff --git a/2026-usrse/Makefile b/2026-usrse/Makefile index c5c9c3d..d1cf654 100644 --- a/2026-usrse/Makefile +++ b/2026-usrse/Makefile @@ -65,6 +65,10 @@ PDF_LATEX_OPTS := --to pdf \ -V toccolor=darkgreen \ -V 'header-includes=\definecolor{darkblue}{HTML}{00008B}\definecolor{darkgreen}{HTML}{006400}' +# This draft is longer than the one-page abstract template; keep this +# adjustment scoped to this document rather than changing shared defaults. +stamped-abcd-poster-draft.pdf: PDF_LATEX_OPTS := $(subst fontsize=11pt,fontsize=10pt,$(PDF_LATEX_OPTS)) + # PDF via HTML (wkhtmltopdf / weasyprint) — same look as the HTML render PDF_HTML_OPTS := --to html5 --css=https://cdn.jsdelivr.net/npm/water.css@2/out/water.css diff --git a/2026-usrse/stamped-abcd-poster-draft.md b/2026-usrse/stamped-abcd-poster-draft.md new file mode 100644 index 0000000..f2b01e5 --- /dev/null +++ b/2026-usrse/stamped-abcd-poster-draft.md @@ -0,0 +1,72 @@ +# STAMPED in Practice: Reproducing a Scientific Result on ABCD Neuroimaging Study + +## Authors + +- John A. Lee , Dartmouth College, ORCID 0000-0001-5884-4247 +- Austin Macdonald , Dartmouth College, ORCID 0000-0002-8124-807X +- Yaroslav O. Halchenko , Dartmouth College, ORCID 0000-0003-3456-2493 + +## Keywords + +STAMPED, reproducibility, research objects, neuroimaging, provenance, AI-assisted science + +## Abstract + +RSEs routinely encounter computational analyses whose code is available but whose data, parameters, software environments, execution context, and provenance are difficult to reconstruct. +This missing context makes analyses harder to review, maintain, transfer, and extend. +AI-assisted tools can accelerate development, testing, and documentation, but their high-volume, nondeterministic output further complicates these tasks and heightens the need for explicit context and reviewable intermediate states. +STAMPED (https://stamped-principles.org) defines seven properties for organizing these materials as a durable and more useful research object [1]. +The framework complements the established FAIR (Findable, Accessible, Interoperable, and Reusable) principles by focusing on the organization and execution of computational research objects [7]. + +This poster presents our application of STAMPED to an existing analysis presented at OHBM 2025 on age-dependent bias in cortical morphometry tools using Adolescent Brain Cognitive Development (ABCD) Study data (https://abcdstudy.org) [3]. +We use the principles to guide improvements to the research object surrounding the analysis [2]. +We use AI extensively in development, testing, and documentation, making the reconstruction a practical test of the STAMPED vision for AI-assisted research. + +Following a review of the original analysis, we use a coordinated set of tools to improve the research object across the seven properties: DataLad and git-annex for composition and versioned state [4]; Git, DataLad run records, con-duct, and NIDM/PROV for provenance [4,6]; tested BIDS Apps and Pixi tasks for executable interfaces [5]; Apptainer, BABS, and Slurm for portable, fresh execution [5]; and persistent Git/annex siblings with separate access boundaries for distribution [4]. +We show how these tools work in concert to make the data, environments, operations, and results more identifiable, executable, modular, portable, reviewable, and retrievable. + +Collectively, the decisions on how to implement the principles provide a worked example of how to use STAMPED to guide choices about research-object boundaries, provenance, execution, validation, and distribution. +The poster reports the practical details of this process—the effort and judgment required, problems encountered, tradeoffs made, evidence produced, and interactions among principles and tools—and invites RSEs to consider which parts apply to their own shared or domain-specific challenges. +Although we demonstrate the approach through a scientific reproduction, such an effort is more convenient if integrated from the start of the analysis. + +The poster reports the practical details of this process: the effort and judgment required, problems encountered, tradeoffs made, evidence produced, and interactions among principles and tools. +In doing so, it shows why these practices are easier to incorporate during study design than to add retrospectively. +It invites RSEs to compare these experiences with their own shared or domain-specific challenges. + +```{=latex} +\newpage +``` + +## Acknowledgments + +We thank the authors of the STAMPED principles and the developers and communities behind DataLad, BIDS, BABS, ReproNim, NIDM, Pixi, Apptainer, and `con-duct`. + +AI-assisted content disclosure: This submission was prepared with assistance from OpenAI Codex (GPT-5, accessed August 2026). +The system helped synthesize repository evidence and draft the Abstract and Connection to Mission sections. +The authors reviewed the source evidence, edited the text, and remain responsible for all claims. + +## References + +1. Macdonald A, Baker CC, To I, Halchenko YO; *STAMPED principles for reproducible research objects*; May 2026; [preprint](https://github.com/stamped-principles/stamped-paper) + +2. Lee JA; *STAMPED-dl_morphometrics_biases: an ideal-oriented reconstruction of a neuroimaging analysis*; 2026; [repository](https://github.com/STAMPED-dl-morphometrics-biases/STAMPED-dl_morphometrics_biases) + +3. Nielson DM, Lee JA, Earl E, Moraczewski D, Pereira F; *Age dependent volume estimation biases in recon-all clinical and recon-any*; OHBM 2025 poster; [doi:10.17605/OSF.IO/P3KNS](https://doi.org/10.17605/OSF.IO/P3KNS) + +4. Halchenko YO, et al.; DataLad: distributed system for joint management of code, data, and their relationship; *Journal of Open Source Software*; 2021;6(63):3262; [doi:10.21105/joss.03262](https://doi.org/10.21105/joss.03262) + +5. Zhao C, et al.; A reproducible and generalizable software workflow for analysis of large-scale neuroimaging data collections using BIDS Apps; *Imaging Neuroscience*; 2024;2:imag-2-00074; [doi:10.1162/imag_a_00074](https://doi.org/10.1162/imag_a_00074) + +6. Center for Open Neuroscience; *con-duct: a lightweight wrapper for monitoring command execution*; RRID:SCR_025436; [repository](https://github.com/con/duct) + +7. Wilkinson MD, Dumontier M, Aalbersberg IJ, et al.; *The FAIR Guiding Principles for scientific data management and stewardship*; *Scientific Data*; 2016;3:160018; [doi:10.1038/sdata.2016.18](https://doi.org/10.1038/sdata.2016.18) + +## Connection to Mission, Goals, & Interests of US-RSE Community + +Research software engineers help determine whether a computational result is merely produced once or becomes a durable scientific contribution. +STAMPED gives RSEs and researchers a shared vocabulary for the properties that make this difference: coherent research-object boundaries, exact identities, executable procedures, independent components, explicit environments, clean execution, and persistent distribution [1]. +This poster grounds that vocabulary in a practical implementation, showing how RSE decisions about provenance, execution, validation, and distribution shape the reviewability and reuse of computational research across domains. + +The project also addresses the conference theme, “Advancing Science in the Age of AI,” by shifting attention from what AI can do to what evidence AI-assisted work leaves behind. +The poster invites RSEs to compare how their teams bound context, record decisions, divide work between automation and human reviewers, and evaluate AI-assisted outputs. +These comparisons can help identify shared expectations for reviewing AI-assisted research and inform longer-term community and institutional practices. diff --git a/2026-usrse/stamped-princples.md b/2026-usrse/stamped-princples.md new file mode 100644 index 0000000..4e00c63 --- /dev/null +++ b/2026-usrse/stamped-princples.md @@ -0,0 +1,37 @@ +# Pragmatic practices for reproducible and open science through case stories and principles + + +## Presenters + +Cody C.Baker , Center for Open Neuroscience, Dartmouth College, 0000-0002-0829-4790 + + +## Keywords + +Reproducible research - Open science - Provenance + +## Abstract + +Neuroscience increasingly depends on the interplay of code, data, and computational environments, yet the record of how they were used together is often incomplete, scattered across repositories, wikis, and notebooks, or lost entirely. +This fragmentation undermines rigor, reproducibility, reusability, and efficiency in BRAIN Initiative pipelines that routinely span multiple institutions, archives, and compute platforms. +Existing frameworks such as FAIR and FAIR4RS govern discovery and interoperability of digital objects, but do not specify how research objects should be structured and managed so they can be re-executed, extended, and audited. +The community lacks a shared vocabulary for this operational layer. + +Building on the YODA and VAMP traditions from neuroimaging, and on patterns that have independently converged across geophysics, genomics, statistics, and neuroimaging over three decades, we formalize seven principles a research object should satisfy: Self-containment, Tracking, Actionability, Modularity, Portability, Ephemerality, and Distributability, collectively STAMPED. +Each spans a spectrum from practical minimum to aspirational ideal, so adoption is non-prescriptive and incremental. +Formal LinkML schemas, an interactive compliance checklist, and the curated collection of examples are provided as enabling tools to this end. + +We demonstrate STAMPED through two major neuroscience pipelines. +OpenNeuroDerivatives reorganized derivative neuroimaging datasets so they exist as independent Ephemeral units that reference raw inputs as subdatasets rather than nesting under them, removing an upward dependency that previously violated Self-containment, Modularity, and Portability. +DANDI Compute, utilizing the Allen Institute for Neural Dynamics electrophysiology pipeline, packages spike-sorting outputs into nested BIDS-derivative units in which each leaf contains the exact code, runtime logs, outputs, and provenance metadata needed to re-execute the analysis, satisfying STAMPED end-to-end. + +These adoptions show that STAMPED provides a tool-agnostic, incrementally adoptable vocabulary that lets researchers, reviewers, collaborators, and emerging AI agents evaluate and improve the operational maturity of computational neuroscience. +By making research objects re-executable and inspectable by construction, STAMPED converts reproducibility from an aspiration into a measurable property of everyday neuroscience practice. + +## References + +Austin Macdonald, Cody Baker, Isaac To, Yaroslav O. Halchenko, “STAMPED principles for reproducible research objects”, 26-May-2026. [Online]. Available: osf.io/preprints/metaarxiv/f3h82_v1. +Michelle Barker, et al. Introducing the FAIR Principles for research software. Scientific Data, 9(1):622, October 2022. ISSN 2052-4463. +Michael Hanke, et al. YODA: YODA’s organigram on data analysis, 2018. Slides. +Alessio P Buccino, Arjun Sridhar, David Feng, Karel Svoboda, Joshua H Siegle (2026). Efficient and reproducible pipelines for spike sorting large-scale electrophysiology data. eLife, 15:RP110170. +Michael Hanke. What is DataLad and what can it do for you? 2023. https://files.inm7.de/mih/pres/talks/whatisdatalad_2023.html#/