Skip to content

2026 usrse duct poster - #10

Draft
asmacdo wants to merge 23 commits into
con:masterfrom
asmacdo:2026-usrse-duct-poster
Draft

2026 usrse duct poster#10
asmacdo wants to merge 23 commits into
con:masterfrom
asmacdo:2026-usrse-duct-poster

Conversation

@asmacdo

@asmacdo asmacdo commented May 28, 2026

Copy link
Copy Markdown
Member

asmacdo and others added 12 commits August 3, 2026 13:56
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
…-draft.md)

- Add Connection-to-Mission section (~245 words).
- One sentence per line.
- Remove all em-dashes and semicolons per author preference.
- Rewrite -e bullets as verb-form clauses.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
- Drop opening "provenance" frame; lead with capture-then-retrieve
- Add dev/explore vs research-output beats
- Drop three failure-mode bullets
- Merge HPC SLURM-sizing claim into research beat
- Move ds000007-mriqc example next to ls/DataLad paragraph
- Add inline credit + logs/duct/ URL for Hoffstaedter
- Add MRIQC one-line context for non-neuro audience
- Fix mriqc/fmriprep mismatch in example
- Fix "resources used" plural

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
- Acknowledgments: credit brainlife's smon (resource-monitoring origin)
- References: drop fmriprep, sfn-2025 demo, intro-duct-tion blog,
  ReproNim/ReproMan (related work not cited in prose)
- References: drop Halchenko author attribution from DataLad
  (community project, not single-author), add DataLad RRID
- References: renumber 1-4, drop "candidates below" header

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
- Add origin story: built for provenance, dev-side was unexpected bonus
- Replace "current research-software work" with explicit "AI amplifies"
  framing (more context, faster pace, parallel streams)
- Drop colons throughout the section

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Lead with the provenance case, then the dev/agent payoff.
State arbitrary-command passthrough outright; correct env capture
to scheduler-only and process group to process tree; add platform
and measurement-accuracy honesty; trim AI disclosure to what IEEE
requires; drop the weak amplification line in the connection section.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
One property, four story panels (provenance, SLURM sizing,
agent-led-but-auditable, bug-report-without-rerun), honesty box,
asset checklist. All proposed pending the accepted-poster format.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
441 words, at parity with the sibling STAMPED draft.
Move deep dataset URL into ref [4], cite [1]/[4] inline, and say
'reconstruct' (not 'reproduce') for the post-hoc resource picture.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
The drafts carry their real titles as H1s; the injected
filename-based \maketitle duplicated it and cost ~1in of page 1.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Bulleted capture mechanics; introduce -m at the ls example where
it is motivated; keep environment claim intentionally scoped-vague
(system and environment details); rework the context-cost sentence.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@asmacdo
asmacdo force-pushed the 2026-usrse-duct-poster branch from ada5083 to b1a3630 Compare August 3, 2026 20:55
asmacdo and others added 9 commits August 3, 2026 16:03
Move the ds000007-mriqc showcase to the poster (layout doc Case 1);
bold lead-ins for the three beats (research / daily work / failed
job); questions back to prose so only two bullet lists remain.
327 words; Makefile render now breaks at Acknowledgments.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Problem beat ends on the vanishing record; identity gets its own
crisp sentence; the trace bullets become the how.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Standard-library Python stays; platform claims leave the abstract
(honesty box in the layout plan keeps POSIX/macOS-ps specifics).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

@leej3 leej3 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I feel it sells too hard. I am immediately curious how it compares to tools with overlapping functionality, across the spectrum from lightweight command history and measurement (history, Atuin, time, script, psrecord), through scheduler and experiment accounting (sacct, MLflow, Sacred, Weights & Biases), to heavier provenance and workflow systems (DataLad, ReproZip, noWorkflow, Snakemake, Nextflow). My pitch would be that con/duct occupies a lightweight middle ground between shell history and a full workflow or experiment-tracking system. Pointing out its position on that spectrum would help people understand the effort/value payoff. For example:

Unlike shell history, con/duct retains output and a sampled resource timeline; unlike scheduler accounting and workflow trackers, it can be applied consistently to an ad hoc local command; unlike deeper provenance systems, it produces a small, human-readable execution record.

Some claims may be a bit too strong... AI thoughts on this below in case it is helpful:

  • Shell pipelines do not run unchanged as duct . The implementation uses subprocess.Popen() without a shell, so a pipeline requires something like duct sh -c 'a | b'.

  • “Every wrapped run leaves a complete trace” and “lists every failure” conflict with the default --fail-time 3.0, which removes the logs for commands that fail in under three seconds.

  • Monitoring is based on a POSIX session and periodic ps sampling, rather than an unconditional capture of the entire process tree. Detached descendants and resource spikes between samples can be missed.

  • The SLURM-sizing story should acknowledge that sacct already provides scheduler-native resource accounting. Con/duct’s value there may be its immediate, portable timeline and association with stdout/stderr, as a complement to scheduler accounting rather than a replacement.

  • Since the title emphasizes “agent-friendly,” it would help to show what is specifically agent-oriented. At present this appears to be a useful convention—agents wrap and later query commands—rather than a dedicated agent integration.

asmacdo and others added 2 commits August 4, 2026 11:12
One positioning line (no tool survey); 'nearly anything' absorbs
pipeline/tty exceptions; drop 'Every' and 'every failure' since
default fail-time removes logs of fast failures.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@asmacdo

asmacdo commented Aug 4, 2026

Copy link
Copy Markdown
Member Author

@leej3 Thanks for the review!

I think the "middleground between shell history and workflow systems" is the right balance, I've adapted that and added.
For the other limitations, I've only softened the language. Earlier drafts had exceptions and limitations spelled out, but it was too much for an abstract. (I have some explicit limitations that I'll include for the poster since I'll have more room)

I agree that it was selling too hard, do you think my softening does enough?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

US RSE 2026: con/duct poster

3 participants