Add sandbox capabilities matrix benchmark and weekly workflow - #321

Open

kisernl wants to merge 11 commits into

devin/sandbox-capabilities-benchmark

Commits on Aug 14, 2026

Add sandbox capabilities matrix benchmark

devin-ai-integration[bot]
and
kisernl
committed
732e8a2
Aggregate per-iteration capability matrices deterministically

devin-ai-integration[bot]
and
kisernl
committed
3465cb8
feat: add sandbox capabilities matrix workflow

devin-ai-integration[bot]
and
kisernl
committed
68a8cae
fix(workflow): use frozen lockfile and provider-scoped vault secrets

devin-ai-integration[bot]
and
kisernl
committed
6373957
fix(workflow): quote dispatch inputs, use pnpm exec, split permissions, avoid empty KEYS regex

devin-ai-integration[bot]
and
kisernl
committed
246bd5d
ci: harden sandbox-capabilities workflow

devin-ai-integration[bot]
and
kisernl
committed
f9e5a32
ci: pin pnpm/action-setup to v4.4.0 SHA

devin-ai-integration[bot]
and
kisernl
committed
5060185
ci: revert pnpm/action-setup pin to v4 tag SHA

devin-ai-integration[bot]
and
kisernl
committed
7d292ed
ci: avoid template injection by passing inputs via env vars

devin-ai-integration[bot]
and
kisernl
committed
a8fd05d
ci: remove unneeded vault and id-token permissions from collect job

devin-ai-integration[bot]
and
kisernl
committed
6dff240
Merge master into sandbox-capabilities-benchmark (keep schedule)

devin-ai-integration[bot]
and
kisernl
committed
b187a14