pat-s
c072b780b2
feat(rebuild): shard the weekly rebuild and make each shard resumable
...
Split every OS/arch row of weekly-rebuild-missing into three shards and move
the build loop out of the inline R one-liner into local/rebuild-missing.R.
A shard re-derives its outstanding set from the bucket on every start: an
object whose ETag equals CRAN's published MD5sum is still a source fallback and
needs building. That is bincraft's check_s3_root_package() evaluated in bulk,
so a restart resumes rather than replaying thousands of per-package HEADs, and
it stays correct when a sibling shard or a process-updates run finishes work in
the meantime. No progress file, no volume, no database cursor.
Give each shard a 20h wall-clock budget so it exits cleanly instead of having
to be killed. A kill matches neither success nor failure, which is how pipeline
10910 skipped its CDN purge and left ~4600 rebuilt binaries behind stale edge
copies.
Move re-indexing and the purge into weekly-rebuild-reindex.yaml, which depends
on the rebuild and runs on success or failure. Three shards writing one slot's
PACKAGES concurrently would race: update_PACKAGES lists the live bucket, so an
early lister that uploads last publishes an index missing its siblings' work.
2026-08-12 08:27:45 +00:00
..
patches
fix(patches): force RcppParallel to use its bundled oneTBB ( #146 )
2026-07-31 09:48:41 +00:00
tests
feat(rebuild): shard the weekly rebuild and make each shard resumable
2026-08-12 08:27:45 +00:00
archive-missed-pkgs.R
feat: R-minor-sensitive binary builds (full + iterative) ( #84 )
2026-06-14 08:04:40 +00:00
build-all.R
refactor: migrate package installation from pak to uvr ( #147 )
2026-07-31 12:19:26 +00:00
build-one.R
feat: patch registry + wiring for per-package patching ( #103 )
2026-06-30 08:50:19 +00:00
check-cdn-cache.sh
add alpine321 to scripts
2024-12-29 10:18:55 +01:00
check-NA.R
feat: R-minor-sensitive binary builds (full + iterative) ( #84 )
2026-06-14 08:04:40 +00:00
debug-packages-writing.R
feat: R-minor-sensitive binary builds (full + iterative) ( #84 )
2026-06-14 08:04:40 +00:00
dedupe-audit-issue.R
fix(audit): replace arch subsection in place instead of appending duplicates ( #138 )
2026-07-21 08:51:23 +00:00
detect-duplicates.R
feat: R-minor-sensitive binary builds (full + iterative) ( #84 )
2026-06-14 08:04:40 +00:00
excluded-packages.json
feat: R-minor-sensitive binary builds (full + iterative) ( #84 )
2026-06-14 08:04:40 +00:00
failing-builds-classify.R
feat(local): aggregate blocked-on-dependency reporting by dependency ( #131 )
2026-07-16 21:24:03 +00:00
failing-builds-report.R
feat(local): detect dependency-cascade failures generally, not just RcppParallel ( #128 )
2026-07-16 08:23:54 +00:00
fetch-rebuild-packages-from-issue.R
fix(audit): replace arch subsection in place instead of appending duplicates ( #138 )
2026-07-21 08:51:23 +00:00
find-R-api-packages.sh
chore(local): add S3 migration and CRAN-source helper scripts
2026-06-14 13:02:48 +02:00
install-bincraft.R
refactor: migrate package installation from pak to uvr ( #147 )
2026-07-31 12:19:26 +00:00
label-removed-cran-packages.R
feat: R-minor-sensitive binary builds (full + iterative) ( #84 )
2026-06-14 08:04:40 +00:00
last-processed-by-platform.R
feat: R-minor-sensitive binary builds (full + iterative) ( #84 )
2026-06-14 08:04:40 +00:00
migrate-s3-hetzner-to-backblaze.sh
chore(local): add S3 migration and CRAN-source helper scripts
2026-06-14 13:02:48 +02:00
missing-cran-packages-db.R
feat: R-minor-sensitive binary builds (full + iterative) ( #84 )
2026-06-14 08:04:40 +00:00
missing-cran-packages.R
feat: R-minor-sensitive binary builds (full + iterative) ( #84 )
2026-06-14 08:04:40 +00:00
missing-packages-in-index.R
feat: R-minor-sensitive binary builds (full + iterative) ( #84 )
2026-06-14 08:04:40 +00:00
packages-to-build.R
fix(build): keep source fallbacks out of the S3 package cache ( #159 )
2026-08-09 16:27:51 +00:00
packages-without-any-binary.R
feat: R-minor-sensitive binary builds (full + iterative) ( #84 )
2026-06-14 08:04:40 +00:00
proposal-tracking-lib.R
feat(local): aggregate blocked-on-dependency reporting by dependency ( #131 )
2026-07-16 21:24:03 +00:00
proposal-tracking.R
feat(local): aggregate blocked-on-dependency reporting by dependency ( #131 )
2026-07-16 21:24:03 +00:00
propose-patches.R
feat(local): aggregate blocked-on-dependency reporting by dependency ( #131 )
2026-07-16 21:24:03 +00:00
query-pkgs-without-old-versions.R
chore(local): add S3 migration and CRAN-source helper scripts
2026-06-14 13:02:48 +02:00
r-minor-helpers.R
refactor: migrate package installation from pak to uvr ( #147 )
2026-07-31 12:19:26 +00:00
rebuild-missing-helpers.R
feat(rebuild): shard the weekly rebuild and make each shard resumable
2026-08-12 08:27:45 +00:00
rebuild-missing.R
feat(rebuild): shard the weekly rebuild and make each shard resumable
2026-08-12 08:27:45 +00:00
repair-built-stamp.R
fix(index): add a slot repair for a broken Built stamp and retire alpine 3.21 ( #150 )
2026-08-07 09:15:04 +00:00
test-package-loading.R
refactor: migrate package installation from pak to uvr ( #147 )
2026-07-31 12:19:26 +00:00
trial-build-patch.R
fix(local): make trial-build-patch.R detect non-throwing build failures ( #134 )
2026-07-18 08:37:04 +00:00
trial-build-registry.R
fix(local): make the trial-build gate detect non-throwing build failures ( #130 )
2026-07-16 08:24:03 +00:00
uvr-install.sh
chore(deps): update dependency nbafrank/uvr to v0.4.6
2026-08-11 00:31:56 +00:00
validate-patches.R
feat(local): auto-propose registry patches and track the feedback loop ( #117 )
2026-07-14 15:03:24 +00:00
weekly-missing-binaries-audit.R
fix(audit): count a source fallback as a missing binary ( #157 )
2026-08-09 10:37:41 +00:00