Repository files (latest commit first)

Filename	Latest commit message	Latest commit date
pat-s e23bd3e539 perf: seed pure-R binaries into a new slot, interleave shards, and stop builds before the timeout (#242) ... Speeds up the full rebuild for a new slot, e.g. the upcoming Alpine version. ## Changes - **Seed pure-R binaries** (`local/seed-pure-r.R`, `local/seed-helpers.R`), opt-in via the new `SEED_FROM` variable on `build-all-versions-install-deps`. About 74% of the ~84k candidate versions have no compiled code and cost ~20s each to build; their R objects are identical across slots. Before the build list is computed, each donor candidate is downloaded and verified, then copied server-side: - donor must be the same OS family and arch; - DESCRIPTION has `Built` (not a CRAN source fallback) with an empty platform and no `libs/`; - built by the target's primary R minor; - bincraft's `tarball_abi_verdict()` calls it portable across every installed minor (unknown means no seed). Each copy gets the `single_builds` and `abi_flat_safety` rows an upload writes, so build-all skips it and the per-minor indexes keep it. Re-runs skip existing objects and rewrite rows idempotently. - **Interleaved shards** in `local/build-all.R` via `shard_slice()`; contiguous alphabetical quarters ranged from 0.1h to 28h. - **Shared build deadline**: `build-all-versions` sets `BUILD_DEADLINE` from `BUILD_BUDGET_HOURS` (44h, repo timeout 50h); `build-all.R` and `build-newer-r.R` stop cleanly when it passes, so archiving still runs. - `codename_platform()` replaces the hard-coded codename-to-platform list. ## Testing - New unit tests for the seed verdict, candidate filter, platform names and deadline; all `local/tests` pass. - Verdicts checked on real amd64/alpine324 tarballs: R6 2.6.1/2.5.1 and jsonstat seeded, cli refused as compiled. - `crow lint .crow/` passes. - The seed has not run against B2/Postgres yet; the first bootstrap run is its end-to-end test. ## Usage Trigger `build-all-versions` with `target_arch`, `OS`, `OS_VERSION` and `SEED_FROM="alpine324 alpine323"`. The new Alpine version still needs adding to the `OS_VERSION` options once its image exists. Reviewed-on: #242		2026-10-24 02:04:06 +00:00
..
patches	fix(patches): cover every RcppParallel 6.x release with the bundled-TBB patch (#228)	2026-10-04 07:35:01 +00:00
tests	perf: seed pure-R binaries into a new slot, interleave shards, and stop builds before the timeout (#242)	2026-10-24 02:04:06 +00:00
archive-missed-pkgs.R	feat: R-minor-sensitive binary builds (full + iterative) (#84)	2026-06-14 08:04:40 +00:00
backfill-abi-classification.R	fix(ci): pass the metadata DB to per-minor reindexes and fail on errors (#234)	2026-10-17 07:46:09 +00:00
backfill-flat-safety.R	fix(abi): inspect flat objects of packages CRAN has removed (#212)	2026-09-09 18:35:33 +00:00
build-all.R	perf: seed pure-R binaries into a new slot, interleave shards, and stop builds before the timeout (#242)	2026-10-24 02:04:06 +00:00
build-newer-r.R	perf: seed pure-R binaries into a new slot, interleave shards, and stop builds before the timeout (#242)	2026-10-24 02:04:06 +00:00
build-one.R	fix(ci): pass the metadata DB to per-minor reindexes and fail on errors (#234)	2026-10-17 07:46:09 +00:00
check-cdn-cache.sh	add alpine321 to scripts	2024-12-29 10:18:55 +01:00
check-NA.R	feat: R-minor-sensitive binary builds (full + iterative) (#84)	2026-06-14 08:04:40 +00:00
check-slots.R	feat(slots): add a retirement workflow and a drift check (#214)	2026-09-11 13:14:17 +00:00
compiler-cache.sh	perf: use ccache and parallel make, and skip already-built newer-R candidates in bulk (#240)	2026-10-23 13:17:59 +00:00
debug-packages-writing.R	feat: R-minor-sensitive binary builds (full + iterative) (#84)	2026-06-14 08:04:40 +00:00
dedupe-audit-issue.R	fix(audit): replace arch subsection in place instead of appending duplicates (#138)	2026-07-21 08:51:23 +00:00
detect-duplicates.R	feat: R-minor-sensitive binary builds (full + iterative) (#84)	2026-06-14 08:04:40 +00:00
excluded-packages.json	feat: R-minor-sensitive binary builds (full + iterative) (#84)	2026-06-14 08:04:40 +00:00
failing-builds-classify.R	feat(local): aggregate blocked-on-dependency reporting by dependency (#131)	2026-07-16 21:24:03 +00:00
failing-builds-report.R	fix(ci): pass the metadata DB to per-minor reindexes and fail on errors (#234)	2026-10-17 07:46:09 +00:00
fetch-rebuild-packages-from-issue.R	fix(audit): replace arch subsection in place instead of appending duplicates (#138)	2026-07-21 08:51:23 +00:00
find-R-api-packages.sh	chore(local): add S3 migration and CRAN-source helper scripts	2026-06-14 13:02:48 +02:00
install-bincraft.R	refactor: migrate package installation from pak to uvr (#147)	2026-07-31 12:19:26 +00:00
label-removed-cran-packages.R	fix(ci): pass the metadata DB to per-minor reindexes and fail on errors (#234)	2026-10-17 07:46:09 +00:00
last-processed-by-platform.R	feat: R-minor-sensitive binary builds (full + iterative) (#84)	2026-06-14 08:04:40 +00:00
list-unsafe-flat-objects.R	fix(ci): pass the metadata DB to per-minor reindexes and fail on errors (#234)	2026-10-17 07:46:09 +00:00
migrate-s3-hetzner-to-backblaze.sh	chore(local): add S3 migration and CRAN-source helper scripts	2026-06-14 13:02:48 +02:00
missing-cran-packages-db.R	fix(ci): pass the metadata DB to per-minor reindexes and fail on errors (#234)	2026-10-17 07:46:09 +00:00
missing-cran-packages.R	feat: R-minor-sensitive binary builds (full + iterative) (#84)	2026-06-14 08:04:40 +00:00
missing-packages-in-index.R	feat: R-minor-sensitive binary builds (full + iterative) (#84)	2026-06-14 08:04:40 +00:00
newer-r-helpers.R	perf: use ccache and parallel make, and skip already-built newer-R candidates in bulk (#240)	2026-10-23 13:17:59 +00:00
packages-to-build.R	fix(ci): install the R packages pipelines use instead of relying on the image (#238)	2026-10-20 08:51:06 +00:00
packages-without-any-binary.R	fix(ci): pass the metadata DB to per-minor reindexes and fail on errors (#234)	2026-10-17 07:46:09 +00:00
proposal-tracking-lib.R	feat(local): aggregate blocked-on-dependency reporting by dependency (#131)	2026-07-16 21:24:03 +00:00
proposal-tracking.R	fix(ci): pass the metadata DB to per-minor reindexes and fail on errors (#234)	2026-10-17 07:46:09 +00:00
propose-patches.R	fix(ci): pass the metadata DB to per-minor reindexes and fail on errors (#234)	2026-10-17 07:46:09 +00:00
prune-stale-flat-binaries.R	fix(ci): pass the metadata DB to per-minor reindexes and fail on errors (#234)	2026-10-17 07:46:09 +00:00
query-pkgs-without-old-versions.R	chore(local): add S3 migration and CRAN-source helper scripts	2026-06-14 13:02:48 +02:00
r-minor-helpers.R	perf: seed pure-R binaries into a new slot, interleave shards, and stop builds before the timeout (#242)	2026-10-24 02:04:06 +00:00
rebuild-missing-helpers.R	feat(rebuild): shard the weekly rebuild and make each shard resumable (#163)	2026-08-12 08:30:29 +00:00
rebuild-missing.R	fix(ci): pass the metadata DB to per-minor reindexes and fail on errors (#234)	2026-10-17 07:46:09 +00:00
repair-built-stamp.R	fix(repair-built-stamp): patch the published PACKAGES.rds once bincraft drops cranlike (#236)	2026-10-18 11:55:21 +00:00
retire-slot.R	feat(slots): add a retirement workflow and a drift check (#214)	2026-09-11 13:14:17 +00:00
seed-helpers.R	perf: seed pure-R binaries into a new slot, interleave shards, and stop builds before the timeout (#242)	2026-10-24 02:04:06 +00:00
seed-pure-r.R	perf: seed pure-R binaries into a new slot, interleave shards, and stop builds before the timeout (#242)	2026-10-24 02:04:06 +00:00
test-package-loading.R	refactor: migrate package installation from pak to uvr (#147)	2026-07-31 12:19:26 +00:00
trial-build-patch.R	fix(local): make trial-build-patch.R detect non-throwing build failures (#134)	2026-07-18 08:37:04 +00:00
trial-build-registry.R	fix(local): make the trial-build gate detect non-throwing build failures (#130)	2026-07-16 08:24:03 +00:00
uvr-install.sh	chore(deps): update dependency nbafrank/uvr to v0.4.7	2026-10-11 00:32:41 +00:00
validate-patches.R	feat(local): auto-propose registry patches and track the feedback loop (#117)	2026-07-14 15:03:24 +00:00
verify-repo-routing.R	fix(ci): do not print a missing timing as "NAs" (#210)	2026-09-09 15:01:29 +00:00
weekly-missing-binaries-audit.R	fix(ci): pass the metadata DB to per-minor reindexes and fail on errors (#234)	2026-10-17 07:46:09 +00:00