798 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
pat-s	0d6c1c8312	fix: correct platform param in alpine 322/323 arm64 CI pipelines ... Both pipelines had platform = 'alpine-321' instead of their actual target, causing builds to upload to the wrong S3 path and the PACKAGES index to not reflect newly built packages.	2026-04-21 19:45:06 +02:00
pat-s	7892eb0423	chore: remove unused cdns	2026-04-21 19:31:01 +02:00
pat-s	6440e3c7a1	ci: make rhel10 update runs compatible with xwayland	2026-04-21 11:05:13 +02:00
pat-s	8974bc4c92	feat: add rhel10 package update workflows	2026-04-20 11:51:27 +02:00
pat-s	8a98cf96a6	fix: save S3 listing in precompute step, avoid loading s3fs in build step ... s3fs uses reticulate/Python which significantly increases R process memory. When pak tries to fork R to install package dependencies, the enlarged process can't be duplicated within the container memory limit. Now the install-deps step saves the S3 file listing as s3_cache.rds, and the build step reads it with readRDS() — no s3fs loading needed.	2026-04-17 20:05:26 +02:00
pat-s	bc3dbd6126	fix: map x86_64/aarch64 to amd64/arm64 for S3 cache path	2026-04-17 19:04:18 +02:00
pat-s	9b27b3e650	refactor: extract build-all R one-liner into local/build-all.R ... - Load bincraft eagerly via library() to avoid lazy-load memory spike - Do bulk S3 listing upfront and pass as s3_package_cache to avoid per-package S3 calls that accumulate memory and trigger fork failures - Consolidate amd64/arm64 exclude lists into single script - Much easier to read and maintain than a YAML-embedded one-liner	2026-04-17 19:01:08 +02:00
pat-s	87d3f54b21	fix: pass NULL to set_codename() which requires an explicit argument	2026-04-17 18:55:40 +02:00
pat-s	92084e51ed	fix: use bincraft::set_codename() for S3 path in precompute step ... The precompute script was constructing S3 paths as "redhat10" while bincraft uses "rhel10" as the codename. This mismatch caused the precompute to find no existing packages in S3, producing ~77K false positive package versions that all get skipped at build time. Now uses bincraft::set_codename() to ensure path alignment. Also fixes nrow() vs length() in install-deps summary message.	2026-04-17 18:54:29 +02:00
pat-s	e47949f546	fix: remove force=TRUE to preserve error metadata tracking ... force=TRUE bypasses the error-DB filter and overwrites build metadata, causing failed packages to be retried indefinitely. Since the precompute step already filters to missing versions, force is unnecessary.	2026-04-17 18:35:59 +02:00
pat-s	a732993d2b	feat: iterate over (package, version) pairs in build-all pipeline ... Build step now reads precomputed package+version pairs and passes specific tags with force=TRUE, eliminating all per-package precondition I/O.	2026-04-17 18:22:36 +02:00
pat-s	21ec8a67dd	feat: save package+version pairs instead of just package names ... packages-to-build.R now saves the full (Package, Version) data.table so the build step can pass specific tags to build_binary_package(), eliminating redundant per-package tag discovery and S3 checks. Also reduces archive versions from 9 to 4 (+ 1 release = 5 total).	2026-04-17 18:20:00 +02:00
pat-s	9330bef97c	chore: adjust matrix split counts for amd64 and arm64 builds	2026-04-15 10:13:16 +02:00
pat-s	5293967137	feat: run incremental package index update after each process-updates workflow ... Each process-updates workflow now calls upload_package_index at the end to update the PACKAGES files for its platform/arch immediately after builds complete. The full update-package-index cron should be rescheduled to weekly.	2026-04-15 10:13:16 +02:00
automation-bot	477d21ce54	chore(deps): update reg.devxy.io/rpkgs/build-env-alpine docker tag to v3.23	2026-04-13 00:01:26 +00:00
pat-s	a27011d049	chore: 4-way split for amd	2026-04-12 19:07:32 +02:00
pat-s	360aa45e90	fix: replace colon in error message to avoid YAML parsing issue in rebuild workflows	2026-04-11 21:53:22 +02:00
pat-s	5d9bdbb3a9	feat: add 14 weekly rebuild workflows for all platform/arch combos	2026-04-11 21:46:38 +02:00
pat-s	10aeffd9fa	feat: add 14 weekly audit workflows for all platform/arch combos	2026-04-11 21:45:29 +02:00
pat-s	ffb8c42511	feat: add weekly missing binaries audit R script	2026-04-11 21:41:59 +02:00
pat-s	84f59682eb	feat: add excluded-packages.json for weekly missing binaries workflow	2026-04-11 21:41:55 +02:00
pat-s	82dd2af5b2	docs: add implementation plan for weekly missing binaries audit & rebuild	2026-04-11 21:23:59 +02:00
pat-s	154a517cfc	docs: add design spec for weekly missing binaries audit & rebuild workflow	2026-04-11 21:16:30 +02:00
pat-s	14950a6bfc	refactor: chain update-package-index workflows sequentially to avoid overwhelming S3 endpoint ... All 12 workflows were triggered simultaneously by the update-package-index cron. Now they run one after another via depends_on. Individual cron triggers still allow running one at a time.	2026-04-11 10:18:35 +02:00
pat-s	a64dea6b23	refactor: separate install-deps workflows for arch	2026-04-11 09:49:44 +02:00
pat-s	1c1bfb5f6d	chore: align arm64 workflow	2026-04-11 09:47:19 +02:00
pat-s	ce8d74d0eb	refactor: apply same build improvements to arm64 workflow ... Uses install-deps step, precomputed package list, weston compositor, stderr redirect, sequential plan with progress output, and unique X server numbers.	2026-04-11 09:47:04 +02:00
pat-s	9ff676a5cb	chore: don't clean cache	2026-04-10 20:16:05 +02:00
pat-s	4b27430270	fix: use weston instead of mutter as Wayland compositor to reduce memory usage ... Mutter (default xwfb-run compositor) consumes ~200-500MB per instance, causing fork failures with 5 parallel matrix jobs. Weston is much lighter.	2026-04-10 20:15:42 +02:00
pat-s	4892497c76	fix: redirect R message stream to stdout to bypass xwfb-run stderr swallowing	2026-04-10 17:48:29 +02:00
pat-s	112bc60ec2	debug: add per-package progress output to stdout to diagnose hang vs buffering	2026-04-10 17:30:20 +02:00
pat-s	270843eaf9	refactor: precompute package list in install-deps step to reduce matrix job memory usage ... Move packages-to-build.R execution to the single install-deps step and save results as RDS. Matrix jobs read the precomputed list instead of loading the massive CRAN archive/release databases, freeing memory for fork/system calls.	2026-04-10 16:21:33 +02:00
pat-s	e53f11a896	fix: one-time full R-pkgs cache wipe to fix corrupted .so files from previous failed builds	2026-04-10 16:04:49 +02:00
pat-s	858f13140b	fix: clear pak cache before installing bincraft to ensure new version is picked up	2026-04-10 15:02:10 +02:00
pat-s	6da70e5074	fix: use unique X server number per matrix job to prevent Xwayland collisions	2026-04-10 12:43:11 +02:00
pat-s	3f985b3bc7	fix: use plan('sequential') instead of removing future, bincraft needs it internally for future_mapply	2026-04-10 12:41:09 +02:00
pat-s	f831db042c	fix: use plan('multisession') instead of plan('sequential') for future_mapply compatibility	2026-04-10 12:37:44 +02:00
pat-s	1ff6a0c32a	fix: use plan('sequential') instead of removing future, bincraft needs it internally for future_mapply	2026-04-10 08:18:53 +02:00
pat-s	7ca1b6e5c6	fix: remove pak::sysreqs_db_update() from matrix step, already cached by install-deps	2026-04-10 00:28:34 +02:00
pat-s	7bd77a2873	fix: stop wiping entire R-pkgs cache, only clean locks and bincraft now that cache is rebuilt	2026-04-10 00:17:11 +02:00
pat-s	e062c58185	fix: restore pak::sysreqs_db_update() in matrix step and pre-cache it in install-deps	2026-04-10 00:15:23 +02:00
pat-s	18a8f2dc54	fix: install packages-to-build.R deps (RPostgres, s3fs, data.table, future) in install-deps step	2026-04-10 00:07:54 +02:00
pat-s	0c4b56262c	fix: remove redundant pak::sysreqs_db_update() from matrix step to reduce memory pressure	2026-04-10 00:06:25 +02:00
pat-s	f3d71a1112	fix: wipe entire R-pkgs cache to rebuild from scratch after corruption from failed installs	2026-04-10 00:01:16 +02:00
pat-s	11c4071c0d	fix: remove future multisession to avoid fork memory failures with parallel matrix jobs	2026-04-09 23:58:51 +02:00
pat-s	d5f7ecc0b4	fix: skip dependency upgrades in install-deps step to avoid memory issues	2026-04-09 23:56:46 +02:00
pat-s	272275e868	refactor: move bincraft install to separate pre-matrix pipeline step ... Adds build-all-versions-install-deps pipeline that runs once before the matrix builds, cleaning stale locks and installing bincraft to the shared cache without contention.	2026-04-09 23:55:30 +02:00
pat-s	08070ce62f	test: use sequential lapply instead of future multisession to rule out fork memory issue	2026-04-09 23:49:47 +02:00
pat-s	0aba224c11	fix: install bincraft to per-job /tmp/R-libs to avoid shared cache conflicts between parallel matrix builds	2026-04-09 23:41:41 +02:00
pat-s	0efe1d3485	fix: remove cached bincraft dir before install to avoid pak metadata conflict	2026-04-09 23:37:40 +02:00