pat-s
72440f9cf5
Adds visibility into how cran.rpkgs.com is actually used, from the Bunny access logs, without sending anything to a third party. ## What it does - `.crow/download-stats.yaml` runs hourly: `stats/collect.ts` reads the last 70 hours of cran-rpkgs logs (Bunny keeps three days) into a new `download_stats` schema in the build metadata database, then `stats/publish.ts` writes aggregated counts to `stats/downloads.json` in the binaries bucket and purges the CDN copy. - `stats/classify.ts` labels each request (download, index, redirect reason, renv/pak probe, scanner noise) by mirroring `edge/rpkgs-router.ts`, and splits cloud/CI networks (by ASN) from everything else. - Downloads are de-duplicated per client, package version and UTC day; clients are a salted HMAC of the anonymized /24 prefix, ASN and R platform, so no IP is stored or published. - Our own CI runners (`STATS_OWN_NETWORKS`) are excluded; collection windows are recorded so the dashboard can show gaps. - `cdn.tf` declares the zone's existing logging settings and adds `json` to the CORS extensions so rpkgs.com can read the file. - `stats/README.md` documents every rule. The rpkgs.com `/stats` page that renders this is in rpkgs/website. ## Before merging - Add Crow secrets `STATS_CLIENT_SALT` and `STATS_OWN_NETWORKS` (values in OpenBao at `development/agent-dev/rpkgs-download-stats`). - `tofu apply` for the CORS change. - After merge, register the `download-stats` cron (`0 * * * *`). ## Verification - `bun test stats`: 15 tests pass. - Ran `collect.ts` locally against the live API and database: 14,273 events inserted, a second run inserted 0. - `publish.ts --out` produced the JSON the website was previewed with; the upload and purge path has only run in CI so far (B2 credentials are CI-only). 🤖 Generated with [Claude Code](https://claude.com/claude-code) Reviewed-on: #251
108 lines
2 KiB
Text
108 lines
2 KiB
Text
# Created by https://www.toptal.com/developers/gitignore/api/terraform,R
|
|
# Edit at https://www.toptal.com/developers/gitignore?templates=terraform,R
|
|
|
|
### R ###
|
|
# History files
|
|
.Rhistory
|
|
.Rapp.history
|
|
|
|
# Session Data files
|
|
.RData
|
|
.RDataTmp
|
|
|
|
# User-specific files
|
|
.Ruserdata
|
|
|
|
# Example code in package build process
|
|
*-Ex.R
|
|
|
|
# Output files from R CMD build
|
|
/*.tar.gz
|
|
|
|
# Output files from R CMD check
|
|
/*.Rcheck/
|
|
|
|
# RStudio files
|
|
.Rproj.user/
|
|
|
|
# produced vignettes
|
|
vignettes/*.html
|
|
vignettes/*.pdf
|
|
|
|
# OAuth2 token, see https://github.com/hadley/httr/releases/tag/v0.3
|
|
.httr-oauth
|
|
|
|
# knitr and R markdown default cache directories
|
|
*_cache/
|
|
/cache/
|
|
|
|
# Temporary files created by R markdown
|
|
*.utf8.md
|
|
*.knit.md
|
|
|
|
# R Environment Variables
|
|
.Renviron
|
|
|
|
# translation temp files
|
|
po/*~
|
|
|
|
# RStudio Connect folder
|
|
rsconnect/
|
|
|
|
### R.Bookdown Stack ###
|
|
# R package: bookdown caching files
|
|
/*_files/
|
|
|
|
### Terraform ###
|
|
# Local .terraform directories
|
|
**/.terraform/*
|
|
|
|
# .tfstate files
|
|
*.tfstate
|
|
*.tfstate.*
|
|
|
|
# Crash log files
|
|
crash.log
|
|
crash.*.log
|
|
|
|
# Exclude all .tfvars files, which are likely to contain sensitive data, such as
|
|
# password, private keys, and other secrets. These should not be part of version
|
|
# control as they are data points which are potentially sensitive and subject
|
|
# to change depending on the environment.
|
|
*.tfvars
|
|
*.tfvars.json
|
|
|
|
# Ignore override files as they are usually used to override resources locally and so
|
|
# are not checked in
|
|
override.tf
|
|
override.tf.json
|
|
*_override.tf
|
|
*_override.tf.json
|
|
|
|
# Include override files you do wish to add to version control using negated pattern
|
|
# !example_override.tf
|
|
|
|
# Include tfplan files to ignore the plan output of command: terraform plan -out=tfplan
|
|
# example: *tfplan*
|
|
|
|
# Ignore CLI configuration files
|
|
.terraformrc
|
|
terraform.rc
|
|
|
|
# End of https://www.toptal.com/developers/gitignore/api/terraform,R
|
|
|
|
.Renviron
|
|
.envrc
|
|
exec.sh
|
|
exec.R
|
|
docs/
|
|
local/test.R
|
|
.DS_Store
|
|
docs/
|
|
|
|
# Superpowers SDD scratch (briefs, reports, ledger)
|
|
.superpowers/
|
|
|
|
# Internal design docs (plans and specs) are kept out of the repo.
|
|
plans/
|
|
specs/
|