Skip to content

chore(hf): cherry-pick HF dataset publisher to main (enables cron) - #633

Merged
Flotapponnier merged 1 commit into
mainfrom
chore/cherry-pick-hf-publisher
Jun 22, 2026
Merged

chore(hf): cherry-pick HF dataset publisher to main (enables cron)#633
Flotapponnier merged 1 commit into
mainfrom
chore/cherry-pick-hf-publisher

Conversation

@Flotapponnier

Copy link
Copy Markdown
Collaborator

Cherry-pick of #632 (already merged on dev) to main, so the GitHub
Actions cron schedule for the HF publisher can actually fire (both
`schedule` and `workflow_dispatch` require the workflow file on the
default branch).

Zero runtime code change. Only:

  • `scripts/hf_publisher/*` Python daily snapshot script + tests
  • `.github/workflows/hf-publish.yml` cron + manual dispatch
  • `.gitignore` .venv exclusion

Dry-run validated on prod via #632 (26/26 live, 26 headlines + 254 providers + 1838 timeseries rows, ~50KB total).

After merge

  1. Auto-deploy prod via prod-deploy.yml (no actual app change, just rebuild)
  2. Trigger workflow manually with `dry_run: true` from Actions tab to validate secrets wired
  3. Re-trigger with `dry_run: false` to ship 1st real snapshot to HF
  4. Cron starts firing daily at 00:00 UTC

Same files as #632 on dev, brought to main so the GitHub Actions
cron schedule can fire (workflow_dispatch and on.schedule both
require the workflow file to live on the default branch).
No runtime code change. Only adds:
- scripts/hf_publisher/* (Python daily snapshot script + tests)
- .github/workflows/hf-publish.yml (cron + manual dispatch)
- .gitignore (.venv exclusion)
@Flotapponnier
Flotapponnier merged commit cd137a1 into mainJun 22, 2026
1 check failed
@Flotapponnier
Flotapponnier deleted the chore/cherry-pick-hf-publisher branch July 17, 2026 14:41
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@Flotapponnier