Skip to content

fix(ci): Add ability to run full test suite on PRs - #6718

Merged
guilload merged 2 commits into
mainfrom
david-yaffe/add-full-test-ci
Aug 26, 2026
Merged

guilload merged 2 commits into
mainfrom
david-yaffe/add-full-test-ci

Conversation

@dayaffe

@dayaffe dayaffe commented Aug 21, 2026

Copy link
Copy Markdown
Contributor

Description

Add a maintainer-triggered /ci-run-all-tests command that runs make test-all against the test merge commit for a pull request and reports the full-test-suite status on the PR head.

The workflow supports fork PRs without exposing secrets and documents the command in the contribution guide.

How was this PR tested?

The full test suite passed 3,022 all-feature tests and 10 failpoint tests.

@dayaffe
dayaffe force-pushed the david-yaffe/add-full-test-ci branch from ed97582 to f6015ba Compare August 21, 2026 20:00
Comment thread .github/workflows/full-tests.yml Fixed
@dayaffe dayaffe changed the title Run the full test suite before merge fix(ci): Add ability to run full test suite on PRs Aug 21, 2026
@dayaffe
dayaffe force-pushed the david-yaffe/add-full-test-ci branch from f6015ba to f246511 Compare August 21, 2026 20:17
@dayaffe
dayaffe force-pushed the david-yaffe/add-full-test-ci branch from f246511 to c1b23ec Compare August 21, 2026 20:26
Comment on lines +69 to +74
- uses: actions/checkout@de0fac2e4500dabe0009e67214ff5f5447ce83dd # v6.0.2
with:
ref: ${{ inputs.merge_sha }}
persist-credentials: false

- name: Install Ubuntu packages
@pront

pront commented Aug 24, 2026

Copy link
Copy Markdown
Collaborator

This is a useful capability but I recommend going even further i.e. make running tests a required check / pre-condition for merging a PR.

@dayaffe
dayaffe marked this pull request as ready for review August 26, 2026 17:45
@dayaffe
dayaffe requested a review from a team as a code owner August 26, 2026 17:45
@guilload
guilload merged commit afe9ac0 into main Aug 26, 2026
9 checks passed
@guilload
guilload deleted the david-yaffe/add-full-test-ci branch August 26, 2026 17:48

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 89b3bec974

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment on lines +116 to +118
- name: Prepare LocalStack S3
run: pipenv run ./prepare_tests.sh
working-directory: ./quickwit/quickwit-cli/tests

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Start LocalStack before preparing its bucket

On a fresh ubuntu-24.04 runner, this step executes before any LocalStack service has been started, so prepare_tests.sh invokes awslocal s3 mb against an unavailable endpoint and exits nonzero. The only Docker startup occurs in the subsequent make test-all target, meaning the workflow stops here without running the suite; start Compose first or remove this redundant preparation step.

AGENTS.md reference: AGENTS.md:L142-L145

Useful? React with 👍 / 👎.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants