[schlessera]

Addresses #390.

Scenarios ran strictly one after another, although almost all of them are independent of each other and the CI runners have several cores.

Setting WP_CLI_TEST_PARALLEL to a number of workers now spreads the scenarios over that many Behat processes. The scenarios are selected with the same tag filter as before, so a parallel run covers exactly the scenarios of a serial one.

• Every worker but the first gets its own temporary directory, and with it its own home directory, caches and run directories, as well as its own test database (wp_cli_test_1, wp_cli_test_2, ...). composer prepare-tests now allows the test user to create these databases.
• Scenarios using fixed ports, background processes, the scaffold test database or fixed paths in the system's temporary directory all run in the first worker, one after the other.
• Scenarios are distributed by their expected cost, so that the workers finish at about the same time.
• composer behat-rerun re-runs exactly the scenarios that failed in the last parallel run.
• Without permission to create the worker databases, on Windows, when collecting code coverage, and when selecting scenarios by path or name, the scenarios run one after the other as before.

Locally, this package's own suite ran the same 97 scenarios and 393 steps with the same results as a serial run, in 27 instead of 47 seconds with 6 workers. A subset of 213 entity-command scenarios went from 491 to 140 seconds with 8 workers in an earlier experiment.

Parallel runs stay opt-in. Measurements on CI are recorded on #390.

[coderabbitai]

Important

Draft PR not reviewed

Draft PRs are not automatically reviewed by default.

• Trigger a manual review

To automatically review draft PRs, update your CodeRabbit configuration:

reviews:
  auto_review:
    drafts: true

• Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands.}

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!