4.x: The mode "run-rerun" doesn't work: ReferenceError: Feature is not defined

[mirao]

It works well with 3.7.9 and doesn't work with 4.x

The behavior depends on the config setting noGlobals. If it is true (recommended in CodeceptJS 4.x), it fails on ReferenceError: Feature is not defined and no run is performed 🐛 :

mirao@rog:~/workspace/my$ codeceptjs run-rerun --verbose
Error loading test file /home/mirao/workspace/my/tests/My_test.js: ReferenceError: Feature is not defined
 at file:///home/mirao/workspace/my/tests/My_test.js:1:1
 at ModuleJob.run (node:internal/modules/esm/module_job:439:25)
 at async node:internal/modules/esm/loader:643:26
 at async file:///home/mirao/workspace/my/node_modules/codeceptjs/lib/rerun.js:56:13
CodeceptJS v4.0.9 #StandWithUkraine
Using test root "/home/mirao/workspace/my"
Helpers: Playwright
Plugins: screenshot, retryFailedStep


 OK | 0 passed // 1ms

Process run 1 of max 4, success runs 1/2

Error loading test file /home/mirao/workspace/my/tests/My_test.js: ReferenceError: Feature is not defined
 at file:///home/mirao/workspace/my/tests/My_test.js:1:1
 at ModuleJob.run (node:internal/modules/esm/module_job:439:25)
 at async node:internal/modules/esm/loader:643:26
 at async file:///home/mirao/workspace/my/node_modules/codeceptjs/lib/rerun.js:56:13
CodeceptJS v4.0.9 #StandWithUkraine
Using test root "/home/mirao/workspace/my"
Helpers: Playwright
Plugins: screenshot, retryFailedStep


 OK | 0 passed // 0ms

Process run 2 of max 4, success runs 2/2

Even if noGlobals: false, it doesn't work well - only the 1st run of the test is performed 🐛

mirao@rog:~/workspace/my$ codeceptjs run-rerun --verbose
Global functions are deprecated. Use `import { Helper, within, session } from "codeceptjs"` instead. Set `noGlobals: true` in config to disable globals.
CodeceptJS v4.0.9 #StandWithUkraine
Using test root "/home/mirao/workspace/my"
Helpers: Playwright
Plugins: screenshot, retryFailedStep

My --
 [1] Starting recording promises
 Timeouts: 
 › [Session] Starting singleton browser session
 test something
 › [New Session] {"ignoreHTTPSErrors":false,"acceptDownloads":true}
 Scenario()
 I see "Welcome to CodeceptJS!"
 [1] Retrying... Attempt #2
 [1] Retrying... Attempt #3
 [1] Retrying... Attempt #4
 [1] Error | Error err => { step.status = 'failed' step.endTime = +Da...
 [1] Error | Error undefined...
 [1] <teardown> Stopping recording promises
 › <screenshot> Saving screenshot test_something.failed.png
 › [Screenshot] output/test_something.failed.png
 ✖ FAILED in 1118ms


-- FAILURES:

 1) My
 test something:

 expected web application to include "Welcome to CodeceptJS!"
 + expected - actual

 +Welcome to CodeceptJS!
 
 
 
 
 ◯ Scenario Steps:
 ✖ I.see("Welcome to CodeceptJS!") at Test.<anonymous> (file://./tests/My_test.js:4:7)
 
 ◯ Artifacts:
 - screenshot: /home/mirao/workspace/my/output/test_something.failed.png
 
 ◯ Metadata:
 - browser: chromium
 - browserVersion: 149.0.7827.55
 - windowSize: 1280x720


 FAIL | 0 passed, 1 failed // 1s

Fail run 1 of max 4, success runs 0/2 

Error: Test run failed
 at done (file:///home/mirao/workspace/my/node_modules/codeceptjs/lib/rerun.js:68:20)
 at file:///home/mirao/workspace/my/node_modules/codeceptjs/lib/rerun.js:75:25
 at done (/home/mirao/workspace/my/node_modules/mocha/lib/mocha.js:1000:7)
CodeceptJS v4.0.9 #StandWithUkraine
Using test root "/home/mirao/workspace/my"
Helpers: Playwright
Plugins: screenshot, retryFailedStep


 OK | 0 passed // 0ms

Process run 2 of max 4, success runs 1/2

CodeceptJS v4.0.9 #StandWithUkraine
Using test root "/home/mirao/workspace/my"
Helpers: Playwright
Plugins: screenshot, retryFailedStep


 OK | 0 passed // 0ms

Process run 3 of max 4, success runs 2/2

codecept.conf.js:

import { setHeadlessWhen, setCommonPlugins } from '@codeceptjs/configure';
// turn on headless mode when running with HEADLESS=true environment variable
// export HEADLESS=true && npx codeceptjs run
setHeadlessWhen(process.env.HEADLESS);

// enable all common plugins https://github.com/codeceptjs/configure#setcommonplugins
setCommonPlugins();

/** @type {CodeceptJS.MainConfig} */
export const config = {
 tests: './tests/*_test.js',
 output: './output',
 helpers: {
 Playwright: {
 browser: 'chromium',
 url: 'http://localhost',
 show: true
 }
 },
 include: {
 I: './steps_file.js'
 },
 noGlobals: true,
 plugins: {},
 rerun: {
 // how many times all tests should pass
 minSuccess: 2,

 // how many times to try to rerun all tests
 maxReruns: 4,
 },
 name: 'my'
}

tests/My_test.js:

Feature('My');

Scenario('test something', ({ I }) => {
 I.see('Welcome to CodeceptJS!');
});

Used SW:

• CodeceptJS 4.0.9

[DenysKuchma]

Resolve bug here https://github.com/codeceptjs/CodeceptJS/releases/tag/4.1.0