Skip to content

gh-130737: Fix multiprocessing test_notify() - #130797

Merged
vstinner merged 1 commit into
python:mainfrom
vstinner:test_notify
Mar 3, 2025
Merged

gh-130737: Fix multiprocessing test_notify()#130797
vstinner merged 1 commit into
python:mainfrom
vstinner:test_notify

Conversation

@vstinner

@vstinnervstinner commented Mar 3, 2025

Copy link
Copy Markdown
Member

Replace hardcoded delay (100 ms) with a loop awaiting until a condition is true: replace assertReturnsIfImplemented() with assertReachesEventually().

Use sleeping_retry() in assertReachesEventually() to tolerate slow buildbots and raise an exception on timeout (30 seconds).

Replace hardcoded delay (100 ms) with a loop awaiting until a
condition is true: replace assertReturnsIfImplemented() with
assertReachesEventually().
Use sleeping_retry() in assertReachesEventually() to tolerate slow
buildbots and raise an exception on timeout (30 seconds).
@vstinner
vstinner enabled auto-merge (squash) March 3, 2025 18:36
@vstinner
vstinner merged commit 8a64a62 into python:mainMar 3, 2025
@vstinner
vstinner deleted the test_notify branch March 3, 2025 18:45
@miss-islington-app

Copy link
Copy Markdown

Thanks @vstinner for the PR 🌮🎉.. I'm working now to backport this PR to: 3.12, 3.13.
🐍🍒⛏🤖

miss-islington pushed a commit to miss-islington/cpython that referenced this pull request Mar 3, 2025
Replace hardcoded delay (100 ms) with a loop awaiting until a
condition is true: replace assertReturnsIfImplemented() with
assertReachesEventually().
Use sleeping_retry() in assertReachesEventually() to tolerate slow
buildbots and raise an exception on timeout (30 seconds).
(cherry picked from commit 8a64a62)
Co-authored-by: Victor Stinner <vstinner@python.org>
@bedevere-app

Copy link
Copy Markdown

GH-130802 is a backport of this pull request to the 3.13 branch.

@bedevere-appbedevere-appBot removed the needs backport to 3.13 bugs and security fixes label Mar 3, 2025
miss-islington pushed a commit to miss-islington/cpython that referenced this pull request Mar 3, 2025
Replace hardcoded delay (100 ms) with a loop awaiting until a
condition is true: replace assertReturnsIfImplemented() with
assertReachesEventually().
Use sleeping_retry() in assertReachesEventually() to tolerate slow
buildbots and raise an exception on timeout (30 seconds).
(cherry picked from commit 8a64a62)
Co-authored-by: Victor Stinner <vstinner@python.org>
@bedevere-app

Copy link
Copy Markdown

GH-130803 is a backport of this pull request to the 3.12 branch.

@bedevere-appbedevere-appBot removed the needs backport to 3.12 only security fixes label Mar 3, 2025
@vstinner

Copy link
Copy Markdown
MemberAuthor

Merged, thanks for the review @gpshead.

vstinner added a commit that referenced this pull request Mar 3, 2025
)
gh-130737: Fix multiprocessing test_notify() (GH-130797)
Replace hardcoded delay (100 ms) with a loop awaiting until a
condition is true: replace assertReturnsIfImplemented() with
assertReachesEventually().
Use sleeping_retry() in assertReachesEventually() to tolerate slow
buildbots and raise an exception on timeout (30 seconds).
(cherry picked from commit 8a64a62)
Co-authored-by: Victor Stinner <vstinner@python.org>
vstinner added a commit that referenced this pull request Mar 3, 2025
)
gh-130737: Fix multiprocessing test_notify() (GH-130797)
Replace hardcoded delay (100 ms) with a loop awaiting until a
condition is true: replace assertReturnsIfImplemented() with
assertReachesEventually().
Use sleeping_retry() in assertReachesEventually() to tolerate slow
buildbots and raise an exception on timeout (30 seconds).
(cherry picked from commit 8a64a62)
Co-authored-by: Victor Stinner <vstinner@python.org>
@bedevere-bot

Copy link
Copy Markdown

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Hi! The buildbot ARM64 Windows Non-Debug 3.x (tier-3) has failed when building commit 8a64a62.

What do you need to do:

  1. Don't panic.
  2. Check the buildbot page in the devguide if you don't know what the buildbots are or how they work.
  3. Go to the page of the buildbot that failed (https://buildbot.python.org/#/builders/730/builds/11586) and take a look at the build logs.
  4. Check if the failure is related to this commit (8a64a62) or if it is a false positive.
  5. If the failure is related to this commit, please, reflect that on the issue and make a new Pull Request with a fix.

You can take a look at the buildbot page here:

https://buildbot.python.org/#/builders/730/builds/11586

Summary of the results of the build (if available):

Click to see traceback logs
remote: Enumerating objects: 27, done. remote: Counting objects: 5% (1/18) remote: Counting objects: 11% (2/18) remote: Counting objects: 16% (3/18) remote: Counting objects: 22% (4/18) remote: Counting objects: 27% (5/18) remote: Counting objects: 33% (6/18) remote: Counting objects: 38% (7/18) remote: Counting objects: 44% (8/18) remote: Counting objects: 50% (9/18) remote: Counting objects: 55% (10/18) remote: Counting objects: 61% (11/18) remote: Counting objects: 66% (12/18) remote: Counting objects: 72% (13/18) remote: Counting objects: 77% (14/18) remote: Counting objects: 83% (15/18) remote: Counting objects: 88% (16/18) remote: Counting objects: 94% (17/18) remote: Counting objects: 100% (18/18) remote: Counting objects: 100% (18/18), done. remote: Compressing objects: 8% (1/12) remote: Compressing objects: 16% (2/12) remote: Compressing objects: 25% (3/12) remote: Compressing objects: 33% (4/12) remote: Compressing objects: 41% (5/12) remote: Compressing objects: 50% (6/12) remote: Compressing objects: 58% (7/12) remote: Compressing objects: 66% (8/12) remote: Compressing objects: 75% (9/12) remote: Compressing objects: 83% (10/12) remote: Compressing objects: 91% (11/12) remote: Compressing objects: 100% (12/12) remote: Compressing objects: 100% (12/12), done. remote: Total 27 (delta 6), reused 7 (delta 6), pack-reused 9 (from 1) 
From https://github.com/python/cpython
* branch main -> FETCH_HEAD
Note: switching to '8a64a62002fa3cdc93cb4cfee315edb235cad8cb'.
You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.
If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:
git switch -c <new-branch-name>
Or undo this operation with:
git switch -
Turn off this advice by setting config variable advice.detachedHead to false
HEAD is now at 8a64a62002f gh-130737: Fix multiprocessing test_notify() (#130797)
Switched to and reset branch 'main'
Traceback (most recent call last):
File "C:\Workspace\buildarea\3.x.linaro-win-arm64.nondebug\build\PCbuild\get_external.py", line 77, in <module>
main()
File "C:\Workspace\buildarea\3.x.linaro-win-arm64.nondebug\build\PCbuild\get_external.py", line 50, in main
zip_path = fetch_zip(
File "C:\Workspace\buildarea\3.x.linaro-win-arm64.nondebug\build\PCbuild\get_external.py", line 19, in fetch_zip
filename, headers = urlretrieve(
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 241, in urlretrievewith contextlib.closing(urlopen(url, data)) as fp:
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 216, in urlopenreturn opener.open(url, data, timeout)
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 519, in open
response =self._open(req, data)
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 536, in _open
result =self._call_chain(self.handle_open, protocol, protocol +
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 496, in _call_chain
result = func(*args)
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 1391, in https_openreturnself.do_open(http.client.HTTPSConnection, req,
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 1352, in do_open
r = h.getresponse()
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\http\client.py", line 1368, in getresponse
response.begin()
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\http\client.py", line 317, in begin
version, status, reason =self._read_status()
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\http\client.py", line 286, in _read_statusraise RemoteDisconnected("Remote end closed connection without"http.client.RemoteDisconnected: Remote end closed connection without response
Traceback (most recent call last):
File "C:\Workspace\buildarea\3.x.linaro-win-arm64.nondebug\build\PCbuild\get_external.py", line 77, in <module>
main()
File "C:\Workspace\buildarea\3.x.linaro-win-arm64.nondebug\build\PCbuild\get_external.py", line 50, in main
zip_path = fetch_zip(
File "C:\Workspace\buildarea\3.x.linaro-win-arm64.nondebug\build\PCbuild\get_external.py", line 19, in fetch_zip
filename, headers = urlretrieve(
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 241, in urlretrievewith contextlib.closing(urlopen(url, data)) as fp:
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 216, in urlopenreturn opener.open(url, data, timeout)
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 519, in open
response =self._open(req, data)
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 536, in _open
result =self._call_chain(self.handle_open, protocol, protocol +
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 496, in _call_chain
result = func(*args)
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 1391, in https_openreturnself.do_open(http.client.HTTPSConnection, req,
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 1352, in do_open
r = h.getresponse()
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\http\client.py", line 1368, in getresponse
response.begin()
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\http\client.py", line 317, in begin
version, status, reason =self._read_status()
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\http\client.py", line 286, in _read_statusraise RemoteDisconnected("Remote end closed connection without"http.client.RemoteDisconnected: Remote end closed connection without response
Traceback (most recent call last):
File "C:\Workspace\buildarea\3.x.linaro-win-arm64.nondebug\build\PCbuild\get_external.py", line 77, in <module>
main()
File "C:\Workspace\buildarea\3.x.linaro-win-arm64.nondebug\build\PCbuild\get_external.py", line 50, in main
zip_path = fetch_zip(
File "C:\Workspace\buildarea\3.x.linaro-win-arm64.nondebug\build\PCbuild\get_external.py", line 19, in fetch_zip
filename, headers = urlretrieve(
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 241, in urlretrievewith contextlib.closing(urlopen(url, data)) as fp:
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 216, in urlopenreturn opener.open(url, data, timeout)
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 519, in open
response =self._open(req, data)
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 536, in _open
result =self._call_chain(self.handle_open, protocol, protocol +
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 496, in _call_chain
result = func(*args)
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 1391, in https_openreturnself.do_open(http.client.HTTPSConnection, req,
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 1352, in do_open
r = h.getresponse()
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\http\client.py", line 1368, in getresponse
response.begin()
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\http\client.py", line 317, in begin
version, status, reason =self._read_status()
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\http\client.py", line 286, in _read_statusraise RemoteDisconnected("Remote end closed connection without"http.client.RemoteDisconnected: Remote end closed connection without response
Could Not Find C:\Workspace\buildarea\3.x.linaro-win-arm64.nondebug\build\Lib\*.pyc
The system cannot find the file specified.
Could Not Find C:\Workspace\buildarea\3.x.linaro-win-arm64.nondebug\build\PCbuild\python*.zip
Traceback (most recent call last):
File "C:\Workspace\buildarea\3.x.linaro-win-arm64.nondebug\build\PCbuild\get_external.py", line 77, in <module>
main()
File "C:\Workspace\buildarea\3.x.linaro-win-arm64.nondebug\build\PCbuild\get_external.py", line 50, in main
zip_path = fetch_zip(
File "C:\Workspace\buildarea\3.x.linaro-win-arm64.nondebug\build\PCbuild\get_external.py", line 19, in fetch_zip
filename, headers = urlretrieve(
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 241, in urlretrievewith contextlib.closing(urlopen(url, data)) as fp:
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 216, in urlopenreturn opener.open(url, data, timeout)
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 519, in open
response =self._open(req, data)
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 536, in _open
result =self._call_chain(self.handle_open, protocol, protocol +
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 496, in _call_chain
result = func(*args)
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 1391, in https_openreturnself.do_open(http.client.HTTPSConnection, req,
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 1352, in do_open
r = h.getresponse()
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\http\client.py", line 1368, in getresponse
response.begin()
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\http\client.py", line 317, in begin
version, status, reason =self._read_status()
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\http\client.py", line 286, in _read_statusraise RemoteDisconnected("Remote end closed connection without"http.client.RemoteDisconnected: Remote end closed connection without response
Traceback (most recent call last):
File "C:\Workspace\buildarea\3.x.linaro-win-arm64.nondebug\build\PCbuild\get_external.py", line 77, in <module>
main()
File "C:\Workspace\buildarea\3.x.linaro-win-arm64.nondebug\build\PCbuild\get_external.py", line 50, in main
zip_path = fetch_zip(
File "C:\Workspace\buildarea\3.x.linaro-win-arm64.nondebug\build\PCbuild\get_external.py", line 19, in fetch_zip
filename, headers = urlretrieve(
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 241, in urlretrievewith contextlib.closing(urlopen(url, data)) as fp:
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 216, in urlopenreturn opener.open(url, data, timeout)
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 519, in open
response =self._open(req, data)
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 536, in _open
result =self._call_chain(self.handle_open, protocol, protocol +
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 496, in _call_chain
result = func(*args)
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 1391, in https_openreturnself.do_open(http.client.HTTPSConnection, req,
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\urllib\request.py", line 1352, in do_open
r = h.getresponse()
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\http\client.py", line 1368, in getresponse
response.begin()
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\http\client.py", line 317, in begin
version, status, reason =self._read_status()
File "C:\Users\tcwg\AppData\Local\Programs\Python\Python310-32\lib\http\client.py", line 286, in _read_statusraise RemoteDisconnected("Remote end closed connection without"http.client.RemoteDisconnected: Remote end closed connection without response
Could Not Find C:\Workspace\buildarea\3.x.linaro-win-arm64.nondebug\build\Lib\*.pyc
The system cannot find the file specified.
Could Not Find C:\Workspace\buildarea\3.x.linaro-win-arm64.nondebug\build\PCbuild\python*.zip

@bedevere-bot

Copy link
Copy Markdown

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Hi! The buildbot s390x RHEL9 Refleaks 3.12 (tier-3) has failed when building commit 519dec9.

What do you need to do:

  1. Don't panic.
  2. Check the buildbot page in the devguide if you don't know what the buildbots are or how they work.
  3. Go to the page of the buildbot that failed (https://buildbot.python.org/#/builders/1569/builds/522) and take a look at the build logs.
  4. Check if the failure is related to this commit (519dec9) or if it is a false positive.
  5. If the failure is related to this commit, please, reflect that on the issue and make a new Pull Request with a fix.

You can take a look at the buildbot page here:

https://buildbot.python.org/#/builders/1569/builds/522

Failed tests:

  • test.test_multiprocessing_spawn.test_manager

Summary of the results of the build (if available):

==

Click to see traceback logs
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 262, in serve_clientraise ke
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 256, in serve_client
obj, exposed, gettypeid = id_to_obj[ident]
~~~~~~~~~^^^^^^^KeyError: '3ff8c581d20'
---------------------------------------------------------------------------
Timeout (0:45:00)!
Thread 0x000003ff8bb73720 (most recent call first):
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/popen_fork.py", line 27 in poll
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/popen_fork.py", line 43 in wait
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/process.py", line 149 in join
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/unittest/case.py", line 597 in _callCleanup
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/unittest/case.py", line 671 in doCleanups
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/unittest/case.py", line 638 in run
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/unittest/case.py", line 690 in __call__
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/unittest/suite.py", line 122 in run
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/unittest/suite.py", line 84 in __call__
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/unittest/suite.py", line 122 in run
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/unittest/suite.py", line 84 in __call__
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/unittest/runner.py", line 240 in run
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 57 in _run_suite
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 37 in run_unittest
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 135 in test_func
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/refleak.py", line 128 in runtest_refleak
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 87 in regrtest_runner
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 138 in _load_run_test
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 181 in _runtest_env_changed_exc
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 281 in _runtest
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 307 in run_single_test
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/worker.py", line 77 in worker_process
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/worker.py", line 100 in main
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/worker.py", line 104 in <module>
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/runpy.py", line 88 in _run_code
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/runpy.py", line 198 in _run_module_as_main
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/process.py", line 314, in _bootstrapself.run()
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/process.py", line 108, in runself._target(*self._args, **self._kwargs)
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/_test_multiprocessing.py", line 1576, in f
woken.release()
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 1060, in releasereturnself._callmethod('release')
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 843, in _callmethodraise convert_to_error(kind, result)
multiprocessing.managers.RemoteError: ---------------------------------------------------------------------------
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 260, in serve_clientself.id_to_local_proxy_obj[ident]
~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^KeyError: '3ffa3f820e0'
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 262, in serve_clientraise ke
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 256, in serve_client
obj, exposed, gettypeid = id_to_obj[ident]
~~~~~~~~~^^^^^^^KeyError: '3ffa3f820e0'
---------------------------------------------------------------------------
Timeout (0:45:00)!
Thread 0x000003ffab373720 (most recent call first):
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/popen_fork.py", line 27 in poll
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/popen_fork.py", line 43 in wait
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/process.py", line 149 in join
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/unittest/case.py", line 597 in _callCleanup
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/unittest/case.py", line 671 in doCleanups
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/unittest/case.py", line 638 in run
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/unittest/case.py", line 690 in __call__
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/unittest/suite.py", line 122 in run
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/unittest/suite.py", line 84 in __call__
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/unittest/suite.py", line 122 in run
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/unittest/suite.py", line 84 in __call__
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/unittest/runner.py", line 240 in run
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 57 in _run_suite
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 37 in run_unittest
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 135 in test_func
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/refleak.py", line 128 in runtest_refleak
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 87 in regrtest_runner
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 138 in _load_run_test
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 181 in _runtest_env_changed_exc
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 281 in _runtest
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 307 in run_single_test
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/worker.py", line 77 in worker_process
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/worker.py", line 100 in main
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/worker.py", line 104 in <module>
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/runpy.py", line 88 in _run_code
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/runpy.py", line 198 in _run_module_as_main
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 262, in serve_clientraise ke
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 256, in serve_client
obj, exposed, gettypeid = id_to_obj[ident]
~~~~~~~~~^^^^^^^KeyError: '3ff9ee01f00'
---------------------------------------------------------------------------
k
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/process.py", line 314, in _bootstrapself.run()
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/process.py", line 108, in runself._target(*self._args, **self._kwargs)
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/_test_multiprocessing.py", line 1576, in f
woken.release()
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 1060, in releasereturnself._callmethod('release')
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 843, in _callmethodraise convert_to_error(kind, result)
multiprocessing.managers.RemoteError: ---------------------------------------------------------------------------
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 260, in serve_clientself.id_to_local_proxy_obj[ident]
~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^KeyError: '3ff8c581d20'
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 262, in serve_clientraise ke
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 256, in serve_client
obj, exposed, gettypeid = id_to_obj[ident]
~~~~~~~~~^^^^^^^KeyError: '3ffad600a10'
---------------------------------------------------------------------------
k
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/process.py", line 314, in _bootstrapself.run()
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/process.py", line 108, in runself._target(*self._args, **self._kwargs)
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/_test_multiprocessing.py", line 1577, in f
cond.release()
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 1060, in releasereturnself._callmethod('release')
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 843, in _callmethodraise convert_to_error(kind, result)
multiprocessing.managers.RemoteError: ---------------------------------------------------------------------------
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 260, in serve_clientself.id_to_local_proxy_obj[ident]
~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^KeyError: '3ffad600a10'
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/process.py", line 314, in _bootstrapself.run()
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/process.py", line 108, in runself._target(*self._args, **self._kwargs)
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/test/_test_multiprocessing.py", line 1576, in f
woken.release()
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 1060, in releasereturnself._callmethod('release')
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 843, in _callmethodraise convert_to_error(kind, result)
multiprocessing.managers.RemoteError: ---------------------------------------------------------------------------
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.12.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 260, in serve_clientself.id_to_local_proxy_obj[ident]
~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^KeyError: '3ff9ee01f00'

@bedevere-bot

Copy link
Copy Markdown

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Hi! The buildbot s390x RHEL9 Refleaks 3.13 (tier-3) has failed when building commit d00e92b.

What do you need to do:

  1. Don't panic.
  2. Check the buildbot page in the devguide if you don't know what the buildbots are or how they work.
  3. Go to the page of the buildbot that failed (https://buildbot.python.org/#/builders/1575/builds/556) and take a look at the build logs.
  4. Check if the failure is related to this commit (d00e92b) or if it is a false positive.
  5. If the failure is related to this commit, please, reflect that on the issue and make a new Pull Request with a fix.

You can take a look at the buildbot page here:

https://buildbot.python.org/#/builders/1575/builds/556

Failed tests:

  • test.test_multiprocessing_spawn.test_manager

Summary of the results of the build (if available):

==

Click to see traceback logs
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/process.py", line 313, in _bootstrapself.run()
~~~~~~~~^^
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/process.py", line 108, in runself._target(*self._args, **self._kwargs)
~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/_test_multiprocessing.py", line 1576, in f
woken.release()
~~~~~~~~~~~~~^^
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 1066, in releasereturnself._callmethod('release')
~~~~~~~~~~~~~~~~^^^^^^^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 847, in _callmethodraise convert_to_error(kind, result)
multiprocessing.managers.RemoteError: ---------------------------------------------------------------------------
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 263, in serve_clientself.id_to_local_proxy_obj[ident]
~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^KeyError: '3ff78c25020'
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/process.py", line 313, in _bootstrapself.run()
~~~~~~~~^^
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/process.py", line 108, in runself._target(*self._args, **self._kwargs)
~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/_test_multiprocessing.py", line 1576, in f
woken.release()
~~~~~~~~~~~~~^^
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 1066, in releasereturnself._callmethod('release')
~~~~~~~~~~~~~~~~^^^^^^^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 847, in _callmethodraise convert_to_error(kind, result)
multiprocessing.managers.RemoteError: ---------------------------------------------------------------------------
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 263, in serve_clientself.id_to_local_proxy_obj[ident]
~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^KeyError: '3ff8ba25020'
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 265, in serve_clientraise ke
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 259, in serve_client
obj, exposed, gettypeid = id_to_obj[ident]
~~~~~~~~~^^^^^^^KeyError: '3ff8ba25020'
---------------------------------------------------------------------------
Timeout (0:45:00)!
Thread 0x000003ff8d673740 (most recent call first):
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/popen_fork.py", line 28 in poll
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/popen_fork.py", line 44 in wait
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/process.py", line 149 in join
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/unittest/case.py", line 614 in _callCleanup
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/unittest/case.py", line 688 in doCleanups
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/unittest/case.py", line 655 in run
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/unittest/case.py", line 707 in __call__
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/unittest/suite.py", line 122 in run
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/unittest/suite.py", line 84 in __call__
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/unittest/suite.py", line 122 in run
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/unittest/suite.py", line 84 in __call__
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/unittest/runner.py", line 240 in run
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 57 in _run_suite
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 37 in run_unittest
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 135 in test_func
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/refleak.py", line 132 in runtest_refleak
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 87 in regrtest_runner
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 138 in _load_run_test
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 181 in _runtest_env_changed_exc
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 281 in _runtest
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 310 in run_single_test
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/worker.py", line 77 in worker_process
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/worker.py", line 112 in main
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/worker.py", line 116 in <module>
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/runpy.py", line 88 in _run_code
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/runpy.py", line 198 in _run_module_as_main
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 265, in serve_clientraise ke
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/managers.py", line 259, in serve_client
obj, exposed, gettypeid = id_to_obj[ident]
~~~~~~~~~^^^^^^^KeyError: '3ff78c25020'
---------------------------------------------------------------------------
Timeout (0:45:00)!
Thread 0x000003ff888f3740 (most recent call first):
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/popen_fork.py", line 28 in poll
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/popen_fork.py", line 44 in wait
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/multiprocessing/process.py", line 149 in join
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/unittest/case.py", line 614 in _callCleanup
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/unittest/case.py", line 688 in doCleanups
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/unittest/case.py", line 655 in run
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/unittest/case.py", line 707 in __call__
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/unittest/suite.py", line 122 in run
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/unittest/suite.py", line 84 in __call__
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/unittest/suite.py", line 122 in run
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/unittest/suite.py", line 84 in __call__
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/unittest/runner.py", line 240 in run
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 57 in _run_suite
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 37 in run_unittest
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 135 in test_func
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/refleak.py", line 132 in runtest_refleak
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 87 in regrtest_runner
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 138 in _load_run_test
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 181 in _runtest_env_changed_exc
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 281 in _runtest
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/single.py", line 310 in run_single_test
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/worker.py", line 77 in worker_process
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/worker.py", line 112 in main
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/test/libregrtest/worker.py", line 116 in <module>
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/runpy.py", line 88 in _run_code
File "/home/buildbot/buildarea/3.13.cstratak-rhel9-s390x.refleak/build/Lib/runpy.py", line 198 in _run_module_as_main

@bedevere-bot

Copy link
Copy Markdown

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Hi! The buildbot AMD64 Windows11 Refleaks 3.12 (tier-1) has failed when building commit 519dec9.

What do you need to do:

  1. Don't panic.
  2. Check the buildbot page in the devguide if you don't know what the buildbots are or how they work.
  3. Go to the page of the buildbot that failed (https://buildbot.python.org/#/builders/1103/builds/802) and take a look at the build logs.
  4. Check if the failure is related to this commit (519dec9) or if it is a false positive.
  5. If the failure is related to this commit, please, reflect that on the issue and make a new Pull Request with a fix.

You can take a look at the buildbot page here:

https://buildbot.python.org/#/builders/1103/builds/802

Failed tests:

  • test.test_multiprocessing_spawn.test_manager

Summary of the results of the build (if available):

==

Click to see traceback logs
Traceback (most recent call last):
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\multiprocessing\process.py", line 314, in _bootstrapself.run()
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\multiprocessing\process.py", line 108, in runself._target(*self._args, **self._kwargs)
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\_test_multiprocessing.py", line 1576, in f
woken.release()
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\multiprocessing\managers.py", line 1060, in releasereturnself._callmethod('release')
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\multiprocessing\managers.py", line 843, in _callmethodraise convert_to_error(kind, result)
multiprocessing.managers.RemoteError: ---------------------------------------------------------------------------
Traceback (most recent call last):
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\multiprocessing\managers.py", line 260, in serve_clientself.id_to_local_proxy_obj[ident]
~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^KeyError: '26f4a452220'
Traceback (most recent call last):
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\multiprocessing\process.py", line 314, in _bootstrapself.run()
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\multiprocessing\process.py", line 108, in runself._target(*self._args, **self._kwargs)
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\_test_multiprocessing.py", line 1576, in f
woken.release()
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\multiprocessing\managers.py", line 1060, in releasereturnself._callmethod('release')
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\multiprocessing\managers.py", line 843, in _callmethodraise convert_to_error(kind, result)
multiprocessing.managers.RemoteError: ---------------------------------------------------------------------------
Traceback (most recent call last):
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\multiprocessing\managers.py", line 260, in serve_clientself.id_to_local_proxy_obj[ident]
~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^KeyError: '12810a82400'
Traceback (most recent call last):
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\multiprocessing\managers.py", line 262, in serve_clientraise ke
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\multiprocessing\managers.py", line 256, in serve_client
obj, exposed, gettypeid = id_to_obj[ident]
~~~~~~~~~^^^^^^^KeyError: '26f4a452220'
---------------------------------------------------------------------------
Timeout (0:45:00)!
Thread 0x00002d6c (most recent call first):
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\multiprocessing\popen_spawn_win32.py", line 112 in wait
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\multiprocessing\process.py", line 149 in join
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\unittest\case.py", line 597 in _callCleanup
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\unittest\case.py", line 671 in doCleanups
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\unittest\case.py", line 638 in run
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\unittest\case.py", line 690 in __call__
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\unittest\suite.py", line 122 in run
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\unittest\suite.py", line 84 in __call__
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\unittest\suite.py", line 122 in run
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\unittest\suite.py", line 84 in __call__
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\unittest\runner.py", line 240 in run
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 57 in _run_suite
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 37 in run_unittest
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 135 in test_func
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\refleak.py", line 128 in runtest_refleak
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 87 in regrtest_runner
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 138 in _load_run_test
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 181 in _runtest_env_changed_exc
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 281 in _runtest
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 307 in run_single_test
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\worker.py", line 77 in worker_process
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\worker.py", line 100 in main
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\worker.py", line 104 in <module>
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\runpy.py", line 88 in _run_code
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\runpy.py", line 198 in _run_module_as_main
Traceback (most recent call last):
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\multiprocessing\managers.py", line 262, in serve_clientraise ke
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\multiprocessing\managers.py", line 256, in serve_client
obj, exposed, gettypeid = id_to_obj[ident]
~~~~~~~~~^^^^^^^KeyError: '12810a82400'
---------------------------------------------------------------------------
Timeout (0:45:00)!
Thread 0x00002ae8 (most recent call first):
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\multiprocessing\popen_spawn_win32.py", line 112 in wait
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\multiprocessing\process.py", line 149 in join
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\unittest\case.py", line 597 in _callCleanup
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\unittest\case.py", line 671 in doCleanups
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\unittest\case.py", line 638 in run
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\unittest\case.py", line 690 in __call__
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\unittest\suite.py", line 122 in run
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\unittest\suite.py", line 84 in __call__
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\unittest\suite.py", line 122 in run
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\unittest\suite.py", line 84 in __call__
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\unittest\runner.py", line 240 in run
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 57 in _run_suite
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 37 in run_unittest
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 135 in test_func
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\refleak.py", line 128 in runtest_refleak
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 87 in regrtest_runner
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 138 in _load_run_test
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 181 in _runtest_env_changed_exc
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 281 in _runtest
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 307 in run_single_test
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\worker.py", line 77 in worker_process
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\worker.py", line 100 in main
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\test\libregrtest\worker.py", line 104 in <module>
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\runpy.py", line 88 in _run_code
File "b:\uildarea\3.12.ware-win11.refleak\build\Lib\runpy.py", line 198 in _run_module_as_main

@bedevere-bot

Copy link
Copy Markdown

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Hi! The buildbot AMD64 Windows11 Refleaks 3.13 (tier-1) has failed when building commit d00e92b.

What do you need to do:

  1. Don't panic.
  2. Check the buildbot page in the devguide if you don't know what the buildbots are or how they work.
  3. Go to the page of the buildbot that failed (https://buildbot.python.org/#/builders/1484/builds/453) and take a look at the build logs.
  4. Check if the failure is related to this commit (d00e92b) or if it is a false positive.
  5. If the failure is related to this commit, please, reflect that on the issue and make a new Pull Request with a fix.

You can take a look at the buildbot page here:

https://buildbot.python.org/#/builders/1484/builds/453

Failed tests:

  • test_io
  • test.test_multiprocessing_spawn.test_manager

Failed subtests:

  • test_daemon_threads_shutdown_stderr_deadlock - test.test_io.CMiscIOTest.test_daemon_threads_shutdown_stderr_deadlock

Summary of the results of the build (if available):

==

Click to see traceback logs
Traceback (most recent call last):
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\multiprocessing\process.py", line 313, in _bootstrapself.run()
~~~~~~~~^^
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\multiprocessing\process.py", line 108, in runself._target(*self._args, **self._kwargs)
~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\_test_multiprocessing.py", line 1576, in f
woken.release()
~~~~~~~~~~~~~^^
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\multiprocessing\managers.py", line 1066, in releasereturnself._callmethod('release')
~~~~~~~~~~~~~~~~^^^^^^^^^^^
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\multiprocessing\managers.py", line 847, in _callmethodraise convert_to_error(kind, result)
multiprocessing.managers.RemoteError: ---------------------------------------------------------------------------
Traceback (most recent call last):
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\multiprocessing\managers.py", line 263, in serve_clientself.id_to_local_proxy_obj[ident]
~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^KeyError: '18befca5410'
Traceback (most recent call last):
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\multiprocessing\process.py", line 313, in _bootstrapself.run()
~~~~~~~~^^
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\multiprocessing\process.py", line 108, in runself._target(*self._args, **self._kwargs)
~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\_test_multiprocessing.py", line 1576, in f
woken.release()
~~~~~~~~~~~~~^^
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\multiprocessing\managers.py", line 1066, in releasereturnself._callmethod('release')
~~~~~~~~~~~~~~~~^^^^^^^^^^^
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\multiprocessing\managers.py", line 847, in _callmethodraise convert_to_error(kind, result)
multiprocessing.managers.RemoteError: ---------------------------------------------------------------------------
Traceback (most recent call last):
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\multiprocessing\managers.py", line 263, in serve_clientself.id_to_local_proxy_obj[ident]
~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^KeyError: '1d7c14e5410'
Traceback (most recent call last):
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\multiprocessing\managers.py", line 265, in serve_clientraise ke
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\multiprocessing\managers.py", line 259, in serve_client
obj, exposed, gettypeid = id_to_obj[ident]
~~~~~~~~~^^^^^^^KeyError: '18befca5410'
---------------------------------------------------------------------------
Timeout (0:45:00)!
Thread 0x00002a54 (most recent call first):
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\multiprocessing\popen_spawn_win32.py", line 114 in wait
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\multiprocessing\process.py", line 149 in join
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\unittest\case.py", line 614 in _callCleanup
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\unittest\case.py", line 688 in doCleanups
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\unittest\case.py", line 655 in run
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\unittest\case.py", line 707 in __call__
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\unittest\suite.py", line 122 in run
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\unittest\suite.py", line 84 in __call__
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\unittest\suite.py", line 122 in run
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\unittest\suite.py", line 84 in __call__
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\unittest\runner.py", line 240 in run
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 57 in _run_suite
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 37 in run_unittest
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 135 in test_func
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\refleak.py", line 132 in runtest_refleak
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 87 in regrtest_runner
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 138 in _load_run_test
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 181 in _runtest_env_changed_exc
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 281 in _runtest
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 310 in run_single_test
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\worker.py", line 77 in worker_process
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\worker.py", line 112 in main
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\worker.py", line 116 in <module>
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\runpy.py", line 88 in _run_code
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\runpy.py", line 198 in _run_module_as_main
Traceback (most recent call last):
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\test_io.py", line 4630, in test_daemon_threads_shutdown_stderr_deadlockself.check_daemon_threads_shutdown_deadlock('stderr')
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\test_io.py", line 4618, in check_daemon_threads_shutdown_deadlockself.assertRegex(err, pattern)
~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^
AssertionError: Regex didn't match: "Fatal Python error: _enter_buffered_busy: could not acquire lock for <(_io\\.)?BufferedWriter name='<stderr>'> at interpreter shutdown, possibly due to daemon threads" not found in '.....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
Traceback (most recent call last):
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\multiprocessing\managers.py", line 265, in serve_clientraise ke
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\multiprocessing\managers.py", line 259, in serve_client
obj, exposed, gettypeid = id_to_obj[ident]
~~~~~~~~~^^^^^^^KeyError: '1d7c14e5410'
---------------------------------------------------------------------------
Timeout (0:45:00)!
Thread 0x00001f28 (most recent call first):
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\multiprocessing\popen_spawn_win32.py", line 114 in wait
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\multiprocessing\process.py", line 149 in join
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\unittest\case.py", line 614 in _callCleanup
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\unittest\case.py", line 688 in doCleanups
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\unittest\case.py", line 655 in run
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\unittest\case.py", line 707 in __call__
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\unittest\suite.py", line 122 in run
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\unittest\suite.py", line 84 in __call__
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\unittest\suite.py", line 122 in run
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\unittest\suite.py", line 84 in __call__
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\unittest\runner.py", line 240 in run
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 57 in _run_suite
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 37 in run_unittest
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 135 in test_func
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\refleak.py", line 132 in runtest_refleak
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 87 in regrtest_runner
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 138 in _load_run_test
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 181 in _runtest_env_changed_exc
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 281 in _runtest
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\single.py", line 310 in run_single_test
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\worker.py", line 77 in worker_process
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\worker.py", line 112 in main
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\libregrtest\worker.py", line 116 in <module>
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\runpy.py", line 88 in _run_code
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\runpy.py", line 198 in _run_module_as_main
Traceback (most recent call last):
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\test_io.py", line 4630, in test_daemon_threads_shutdown_stderr_deadlockself.check_daemon_threads_shutdown_deadlock('stderr')
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^
File "b:\uildarea\3.13.ware-win11.refleak\build\Lib\test\test_io.py", line 4618, in check_daemon_threads_shutdown_deadlockself.assertRegex(err, pattern)
~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^

@colesbury

Copy link
Copy Markdown
Contributor

It looks like the change to assertReachesEventually made test_notify_all a lot more likely to fail. I'm not exactly sure why yet.

@colesbury

Copy link
Copy Markdown
Contributor

#130933 should fix the test_notify_all failures.

I think I understand why the change to assertReachesEventually mattered. Previously, when the function was not implemented, like when getting the value of multiprocessing.Manager().Semaphore(), assertReachesEventually still called time.sleep(DELTA) ten times. Now it's faster -- no sleeping! -- but that made the existing bug in test_notify_all() more likely to occur.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

skip newstestsTests in the Lib/test dirtopic-multiprocessing

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@vstinner@bedevere-bot@colesbury@gpshead