Add a --rerun option to the iOS testbed. by freakboy3742 · Pull Request #122992 · python/cpython

freakboy3742 · 2024-08-13T23:45:37Z

Adds a --rerun option to the iOS testbed runner.

We've seen a small number of transient failures in the iOS buildbot - mostly in socket-related tests, due to socket availability. These tests pass on the next test, and can't be easily reproduced. The test runner has a --rerun option that may help with the resilience of these tests, and is enabled in the --slow/fast-ci configurations; this PR enables that option for the iOS test runner.

freakboy3742 · 2024-08-13T23:45:54Z

!buildbot iOS

bedevere-bot · 2024-08-13T23:45:56Z

🤖 New build scheduled with the buildbot fleet by @freakboy3742 for commit f9cca3e 🤖

The command will test the builders whose names match following regular expression: iOS

The builders matched are:

iOS ARM64 Simulator PR

ned-deily

A good option to use

miss-islington-app · 2024-08-14T00:14:37Z

Thanks @freakboy3742 for the PR 🌮🎉.. I'm working now to backport this PR to: 3.13.
🐍🍒⛏🤖

Enable --rerun when running tests on iOS. (cherry picked from commit ce39d3c) Co-authored-by: Russell Keith-Magee <russell@keith-magee.com>

bedevere-app · 2024-08-14T00:14:47Z

GH-122993 is a backport of this pull request to the 3.13 branch.

bedevere-bot · 2024-08-14T00:40:03Z

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Hi! The buildbot iOS ARM64 Simulator 3.x has failed when building commit ce39d3c.

What do you need to do:

Don't panic.
Check the buildbot page in the devguide if you don't know what the buildbots are or how they work.
Go to the page of the buildbot that failed (https://buildbot.python.org/#builders/1380/builds/1068) and take a look at the build logs.
Check if the failure is related to this commit (ce39d3c) or if it is a false positive.
If the failure is related to this commit, please, reflect that on the issue and make a new Pull Request with a fix.

You can take a look at the buildbot page here:

https://buildbot.python.org/#builders/1380/builds/1068

Failed tests:

test_urllib2net

Failed subtests:

test_ftp_timeout - test.test_urllib2net.TimeoutTest.test_ftp_timeout
test_ftp - test.test_urllib2net.OtherNetworkTests.test_ftp
test_ftp_no_timeout - test.test_urllib2net.TimeoutTest.test_ftp_no_timeout
test_ftp_basic - test.test_urllib2net.TimeoutTest.test_ftp_basic
test_ftp_default_timeout - test.test_urllib2net.TimeoutTest.test_ftp_default_timeout

Summary of the results of the build (if available):

==

Click to see traceback logs

Traceback (most recent call last):
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/support/socket_helper.py", line 249, in transient_internetyield
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 373, in test_ftp_timeout
u = _urlopen_with_retry(self.FTP_HOST, timeout=60)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 29, in wrappedreturn _retry_thrice(func, exc, *args, **kwargs)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 25, in _retry_thriceraise last_exc
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 21, in _retry_thricereturn func(*args, **kwargs)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 189, in urlopenreturn opener.open(url, data, timeout)
~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 489, in open
response =self._open(req, data)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 506, in _open
result =self._call_chain(self.handle_open, protocol, protocol +'_open', req)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 466, in _call_chain
result = func(*args)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 1558, in ftp_openraise URLError(exp) from exp
urllib.error.URLError: <urlopen error 500 OOPS: vsf_sysutil_bind>
Traceback (most recent call last):
Warning -- File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/libregrtest/run_workers.py", line 399, in run
Warning -- mp_result = self._runtest(test_name)
Warning -- File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/libregrtest/run_workers.py", line 359, in _runtest
Warning -- retcode, tmp_files = self.run_tmp_files(worker_runtests,
Warning -- ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
Warning -- stdout_file.fileno())
Warning -- ^^^^^^^^^^^^^^^^^^^^^
Warning -- File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/libregrtest/run_workers.py", line 295, in run_tmp_files
Warning -- retcode = self._run_process(worker_runtests,
Warning -- stdout_fd, tmp_dir)
Warning -- File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/libregrtest/run_workers.py", line 177, in _run_process
Warning -- popen = create_worker_process(runtests, output_fd, tmp_dir)
Warning -- File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/libregrtest/worker.py", line 64, in create_worker_process
Warning -- return subprocess.Popen(cmd, **kwargs)
Warning -- ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^
Warning -- File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/subprocess.py", line 824, in __init__
Warning -- raise OSError(
Warning -- errno.ENOTSUP, f"{sys.platform} does not support processes."
Warning -- )
Warning -- OSError: [Errno 45] ios does not support processes.
Traceback (most recent call last):
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 1548, in ftp_open
fp, retrlen = fw.retrfile(file, type)
~~~~~~~~~~~^^^^^^^^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 2443, in retrfile
conn, retrlen =self.ftp.ntransfercmd(cmd)
~~~~~~~~~~~~~~~~~~~~~^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/ftplib.py", line 353, in ntransfercmd
host, port =self.makepasv()
~~~~~~~~~~~~~^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/ftplib.py", line 327, in makepasv
untrusted_host, port = parse227(self.sendcmd('PASV'))
~~~~~~~~~~~~^^^^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/ftplib.py", line 281, in sendcmdreturnself.getresp()
~~~~~~~~~~~~^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/ftplib.py", line 254, in getrespraise error_perm(resp)
ftplib.error_perm: 500 OOPS: vsf_sysutil_bind
Traceback (most recent call last):
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 1548, in ftp_open
fp, retrlen = fw.retrfile(file, type)
~~~~~~~~~~~^^^^^^^^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 2426, in retrfileraise URLError(f'ftp error: {reason}') from reason
urllib.error.URLError: <urlopen error ftp error: 500 OOPS: vsf_sysutil_bind>
Traceback (most recent call last):
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/support/socket_helper.py", line 249, in transient_internetyield
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 364, in test_ftp_no_timeout
u = _urlopen_with_retry(self.FTP_HOST, timeout=None)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 29, in wrappedreturn _retry_thrice(func, exc, *args, **kwargs)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 25, in _retry_thriceraise last_exc
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 21, in _retry_thricereturn func(*args, **kwargs)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 189, in urlopenreturn opener.open(url, data, timeout)
~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 489, in open
response =self._open(req, data)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 506, in _open
result =self._call_chain(self.handle_open, protocol, protocol +'_open', req)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 466, in _call_chain
result = func(*args)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 1558, in ftp_openraise URLError(exp) from exp
urllib.error.URLError: <urlopen error 500 OOPS: vsf_sysutil_bind>
Traceback (most recent call last):
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 372, in test_ftp_timeoutwith socket_helper.transient_internet(self.FTP_HOST):
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/contextlib.py", line 162, in __exit__self.gen.throw(value)
~~~~~~~~~~~~~~^^^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/support/socket_helper.py", line 264, in transient_internet
filter_error(err)
~~~~~~~~~~~~^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/support/socket_helper.py", line 237, in filter_error
(("ConnectionRefusedError"in err.reason) or^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^TypeError: argument of type 'error_perm' is not a container or iterable
Traceback (most recent call last):
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 261, in _test_urls
f = urlopen(url, req, support.INTERNET_TIMEOUT)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 29, in wrappedreturn _retry_thrice(func, exc, *args, **kwargs)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 25, in _retry_thriceraise last_exc
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 21, in _retry_thricereturn func(*args, **kwargs)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 489, in open
response =self._open(req, data)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 506, in _open
result =self._call_chain(self.handle_open, protocol, protocol +'_open', req)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 466, in _call_chain
result = func(*args)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 1558, in ftp_openraise URLError(exp) from exp
urllib.error.URLError: <urlopen error <urlopen error ftp error: 500 OOPS: vsf_sysutil_bind>>
Traceback (most recent call last):
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/support/socket_helper.py", line 249, in transient_internetyield
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 343, in test_ftp_basic
u = _urlopen_with_retry(self.FTP_HOST)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 29, in wrappedreturn _retry_thrice(func, exc, *args, **kwargs)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 25, in _retry_thriceraise last_exc
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 21, in _retry_thricereturn func(*args, **kwargs)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 189, in urlopenreturn opener.open(url, data, timeout)
~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 489, in open
response =self._open(req, data)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 506, in _open
result =self._call_chain(self.handle_open, protocol, protocol +'_open', req)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 466, in _call_chain
result = func(*args)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 1558, in ftp_openraise URLError(exp) from exp
urllib.error.URLError: <urlopen error 500 OOPS: vsf_sysutil_bind>
Traceback (most recent call last):
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/support/socket_helper.py", line 249, in transient_internetyield
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 352, in test_ftp_default_timeout
u = _urlopen_with_retry(self.FTP_HOST)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 29, in wrappedreturn _retry_thrice(func, exc, *args, **kwargs)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 25, in _retry_thriceraise last_exc
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 21, in _retry_thricereturn func(*args, **kwargs)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 189, in urlopenreturn opener.open(url, data, timeout)
~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 489, in open
response =self._open(req, data)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 506, in _open
result =self._call_chain(self.handle_open, protocol, protocol +'_open', req)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 466, in _call_chain
result = func(*args)
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 1558, in ftp_openraise URLError(exp) from exp
urllib.error.URLError: <urlopen error 500 OOPS: vsf_sysutil_bind>
Traceback (most recent call last):
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/urllib/request.py", line 2423, in retrfile
conn, retrlen =self.ftp.ntransfercmd(cmd)
~~~~~~~~~~~~~~~~~~~~~^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/ftplib.py", line 353, in ntransfercmd
host, port =self.makepasv()
~~~~~~~~~~~~~^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/ftplib.py", line 327, in makepasv
untrusted_host, port = parse227(self.sendcmd('PASV'))
~~~~~~~~~~~~^^^^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/ftplib.py", line 281, in sendcmdreturnself.getresp()
~~~~~~~~~~~~^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/ftplib.py", line 254, in getrespraise error_perm(resp)
ftplib.error_perm: 500 OOPS: vsf_sysutil_bind
Traceback (most recent call last):
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 349, in test_ftp_default_timeoutwith socket_helper.transient_internet(self.FTP_HOST):
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/contextlib.py", line 162, in __exit__self.gen.throw(value)
~~~~~~~~~~~~~~^^^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/support/socket_helper.py", line 264, in transient_internet
filter_error(err)
~~~~~~~~~~~~^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/support/socket_helper.py", line 237, in filter_error
(("ConnectionRefusedError"in err.reason) or^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^TypeError: argument of type 'error_perm' is not a container or iterable
Traceback (most recent call last):
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 342, in test_ftp_basicwith socket_helper.transient_internet(self.FTP_HOST, timeout=None):
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/contextlib.py", line 162, in __exit__self.gen.throw(value)
~~~~~~~~~~~~~~^^^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/support/socket_helper.py", line 264, in transient_internet
filter_error(err)
~~~~~~~~~~~~^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/support/socket_helper.py", line 237, in filter_error
(("ConnectionRefusedError"in err.reason) or^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^TypeError: argument of type 'error_perm' is not a container or iterable
Traceback (most recent call last):
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/test_urllib2net.py", line 361, in test_ftp_no_timeoutwith socket_helper.transient_internet(self.FTP_HOST):
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/contextlib.py", line 162, in __exit__self.gen.throw(value)
~~~~~~~~~~~~~~^^^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/support/socket_helper.py", line 264, in transient_internet
filter_error(err)
~~~~~~~~~~~~^^^^^
File "/Users/buildbot/Library/Developer/XCTestDevices/DEF0AAE3-414C-4A0D-A16C-D561C37F8D16/data/Containers/Bundle/Application/028C1970-6491-46B7-A9E9-5B8076EA3A32/iOSTestbed.app/python/lib/python3.14/test/support/socket_helper.py", line 237, in filter_error
(("ConnectionRefusedError"in err.reason) or^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^TypeError: argument of type 'error_perm' is not a container or iterable

Enable --rerun when running tests on iOS. (cherry picked from commit ce39d3c) Co-authored-by: Russell Keith-Magee <russell@keith-magee.com>

ned-deily · 2024-08-14T00:53:32Z

Oops, it looks like regrtest by default uses a subprocess for the reruns. https://buildbot.python.org/#builders/1380/builds/1068

freakboy3742 · 2024-08-14T01:02:58Z

Whelp... I guess we need --single-process as well. Unfortunately, that option doesn't exist in 3.13, so we've either got to backport #119728, or live without --rerun on the 3.13 branch. Any preferences @ned-deily?

ned-deily · 2024-08-14T01:13:24Z

It would be a RM call; to me, backporting a feature in the release candidate phase of 3.13 seems a stretch. Possibly in a maintenance release. But I think the right thing to do now is to live without it for 3.13.0.

It does look like there is some useful info in the buildbot traceback: 500 OOPS: vsf_sysutil_bind.

freakboy3742 · 2024-08-14T01:22:35Z

Makes sense. I've opened #122994 to add the --single-process option on main; I guess the soon-to-be-answered question is whether the problem is just a very inconvenient, new form of transient error with FTP tests, or an iOS problem to be fixed...

freakboy3742 · 2024-08-14T02:20:00Z

Looks like the vsf_sysutil_bind error is transient... but it can also trigger on macOS

bedevere-bot · 2024-08-14T02:31:34Z

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Hi! The buildbot PPC64LE RHEL7 LTO + PGO 3.13 has failed when building commit bfec6f3.

What do you need to do:

Don't panic.
Check the buildbot page in the devguide if you don't know what the buildbots are or how they work.
Go to the page of the buildbot that failed (https://buildbot.python.org/#builders/1461/builds/212) and take a look at the build logs.
Check if the failure is related to this commit (bfec6f3) or if it is a false positive.
If the failure is related to this commit, please, reflect that on the issue and make a new Pull Request with a fix.

You can take a look at the buildbot page here:

https://buildbot.python.org/#builders/1461/builds/212

Failed tests:

test_urllib2net

Failed subtests:

test_ftp_timeout - test.test_urllib2net.TimeoutTest.test_ftp_timeout
test_ftp - test.test_urllib2net.OtherNetworkTests.test_ftp
test_ftp_no_timeout - test.test_urllib2net.TimeoutTest.test_ftp_no_timeout
test_ftp_basic - test.test_urllib2net.TimeoutTest.test_ftp_basic
test_ftp_default_timeout - test.test_urllib2net.TimeoutTest.test_ftp_default_timeout

Summary of the results of the build (if available):

==

Click to see traceback logs

Traceback (most recent call last):
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 372, in test_ftp_timeoutwith socket_helper.transient_internet(self.FTP_HOST):
...<2 lines>...self.assertEqual(u.fp.fp.raw._sock.gettimeout(), 60)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/contextlib.py", line 162, in __exit__self.gen.throw(value)
~~~~~~~~~~~~~~^^^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/support/socket_helper.py", line 264, in transient_internet
filter_error(err)
~~~~~~~~~~~~^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/support/socket_helper.py", line 237, in filter_error
(("ConnectionRefusedError"in err.reason) or^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^TypeError: argument of type 'error_perm' is not iterable
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 349, in test_ftp_default_timeoutwith socket_helper.transient_internet(self.FTP_HOST):
...<6 lines>...self.assertEqual(u.fp.fp.raw._sock.gettimeout(), 60)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/contextlib.py", line 162, in __exit__self.gen.throw(value)
~~~~~~~~~~~~~~^^^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/support/socket_helper.py", line 264, in transient_internet
filter_error(err)
~~~~~~~~~~~~^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/support/socket_helper.py", line 237, in filter_error
(("ConnectionRefusedError"in err.reason) or^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^TypeError: argument of type 'error_perm' is not iterable
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 1548, in ftp_open
fp, retrlen = fw.retrfile(file, type)
~~~~~~~~~~~^^^^^^^^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 2426, in retrfileraise URLError(f'ftp error: {reason}') from reason
urllib.error.URLError: <urlopen error ftp error: 500 OOPS: vsf_sysutil_bind>
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/support/socket_helper.py", line 249, in transient_internetyield
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 364, in test_ftp_no_timeout
u = _urlopen_with_retry(self.FTP_HOST, timeout=None)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 29, in wrappedreturn _retry_thrice(func, exc, *args, **kwargs)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 25, in _retry_thriceraise last_exc
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 21, in _retry_thricereturn func(*args, **kwargs)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 189, in urlopenreturn opener.open(url, data, timeout)
~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 489, in open
response =self._open(req, data)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 506, in _open
result =self._call_chain(self.handle_open, protocol, protocol +'_open', req)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 466, in _call_chain
result = func(*args)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 1558, in ftp_openraise URLError(exp) from exp
urllib.error.URLError: <urlopen error 500 OOPS: vsf_sysutil_bind>
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 361, in test_ftp_no_timeoutwith socket_helper.transient_internet(self.FTP_HOST):
...<6 lines>...self.assertIsNone(u.fp.fp.raw._sock.gettimeout())
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/contextlib.py", line 162, in __exit__self.gen.throw(value)
~~~~~~~~~~~~~~^^^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/support/socket_helper.py", line 264, in transient_internet
filter_error(err)
~~~~~~~~~~~~^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/support/socket_helper.py", line 237, in filter_error
(("ConnectionRefusedError"in err.reason) or^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^TypeError: argument of type 'error_perm' is not iterable
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 1548, in ftp_open
fp, retrlen = fw.retrfile(file, type)
~~~~~~~~~~~^^^^^^^^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 2443, in retrfile
conn, retrlen =self.ftp.ntransfercmd(cmd)
~~~~~~~~~~~~~~~~~~~~~^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/ftplib.py", line 353, in ntransfercmd
host, port =self.makepasv()
~~~~~~~~~~~~~^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/ftplib.py", line 327, in makepasv
untrusted_host, port = parse227(self.sendcmd('PASV'))
~~~~~~~~~~~~^^^^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/ftplib.py", line 281, in sendcmdreturnself.getresp()
~~~~~~~~~~~~^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/ftplib.py", line 254, in getrespraise error_perm(resp)
ftplib.error_perm: 500 OOPS: vsf_sysutil_bind
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 261, in _test_urls
f = urlopen(url, req, support.INTERNET_TIMEOUT)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 29, in wrappedreturn _retry_thrice(func, exc, *args, **kwargs)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 25, in _retry_thriceraise last_exc
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 21, in _retry_thricereturn func(*args, **kwargs)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 489, in open
response =self._open(req, data)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 506, in _open
result =self._call_chain(self.handle_open, protocol, protocol +'_open', req)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 466, in _call_chain
result = func(*args)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 1558, in ftp_openraise URLError(exp) from exp
urllib.error.URLError: <urlopen error <urlopen error ftp error: 500 OOPS: vsf_sysutil_bind>>
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/support/socket_helper.py", line 249, in transient_internetyield
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 373, in test_ftp_timeout
u = _urlopen_with_retry(self.FTP_HOST, timeout=60)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 29, in wrappedreturn _retry_thrice(func, exc, *args, **kwargs)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 25, in _retry_thriceraise last_exc
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 21, in _retry_thricereturn func(*args, **kwargs)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 189, in urlopenreturn opener.open(url, data, timeout)
~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 489, in open
response =self._open(req, data)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 506, in _open
result =self._call_chain(self.handle_open, protocol, protocol +'_open', req)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 466, in _call_chain
result = func(*args)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 1558, in ftp_openraise URLError(exp) from exp
urllib.error.URLError: <urlopen error 500 OOPS: vsf_sysutil_bind>
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/support/socket_helper.py", line 249, in transient_internetyield
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 352, in test_ftp_default_timeout
u = _urlopen_with_retry(self.FTP_HOST)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 29, in wrappedreturn _retry_thrice(func, exc, *args, **kwargs)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 25, in _retry_thriceraise last_exc
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 21, in _retry_thricereturn func(*args, **kwargs)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 189, in urlopenreturn opener.open(url, data, timeout)
~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 489, in open
response =self._open(req, data)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 506, in _open
result =self._call_chain(self.handle_open, protocol, protocol +'_open', req)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 466, in _call_chain
result = func(*args)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 1558, in ftp_openraise URLError(exp) from exp
urllib.error.URLError: <urlopen error 500 OOPS: vsf_sysutil_bind>
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 342, in test_ftp_basicwith socket_helper.transient_internet(self.FTP_HOST, timeout=None):
...<2 lines>...self.assertIsNone(u.fp.fp.raw._sock.gettimeout())
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/contextlib.py", line 162, in __exit__self.gen.throw(value)
~~~~~~~~~~~~~~^^^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/support/socket_helper.py", line 264, in transient_internet
filter_error(err)
~~~~~~~~~~~~^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/support/socket_helper.py", line 237, in filter_error
(("ConnectionRefusedError"in err.reason) or^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^TypeError: argument of type 'error_perm' is not iterable
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/support/socket_helper.py", line 249, in transient_internetyield
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 343, in test_ftp_basic
u = _urlopen_with_retry(self.FTP_HOST)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 29, in wrappedreturn _retry_thrice(func, exc, *args, **kwargs)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 25, in _retry_thriceraise last_exc
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/test/test_urllib2net.py", line 21, in _retry_thricereturn func(*args, **kwargs)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 189, in urlopenreturn opener.open(url, data, timeout)
~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 489, in open
response =self._open(req, data)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 506, in _open
result =self._call_chain(self.handle_open, protocol, protocol +'_open', req)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 466, in _call_chain
result = func(*args)
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 1558, in ftp_openraise URLError(exp) from exp
urllib.error.URLError: <urlopen error 500 OOPS: vsf_sysutil_bind>
Traceback (most recent call last):
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/urllib/request.py", line 2423, in retrfile
conn, retrlen =self.ftp.ntransfercmd(cmd)
~~~~~~~~~~~~~~~~~~~~~^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/ftplib.py", line 353, in ntransfercmd
host, port =self.makepasv()
~~~~~~~~~~~~~^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/ftplib.py", line 327, in makepasv
untrusted_host, port = parse227(self.sendcmd('PASV'))
~~~~~~~~~~~~^^^^^^^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/ftplib.py", line 281, in sendcmdreturnself.getresp()
~~~~~~~~~~~~^^
File "/home/buildbot/buildarea/3.13.cstratak-RHEL7-ppc64le.lto-pgo/build/Lib/ftplib.py", line 254, in getrespraise error_perm(resp)
ftplib.error_perm: 500 OOPS: vsf_sysutil_bind

ned-deily · 2024-08-14T02:59:09Z

These errors may be related to the recent OS upgrade on the PSF pythontest.net test server.

mhsmith · 2024-08-14T12:28:43Z

I had been planning to use --slow-ci in the Android buildbot for consistency with the other platforms, but that won't be possible unless the --single-process option is available as well. So I'll submit a backport of that option, even if it does have to wait until 3.13.1.

Enable --rerun when running tests on iOS.

miss-islington-app · 2024-08-27T00:00:50Z

Thanks @freakboy3742 for the PR 🌮🎉.. I'm working now to backport this PR to: 3.13.
🐍🍒⛏🤖

Enable --rerun when running tests on iOS. (cherry picked from commit ce39d3c) Co-authored-by: Russell Keith-Magee <russell@keith-magee.com>

bedevere-app · 2024-08-27T00:00:58Z

GH-123367 is a backport of this pull request to the 3.13 branch.

Add a --rerun option to the iOS testbed. (GH-122992) Enable --rerun when running tests on iOS. (cherry picked from commit ce39d3c) Co-authored-by: Russell Keith-Magee <russell@keith-magee.com>

Add a --rerun option to the iOS testbed.
f9cca3e

freakboy3742 added skip issue skip news OS-ios needs backport to 3.13 bugs and security fixes labels Aug 13, 2024

bedevere-appBot added the awaiting core review label Aug 13, 2024

freakboy3742 requested a review from ned-deily August 13, 2024 23:45

ned-deily approved these changes Aug 14, 2024
View reviewed changes

bedevere-appBot added awaiting merge and removed awaiting core review labels Aug 14, 2024

freakboy3742 merged commit ce39d3c into python:mainAug 14, 2024

bedevere-appBot removed the awaiting merge label Aug 14, 2024

bedevere-appBot removed the needs backport to 3.13 bugs and security fixes label Aug 14, 2024

freakboy3742 deleted the ios-rerun branch August 14, 2024 00:23

freakboy3742 added a commit that referenced this pull request Aug 14, 2024
[3.13] Add a --rerun option to the iOS testbed. (GH-122992) (#122993)
bfec6f3
Enable --rerun when running tests on iOS. (cherry picked from commit ce39d3c) Co-authored-by: Russell Keith-Magee <russell@keith-magee.com>

This was referenced Aug 14, 2024
Ensure that iOS test re-runs don't try to spawn a process. #122994
Merged
[3.13] Revert use of --rerun in iOS testbed. #122995
Merged

freakboy3742 mentioned this pull request Aug 14, 2024
Infrastructure: Upgrading pythontest service #122795
Closed

This was referenced Aug 14, 2024
gh-119727: Add --single-process option to regrtest #119728
Merged
[3.13] gh-119727: Add --single-process option to regrtest (#119728) #123010
Merged

blhsing pushed a commit to blhsing/cpython that referenced this pull request Aug 22, 2024
Add a --rerun option to the iOS testbed. (python#122992)
a096103
Enable --rerun when running tests on iOS.

freakboy3742 added the needs backport to 3.13 bugs and security fixes label Aug 27, 2024

bedevere-appBot removed the needs backport to 3.13 bugs and security fixes label Aug 27, 2024

mhsmith mentioned this pull request Jan 23, 2025
iOS buildbot failure comments don't contain failure details anymore #129248
Closed

Uh oh!

Uh oh!

Conversation

freakboy3742 commented Aug 13, 2024

Uh oh!

freakboy3742 commented Aug 13, 2024

Uh oh!

bedevere-bot commented Aug 13, 2024

Uh oh!

ned-deily left a comment

Choose a reason for hiding this comment

Uh oh!

miss-islington-appBot commented Aug 14, 2024

Uh oh!

bedevere-appBot commented Aug 14, 2024

Uh oh!

bedevere-bot commented Aug 14, 2024

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Uh oh!

ned-deily commented Aug 14, 2024

Uh oh!

freakboy3742 commented Aug 14, 2024

Uh oh!

ned-deily commented Aug 14, 2024

Uh oh!

freakboy3742 commented Aug 14, 2024

Uh oh!

freakboy3742 commented Aug 14, 2024

Uh oh!

bedevere-bot commented Aug 14, 2024

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Uh oh!

ned-deily commented Aug 14, 2024

Uh oh!

mhsmith commented Aug 14, 2024

Uh oh!

miss-islington-appBot commented Aug 27, 2024

Uh oh!

bedevere-appBot commented Aug 27, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants