Excessive QSBR memory usage when delay freeing large blocks.

[tom-pytel]

Bug report

Bug description:

I ran across this while profiling memory usage in #130771. The results are same for both that and list objects which use QSBR to free memory, so this is a QSBR thing. Note this is an extreme synthetic case, this CAN happen but does not mean it WILL happen in real-world apps.

Memory usage numbers:

 VmHWM
GIL 135104 kB - normal GIL-enabled baseline
noGIL 6702788 kB - free-threaded current QSBR behavior

Test script:

import threading
from queue import Queue

def thrdfunc(queue):
 while True:
 l = queue.get()

 l.append(0) # force resize in non-parent thread which will free using _PyMem_FreeDelayed()

queue = Queue(maxsize=2)

threading.Thread(target=thrdfunc, args=(queue,)).start()

while True:
 l = [None] * int(3840*2160*3/8) # sys.getsizeof(l) ~= 3840*2160*3 bytes

 queue.put(l)

See PR for proposed fix.

CPython versions tested on:

3.14

Operating systems tested on:

No response

Linked PRs

• gh-132519: fix excessive mem usage in QSBR with large blocks #132520

[ZeroIntensity]

Triage: should we close this?

[kumaraditya303]

Closing this in favor of #133136