Skip to content

bpo-36854: Move GC runtime state from _PyRuntimeState to PyInterpreterState. - #13219

Closed
ericsnowcurrently wants to merge 3 commits into
python:masterfrom
ericsnowcurrently:runtime-interp-gc
Closed

bpo-36854: Move GC runtime state from _PyRuntimeState to PyInterpreterState.#13219
ericsnowcurrently wants to merge 3 commits into
python:masterfrom
ericsnowcurrently:runtime-interp-gc

Conversation

@ericsnowcurrently

@ericsnowcurrentlyericsnowcurrently commented May 9, 2019

Copy link
Copy Markdown
Member

Note: as part of this PR, I've made sure that Python threads (created by the threading module) are marked as "deleted" earlier in finalization. That marker is how joining threads get unblocked. It was happening in PyThreadState_Delete() but now it will happen in PyThreadState_Clear(). This is necessary to ensure that the callback gets called before much interpreter/runtime finalization happens. (It could impact daemon threads, but we already can't guarantee behavior for those once finalization starts.)

https://bugs.python.org/issue36854

@vstinnervstinner left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I like what I see: -) But I have some comments on the actual implementation.

Comment threadPython/pystate.c
// This will unblock any joining threads.
tstate->on_delete(tstate->on_delete_data);
tstate->on_delete = NULL;
tstate->on_delete_data = NULL;

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This change looks to be unrelated. If it's related, I would prefer to see it as a separated PR to prepare that one.

Same comment for other thread changes:

 // All threading module threads are marked as "done" later
// in PyThreadState_Clear().

and

 // This will unblock any joining threads.
// We also do this in PyThreadState_Clear(), but do it here to be sure.

filename, lineno, "_PyObject_GC_TRACK");

PyGC_Head *last = (PyGC_Head*)(_PyRuntime.gc.generation0->_gc_prev);
PyInterpreterState *interp = _PyInterpreterState_GET_UNSAFE();

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would it be possible to use a "struct _gc_runtime_state *state" variable instead?

struct _gc_runtime_state *state = &_PyInterpreterState_GET_UNSAFE()->gc;

Comment threadModules/gcmodule.c
/*[clinic end generated code: output=45a427e9dce9155c input=81ac4940ca579707]*/
{
_PyRuntime.gc.enabled = 1;
PyInterpreterState *interp = _PyInterpreterState_GET_UNSAFE();

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would it be possible to use a "struct _gc_runtime_state *state" variable instead?

struct _gc_runtime_state *state = &_PyInterpreterState_GET_UNSAFE()->gc;

If the line is too lone, maybe add a GET_STATE() macro which returns &_PyInterpreterState_GET_UNSAFE()->gc.

Same comment for the whole file. I would prefer to avoid introducing "PyInterpreterState *interp = _PyInterpreterState_GET_UNSAFE(); " lines if it's only used to get the GC state.

Comment threadObjects/object.c
{
while (_PyRuntime.gc.trash_delete_later) {
PyObject *op = _PyRuntime.gc.trash_delete_later;
PyInterpreterState *interp = _PyInterpreterState_GET_UNSAFE();

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Again, a "state" variable would be more appropriate here.

Comment threadPython/pylifecycle.c
}
*interp_p = interp;

_PyGC_Initialize(&interp->gc);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hum, maybe _PyGC_Initialize() should take interp argument instead, to be consistent with other _PyGC functions.

@bedevere-bot

Copy link
Copy Markdown

When you're done making the requested changes, leave the comment: I have made the requested changes; please review again.

@csabella

Copy link
Copy Markdown
Contributor

@ericsnowcurrently, were you wanting to land this for 3.8?

@brettcannon
brettcannon removed their request for review May 31, 2019 19:08
@encukou
encukou removed their request for review September 12, 2019 14:04
@vstinner

Copy link
Copy Markdown
Member

I wrote a different change, PR #17287, that I just merged. So I close this old PR. Thanks anyway Eric for working on this, my work is partially based on yours ;-)

@ericsnowcurrently

Copy link
Copy Markdown
MemberAuthor

Thanks for doing it!!!

@ericsnowcurrently
ericsnowcurrently deleted the runtime-interp-gc branch November 22, 2019 22:17
@vstinner

Copy link
Copy Markdown
Member

Thanks for doing it!!!

You're welcome.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@ericsnowcurrently@bedevere-bot@csabella@vstinner@the-knights-who-say-ni