Skip to content

Fix threading-related deadlocks, and also add support for Python's built-in listing of libraries - #243

Open
itamarst wants to merge 5 commits into
joblib:masterfrom
itamarst:239-fix-deadlock
Open

Fix threading-related deadlocks, and also add support for Python's built-in listing of libraries#243
itamarst wants to merge 5 commits into
joblib:masterfrom
itamarst:239-fix-deadlock

Conversation

@itamarst

@itamarst itamarst commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Fixes #239

Unfortunately I failed to create a reproducer for the deadlock, so this is just a fix without a test 😬

These changes did allow for https://github.com/ogrisel/example_pipelines/ to run without deadlocks, however.

Both changes are necessary:

  • Lock is for parallel usages of threadpoolctl
  • PyDLL is for deadlocks with other usages of dl_iterate_phdr from other libraries.

@itamarst
itamarst marked this pull request as ready for review September 8, 2026 16:38
@itamarst itamarst changed the title Fix deadlocks, and also add support for Python's built-in listing of libraries Fix threading-related deadlocks, and also add support for Python's built-in listing of libraries Sep 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Deadlock when running dl_iterate_phdr in parallel with GIL Python

1 participant