Skip to content

gh-108724: Use _PyTime_GetMonotonicClock() in parking_lot.c - #112222

Closed
vstinner wants to merge 1 commit into
python:mainfrom
vstinner:monotonic_parking
Closed

gh-108724: Use _PyTime_GetMonotonicClock() in parking_lot.c#112222
vstinner wants to merge 1 commit into
python:mainfrom
vstinner:monotonic_parking

Conversation

@vstinner

@vstinnervstinner commented Nov 17, 2023

Copy link
Copy Markdown
Member

Using a system clock causes issues when it's being updated by the system administrator, NTP, Daylight Saving Time, or anything else. Sadly, on Windows, the monotonic clock resolution is around 15.6 ms.

Example: #85876

Using a system clock causes issues when it's being updated by the
system administrator, NTP, Daylight Saving Time, or anything
else. Sadly, on Windows, the monotonic clock resolution is around
15.6 ms.
Example: python#85876
@vstinner

Copy link
Copy Markdown
MemberAuthor

@colesbury@ericsnowcurrently: Please don't use the system clock for locks. It causes too many issues. Using a monotonic clock is more reliable. Sadly, on Windows, the monotonic clock has a resolution of 15.6 ms.

@colesburycolesbury left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should use the monotonic clock when available, but this change isn't sufficient:

  • sem_timedwait does not work with CLOCK_MONOTONIC. (Need sem_clockwait if available)
  • pthread_cond_t needs to be initialized with the right attribute

Comment threadPython/parking_lot.c
Comment on lines +121 to 124
_PyTime_t deadline = _PyTime_Add(_PyTime_GetMonotonicClock(), timeout);
_PyTime_AsTimespec(deadline, &ts);

err = sem_timedwait(&sema->platform_sem, &ts);

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe:

# ifdefHAVE_SEM_CLOCKWAIT_PyTime_tdeadline=_PyDeadline_Init(timeout);
_PyTime_AsTimespec_clamp(deadline, &ts);
err=sem_clockwait(&sema->platform_sem, CLOCK_MONOTONIC, &ts);
# else_PyTime_tdeadline=_PyTime_Add(_PyTime_GetSystemClock(), timeout);
_PyTime_AsTimespec_clamp(deadline, &ts);
err=sem_timedwait(&sema->platform_sem, &ts);
#endif

@vstinner

Copy link
Copy Markdown
MemberAuthor

Oh. I made a mechanical change to avoid _PyTime_GetSystemClock(). I didn't see that timestamps are passed to existing functions such as pthread_cond_timedwait(). I mark my PR as a draft for now and will try to update it to address Sam's review

@vstinner
vstinner marked this pull request as draft November 17, 2023 23:24
@vstinnervstinner closed this Dec 1, 2023
@vstinner
vstinner deleted the monotonic_parking branch December 1, 2023 18:26
@vstinner

Copy link
Copy Markdown
MemberAuthor

I don't have time to fix my PR right now. I may try again later ;-)

@colesbury

colesbury commented Dec 1, 2023

Copy link
Copy Markdown
Contributor

I wrote it up as an issue so that I don't forget about this and in case someone else wants to tackle it first: #112606

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@vstinner@colesbury