Uh oh!
There was an error while loading. Please reload this page.
Update Kubernetes library version and backport pickle-fix for Loggers - #18797
Merged
Conversation
ashb
commented
Oct 7, 2021
MemberAuthor
Maybe it is worth splitting this in two actually -- add the reducer for logging to core, but leave the Kube client library version unchanged? |
kaxil
commented
Oct 7, 2021
Member
Yeah 2 PRs does make sense. |
ashb
commented
Oct 7, 2021
MemberAuthor
Split the copyreg in core airflow in to #18798 which is fine to merge in for 2.2.0rc1 |
kaxil
approved these changes
Oct 7, 2021
potiuk
approved these changes
Oct 7, 2021
jedcunningham
approved these changes
Oct 7, 2021
ashb
commented
Oct 12, 2021
MemberAuthor
Merging now 2.2.0 is out. |
ashb
commented
Oct 12, 2021
MemberAuthor
Wait -- making sure tests actually run first 😁 |
ashbforce-pushed
the
update-kube-client
branch
2 times, most recently
from
November 11, 2021 10:50
2c2c555 to
77661b7Compareashb
commented
Nov 12, 2021
MemberAuthor
Green enough. Merging to mainline for 2.3 -- we shouldn't pull this in to 2.2 series. |
ashb
commented
Nov 12, 2021
MemberAuthor
Oh wait, the helm tests were cancelled. Those one's probably are important to run. 👀 |
uranusjr
requested changes
Nov 12, 2021
Uh oh!
There was an error while loading. Please reload this page.
uranusjr
approved these changes
Jan 3, 2022
ashb
commented
Jan 3, 2022
MemberAuthor
Hmmm helm tests are still timing out here, which means something is not right |
Previously we pinned this version as v12 as a change to Kube library internals meant v1.Pod objects now have a logger object inside them, and couldn't be pickled on Python 3.6. To fix that we have "backported" the change in Python 3.7 to make Logger objects be pickled "by name". (In Python 3.7 the change adds `__reduce__` methods on to the Logger and RootLogger objects, but here we achieve it `copyreg` stdlib module so we don't monkeypatch anything.) This fix is also applied in to airflow core in a separate commit, but we also apply it here in the provider so that cncf.kubernetes client library can be updated but still used with older versions of Airflow that don't have this fix in.
ashb
commented
Jan 4, 2022
MemberAuthor
Better now after a rebase. |
4 tasks
eladkal
commented
Jan 17, 2022
Contributor
Removing 2.3.0 milestone as this PR is in the provider release cycle. |
potiuk pushed a commit
that referenced
this pull request
Mar 26, 2022
Previously we pinned this version as v12 as a change to Kube library internals meant v1.Pod objects now have a logger object inside them, and couldn't be pickled on Python 3.6. To fix that we have "backported" the change in Python 3.7 to make Logger objects be pickled "by name". (In Python 3.7 the change adds `__reduce__` methods on to the Logger and RootLogger objects, but here we achieve it `copyreg` stdlib module so we don't monkeypatch anything.) This fix is also applied in to airflow core in a separate commit, but we also apply it here in the provider so that cncf.kubernetes client library can be updated but still used with older versions of Airflow that don't have this fix in. (cherry picked from commit 7222f68)
ephraimbuddy pushed a commit
that referenced
this pull request
Mar 26, 2022
Previously we pinned this version as v12 as a change to Kube library internals meant v1.Pod objects now have a logger object inside them, and couldn't be pickled on Python 3.6. To fix that we have "backported" the change in Python 3.7 to make Logger objects be pickled "by name". (In Python 3.7 the change adds `__reduce__` methods on to the Logger and RootLogger objects, but here we achieve it `copyreg` stdlib module so we don't monkeypatch anything.) This fix is also applied in to airflow core in a separate commit, but we also apply it here in the provider so that cncf.kubernetes client library can be updated but still used with older versions of Airflow that don't have this fix in. (cherry picked from commit 7222f68)
ephraimbuddy pushed a commit
that referenced
this pull request
Mar 26, 2022
Previously we pinned this version as v12 as a change to Kube library internals meant v1.Pod objects now have a logger object inside them, and couldn't be pickled on Python 3.6. To fix that we have "backported" the change in Python 3.7 to make Logger objects be pickled "by name". (In Python 3.7 the change adds `__reduce__` methods on to the Logger and RootLogger objects, but here we achieve it `copyreg` stdlib module so we don't monkeypatch anything.) This fix is also applied in to airflow core in a separate commit, but we also apply it here in the provider so that cncf.kubernetes client library can be updated but still used with older versions of Airflow that don't have this fix in. (cherry picked from commit 7222f68)
36 tasks
ephraimbuddy pushed a commit
that referenced
this pull request
Mar 28, 2022
This reverts commit cb9cdf5.
ephraimbuddy pushed a commit
that referenced
this pull request
Mar 28, 2022
This reverts commit cb9cdf5.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment
7 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Previously we pinned this version as v12 as a change to Kube library
internals meant v1.Pod objects now have a logger object inside them, and
couldn't be pickled on Python 3.6.
To fix that we have "backported" the change in Python 3.7 to make Logger
objects be pickled "by name". (In Python 3.7 the change adds
__reduce__methods on to the Logger and RootLogger objects, but herewe achieve it
copyregstdlib module so we don't monkeypatchanything.)
This fix is also applied in to airflow core in a separate commit, but we
also apply it here in the provider so that cncf.kubernetes client
library can be updated but still used with older versions of Airflow
that don't have this fix in.
I think we should NOT merge this until after 2.2.0 RC is cut, as I don't think we have time to test the kube client upgrade doesn't break anything before the planned RC release.
^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.