Skip to content

Adding GitHub provider - #21076

Merged
potiuk merged 22 commits into
apache:mainfrom
pateash:20300-Add-Github-provider
Jan 28, 2022
Merged

Adding GitHub provider#21076
potiuk merged 22 commits into
apache:mainfrom
pateash:20300-Add-Github-provider

Conversation

@pateash

Copy link
Copy Markdown
Contributor

closes: #20300


Description

Adding Github provider based on Python SDK https://github.com/PyGithub/PyGithub
The SDK has many objects which can be viewed at https://pygithub.readthedocs.io/en/latest/github_objects.html

Users can create their own custom operators leveraging the PyGithub SDK, either by leveraging Hook directly or building their operator on GithubOperator by providing method and method_args from PyGithub
results can be further processed by implementing result_processor method, please look into GithubTagSensor for reference.

github_operator = GithubOperator(
task_id='github-test',
github_method="get_repo",
github_method_args={'full_name_or_id': 'apache/airflow'},
result_processor=lambda r: r.full_name,
dag=self.dag,
)

@pateashpateash changed the title 20300 add GitHub provider[WIP]: 20300 add GitHub providerJan 24, 2022
@pateashpateash changed the title [WIP]: 20300 add GitHub provider[WIP]: 20300- Adding GitHub providerJan 24, 2022
@potiukpotiuk changed the title [WIP]: 20300- Adding GitHub provider[WIP]: Adding GitHub providerJan 25, 2022
@potiukpotiuk changed the title [WIP]: Adding GitHub provider[WIP]: Add GitHub providerJan 25, 2022
Comment threadairflow/providers/github/.latest-doc-only-change.txt Outdated
Comment threadairflow/providers/github/example_dags/example_github.py Outdated
Comment threadairflow/providers/github/example_dags/example_github.py Outdated
Comment threadairflow/providers/github/hooks/github.py Outdated
Comment threadairflow/providers/github/sensors/github.py Outdated
Comment threadairflow/providers/github/sensors/github_old.py Outdated
Comment threaddocs/apache-airflow-providers-github/commits.rst
Comment threaddocs/apache-airflow-providers-github/index.rst Outdated
Comment threaddocs/apache-airflow-providers-github/index.rst

@potiukpotiuk left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Very nice one!

I left a few comments, but it looks great already!

@pateash
pateash requested a review from potiukJanuary 26, 2022 15:44
@pateashpateash changed the title [WIP]: Add GitHub providerAdding GitHub providerJan 26, 2022
@pateash

Copy link
Copy Markdown
ContributorAuthor

image

image

@pateash

Copy link
Copy Markdown
ContributorAuthor

image

@pateash
pateashforce-pushed the 20300-Add-Github-provider branch from 3fcacda to 58e3f99CompareJanuary 26, 2022 15:49
@pateash

Copy link
Copy Markdown
ContributorAuthor

Hi @potiuk,
thanks for the comments, Please let me know if anything else needed.

Comment threaddocs/apache-airflow-providers-influxdb/connections/influxdb.rst Outdated
Comment threadairflow/providers/github/sensors/github.py Outdated
@pateashpateash changed the title Adding GitHub providerWIP: Adding GitHub providerJan 26, 2022
@pateash
pateash requested a review from eladkalJanuary 26, 2022 16:55
@pateash
pateashforce-pushed the 20300-Add-Github-provider branch from 94c689a to 8369d9fCompareJanuary 28, 2022 12:24

@eladkaleladkal left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@potiuk any further comments?

@potiuk
potiuk merged commit 5d23fbe into apache:mainJan 28, 2022
@potiuk

Copy link
Copy Markdown
Member

Just in time for the January wave of Providers :)

@pateash
pateash deleted the 20300-Add-Github-provider branch February 15, 2022 13:49
@jedcunninghamjedcunningham added the changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..) label Mar 1, 2022
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:dev-toolsarea:providerschangelog:skipChanges that should be skipped from the changelog (CI, tests, etc..)kind:documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add Github provider

4 participants

@pateash@eladkal@potiuk@jedcunningham