Skip to content

Nasa Provider Plugin - #40

Merged
sdc50 merged 9 commits into
erdc:masterfrom
AaronV77:nasa_provider
Apr 18, 2018
Merged

Nasa Provider Plugin#40
sdc50 merged 9 commits into
erdc:masterfrom
AaronV77:nasa_provider

Conversation

@AaronV77

Copy link
Copy Markdown
Collaborator

I got the basic authentication piece setup for the nasa provider.

Comment thread quest/services/nasa.py Outdated
return self.provider.get_user_info()

def _read_granules(self, short_name, page_num):
return requests.get(granules_url % (short_name, page_num), auth=(self.info['username'], self.info['password'])).json()['feed']['entry']

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

E501 line too long (143 > 120 characters)

Comment thread quest/services/nasa.py Outdated
organization_abbr = 'NASA'

def get_user_info(self):
the_info = {**self.credentials}

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

E999 SyntaxError: invalid syntax

@AaronV77 AaronV77 changed the title Nasa Provider Plugin (WIP) Nasa Provider Plugin Apr 13, 2018
@AaronV77

Copy link
Copy Markdown
Collaborator Author

This provider is working now. Will have to find a special case where you can't get data because of not being logged in, and make sure that the authentication piece works indefinitely.

Comment thread quest/services/nasa.py

def _read_granules(self, short_name, page_num):
try:
return requests.get(granules_url % (short_name, page_num), auth=(self.info['username'], self.info['password'])).json()['feed']['entry']

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

E501 line too long (147 > 120 characters)

AaronV77 and others added 6 commits April 16, 2018 11:45
* Added the cuahsi coverage fix. The change was not getting all the resources and just getting all resources that had a coverage from the world.

* Made kwargs the standard over using options, params, and kwargs.

* Updated the load_providers to only update if update-cache is True or if the global is None.
Comment thread quest/util/misc.py

providers = {name: driver.DriverManager('quest.services', name, invoke_on_load=True, invoke_kwds={'name': name}).driver for name in web_services}
if update_cache or the_providers is None:
providers = {name: driver.DriverManager('quest.services', name, invoke_on_load=True, invoke_kwds={'name': name}).driver for name in web_services}

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

E501 line too long (153 > 120 characters)

Comment thread quest/util/misc.py
if len(settings.get('USER_SERVICES', [])) > 0:
for uri in settings.get('USER_SERVICES', []):
try:
drv = driver.DriverManager('quest.services', 'user', invoke_on_load=True, invoke_kwds={'uri': uri}).driver

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

E501 line too long (126 > 120 characters)

Comment thread test/data.py
DOWNLOAD_OPTIONS_FROM_ALL_SERVICES = {
# 'svc://nasa:srtm-3-arc-second': {},
# 'svc://nasa:srtm-30-arc-second': {},
'svc://nasa:srtm-3-arc-second': {},

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

E121 continuation line under-indented for hanging indent

@sdc50
sdc50 merged commit cccb496 into erdc:master Apr 18, 2018
sdc50 pushed a commit that referenced this pull request Apr 27, 2018
* Dataset display name fix (More readable).

* Added the noaa_ncep plugin and updated the conda environment file.

* NCEP test and setup.cfg were updated.

* Removing the placeholder for the girder site.

* Updated the docs and the python 2 environment file for ncep and terrapin.

* Minor updates (#38)

* Added the cuahsi coverage fix. The change was not getting all the resources and just getting all resources that had a coverage from the world.

* Made kwargs the standard over using options, params, and kwargs.

* Updated the load_providers to only update if update-cache is True or if the global is None.

* Dataset display name fix (More readable).

* Added the noaa_ncep plugin and updated the conda environment file.

* NCEP test and setup.cfg were updated.

* Removing the placeholder for the girder site.

* Updated the docs and the python 2 environment file for ncep and terrapin.

* The setup.cfg never got updated or added to this commit. This fixes the tests.

* Addeed another service from ncep, and added the sorted call to the lists.

* Fixed the test and added the sorted functions into this plugin.

* Nasa Provider Plugin (#40)

* I got the basic authentication piece setup for the nasa provider.

* Made a small fix to the authentication fix. This provider is working again.

* Nasa provider syntax fix.

* Minor updates (#38)

* Added the cuahsi coverage fix. The change was not getting all the resources and just getting all resources that had a coverage from the world.

* Made kwargs the standard over using options, params, and kwargs.

* Updated the load_providers to only update if update-cache is True or if the global is None.

* I got the basic authentication piece setup for the nasa provider.

* Made a small fix to the authentication fix. This provider is working again.

* Nasa provider syntax fix.

* I never added the uncommented the nasa download options to the tests in data.py. This fixes the tests.

* Dataset display name fix (More readable).

* Added the noaa_ncep plugin and updated the conda environment file.

* NCEP test and setup.cfg were updated.

* Removing the placeholder for the girder site.

* Updated the docs and the python 2 environment file for ncep and terrapin.

* Dataset display name fix (More readable).

* Removing the placeholder for the girder site.

* The setup.cfg never got updated or added to this commit. This fixes the tests.

* Addeed another service from ncep, and added the sorted call to the lists.

* Fixed the test and added the sorted functions into this plugin.

* Fixed the test for ncep provider.

* Fixed the test for ncep provider part 2.

* Updated the authentication to work with QuestWeb, and added a method for getting the status of a providers authentication. (#41)

* Dataset display name fix (More readable).

* Added the noaa_ncep plugin and updated the conda environment file.

* NCEP test and setup.cfg were updated.

* Removing the placeholder for the girder site.

* Updated the docs and the python 2 environment file for ncep and terrapin.

* Dataset display name fix (More readable).

* Removing the placeholder for the girder site.

* The setup.cfg never got updated or added to this commit. This fixes the tests.

* Addeed another service from ncep, and added the sorted call to the lists.

* Fixed the test and added the sorted functions into this plugin.

* Dataset display name fix (More readable).

* Removing the placeholder for the girder site.

* Removing the placeholder for the girder site.

* Fixed the test for ncep provider.

* Fixed the test for ncep provider part 2.
@AaronV77
AaronV77 deleted the nasa_provider branch May 8, 2018 17:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants