This repository was archived by the owner on Aug 29, 2025. It is now read-only.

Implement API to create a grid to store results of a scheduled query - #444

Merged
n-riesco merged 5 commits into
masterfrom
plotlyapi/create-grid
May 28, 2018
Merged

Implement API to create a grid to store results of a scheduled query#444
n-riesco merged 5 commits into
masterfrom
plotlyapi/create-grid

Conversation

@n-riesco

Copy link
Copy Markdown
Contributor

This API is needed for the upcoming UI for scheduling queries.

Closes#440


I've also taken the opportunity to move all the code invoking plotlyAPIRequest into file backend/persistent/plotly-api.js.


@tarzzz , could you review this PR, please?

@shannonlal, this is a good PR to get familiar with the API in the backend that connects to Plotly.

cc/ @jackparmer

* Refactor code to retrieve a user's credentials into a function.
* Move all the code that invokes `plotlyAPIRequest` into
`backend/persistent/plotly-api.js`.
* Ensure grids created for testing are deleted when the test completes.
* POST queries accepts field `filename` to create a grid for storing the
results of the scheduled query.
Closes#440

@shannonlalshannonlal left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall really clean. Just some small comments on constants and names of variables. Was able to follow so not a show stopper.

Great job

//
// See API documentation at https://api.plot.ly/v2/
//
// TODO: Refactor as a class with a constructor that takes username as input,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this to be done as part of this PR? Or will you be creating a separate Issue

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, that's future TODO (a nice thing to have but it doesn't cause any issues at the moment).

}).then(res => {
Logger.log(`Request to Plotly for creating a grid took ${process.hrtime(startTime)[0]} seconds`, 2);

if (res.status !== 201) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should be putting this into a constants file with actual codes? I noticed below we have 200, 401, etc. If we used names would make code easier to read

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, it'd make the code less readable (in this context it's clear 201 is an HTTP status code).

Comment threadbackend/persistent/plotly-api.js Outdated
});
}

export function getGridMetadata(fid, requestor) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we use fid or filename? Above it is filename and now it is fid

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Plotly's API uses fid.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we can use getGridMeta as it is more consistent with Plotly nomenclature. Not a big deal though..

});
}

export function updateGrid(rows, fid, uids, requestor) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fid or filename?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Plotly's API uses fid.

accessToken,
method: 'GET'
}).then(function(res) {
if (res.status === 404) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should maybe flip the codes into constants with names?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, it'd make the code less readable (in this context it's clear 404 is an HTTP status code).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that using human readable constant names is generally a good approach. While it's clear that it's an HTTP status code, there are so many specific HTTP status codes, that it's not clear sometimes what an HTTP status code means exactly (e.g. 409 is not a very common status code).

https://philsturgeon.uk/http/2015/08/16/avoid-hardcoding-http-status-codes/

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Gzork One can always open a node session and run:

> http.STATUS_CODES[409]
'Conflict'

I can't think of any REST API that isn't defined in terms of numeric status codes. Let's say, I'm doing a review, and I come across an uncommon status code written like: if (res.status === CONFLICT) {...}. Then, I need to stop my review, and find where CONFLICT has been defined, to be able to confirm that the right status code has been used.

Comment threadbackend/settings.js
@@ -226,3 +228,8 @@ export function saveSetting(settingName, settingValue) {
*/
fs.writeFileSync(getSetting('SETTINGS_PATH'), YAML.stringify(settingsOnFile));

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should put an issue on this. If you remember when we tried to pump out the Athena client on this line it would cause an error.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I sneaked a fix for this in the PR that implemented the CSV connector. See f3df19f .

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Thanks

@n-riesco

Copy link
Copy Markdown
ContributorAuthor

@shannonlal I'm sorry about the quick replies (I'm rushing to wrap up a few things). If you want to discuss further the introduction of STATUS constants or Plotly API, let's open an issue for it.

@shannonlal

Copy link
Copy Markdown
Contributor

@n-riesco Nope. This is a small detail. Looks good and clean. It is a small detail. I would merge it.

@shannonlal

Copy link
Copy Markdown
Contributor

💃

* To be consistent with Plotly nomenclature:
#444 (comment)
getQueries,
saveQuery,
deleteQuery
} from './Queries.js';

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(Not necessarily in this PR) but we should small-case these filenames as well.. !! Queries, Datastore etc, and remove .js extensions to be consistent.. !!

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I want to keep the extensions, because:

  • it's grep-friendly
  • we have imports that only differ in the extension (e.g. code-editor.css and code-editor.jsx)

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The idea is to move to lower case, whenever we have a chance (instead of having a huge big PR). We don't really want to spend time on it.

Comment threadtest/backend/utils.js

return newGrid(uniqueFilename, names, rows, username);
}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

let startTime;

// Check if the user even exists
if (!username || !(apiKey || accessToken)) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can simplify it:

if !(username || apiKey || accessToken) {

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tricky, but not equivalent: the latter doesn't catch the case when username is defined but both apiKey and accessToken are undefined.

});
});

it('can create a grid when it registers a query', function() {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is better if you split this into two commits, one where you move the code into a different file, and anotherwhere you do updates/add new code.

Easier to review, and something to consider for next time.. !!

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK, will do next time.

@tarzzztarzzz left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some comments, but nothing blocking.. !!

💃

@n-riesco
n-riesco merged commit 1b98662 into masterMay 28, 2018
@n-riesco
n-riesco deleted the plotlyapi/create-grid branch June 5, 2018 15:09
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@n-riesco@shannonlal@tarzzz@deepstqte
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Skip to content
This repository was archived by the owner on Aug 29, 2025. It is now read-only.

Implement API to create a grid to store results of a scheduled query - #444

Merged
n-riesco merged 5 commits into
masterfrom
plotlyapi/create-grid
May 28, 2018
Merged

Implement API to create a grid to store results of a scheduled query#444
n-riesco merged 5 commits into
masterfrom
plotlyapi/create-grid

Conversation

@n-riesco

Copy link
Copy Markdown
Contributor

This API is needed for the upcoming UI for scheduling queries.

Closes#440


I've also taken the opportunity to move all the code invoking plotlyAPIRequest into file backend/persistent/plotly-api.js.


@tarzzz , could you review this PR, please?

@shannonlal, this is a good PR to get familiar with the API in the backend that connects to Plotly.

cc/ @jackparmer

* Refactor code to retrieve a user's credentials into a function.
* Move all the code that invokes `plotlyAPIRequest` into
`backend/persistent/plotly-api.js`.
* Ensure grids created for testing are deleted when the test completes.
* POST queries accepts field `filename` to create a grid for storing the
results of the scheduled query.
Closes#440

@shannonlalshannonlal left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall really clean. Just some small comments on constants and names of variables. Was able to follow so not a show stopper.

Great job

//
// See API documentation at https://api.plot.ly/v2/
//
// TODO: Refactor as a class with a constructor that takes username as input,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this to be done as part of this PR? Or will you be creating a separate Issue

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, that's future TODO (a nice thing to have but it doesn't cause any issues at the moment).

}).then(res => {
Logger.log(`Request to Plotly for creating a grid took ${process.hrtime(startTime)[0]} seconds`, 2);

if (res.status !== 201) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should be putting this into a constants file with actual codes? I noticed below we have 200, 401, etc. If we used names would make code easier to read

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, it'd make the code less readable (in this context it's clear 201 is an HTTP status code).

Comment threadbackend/persistent/plotly-api.js Outdated
});
}

export function getGridMetadata(fid, requestor) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we use fid or filename? Above it is filename and now it is fid

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Plotly's API uses fid.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we can use getGridMeta as it is more consistent with Plotly nomenclature. Not a big deal though..

});
}

export function updateGrid(rows, fid, uids, requestor) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fid or filename?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Plotly's API uses fid.

accessToken,
method: 'GET'
}).then(function(res) {
if (res.status === 404) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should maybe flip the codes into constants with names?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, it'd make the code less readable (in this context it's clear 404 is an HTTP status code).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that using human readable constant names is generally a good approach. While it's clear that it's an HTTP status code, there are so many specific HTTP status codes, that it's not clear sometimes what an HTTP status code means exactly (e.g. 409 is not a very common status code).

https://philsturgeon.uk/http/2015/08/16/avoid-hardcoding-http-status-codes/

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Gzork One can always open a node session and run:

> http.STATUS_CODES[409]
'Conflict'

I can't think of any REST API that isn't defined in terms of numeric status codes. Let's say, I'm doing a review, and I come across an uncommon status code written like: if (res.status === CONFLICT) {...}. Then, I need to stop my review, and find where CONFLICT has been defined, to be able to confirm that the right status code has been used.

Comment threadbackend/settings.js
@@ -226,3 +228,8 @@ export function saveSetting(settingName, settingValue) {
*/
fs.writeFileSync(getSetting('SETTINGS_PATH'), YAML.stringify(settingsOnFile));

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should put an issue on this. If you remember when we tried to pump out the Athena client on this line it would cause an error.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I sneaked a fix for this in the PR that implemented the CSV connector. See f3df19f .

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Thanks

@n-riesco

Copy link
Copy Markdown
ContributorAuthor

@shannonlal I'm sorry about the quick replies (I'm rushing to wrap up a few things). If you want to discuss further the introduction of STATUS constants or Plotly API, let's open an issue for it.

@shannonlal

Copy link
Copy Markdown
Contributor

@n-riesco Nope. This is a small detail. Looks good and clean. It is a small detail. I would merge it.

@shannonlal

Copy link
Copy Markdown
Contributor

💃

* To be consistent with Plotly nomenclature:
#444 (comment)
getQueries,
saveQuery,
deleteQuery
} from './Queries.js';

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(Not necessarily in this PR) but we should small-case these filenames as well.. !! Queries, Datastore etc, and remove .js extensions to be consistent.. !!

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I want to keep the extensions, because:

  • it's grep-friendly
  • we have imports that only differ in the extension (e.g. code-editor.css and code-editor.jsx)

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The idea is to move to lower case, whenever we have a chance (instead of having a huge big PR). We don't really want to spend time on it.

Comment threadtest/backend/utils.js

return newGrid(uniqueFilename, names, rows, username);
}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

let startTime;

// Check if the user even exists
if (!username || !(apiKey || accessToken)) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can simplify it:

if !(username || apiKey || accessToken) {

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tricky, but not equivalent: the latter doesn't catch the case when username is defined but both apiKey and accessToken are undefined.

});
});

it('can create a grid when it registers a query', function() {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is better if you split this into two commits, one where you move the code into a different file, and anotherwhere you do updates/add new code.

Easier to review, and something to consider for next time.. !!

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK, will do next time.

@tarzzztarzzz left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some comments, but nothing blocking.. !!

💃

@n-riesco
n-riesco merged commit 1b98662 into masterMay 28, 2018
@n-riesco
n-riesco deleted the plotlyapi/create-grid branch June 5, 2018 15:09
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@n-riesco@shannonlal@tarzzz@deepstqte
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix"); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content
This repository was archived by the owner on Aug 29, 2025. It is now read-only.

Implement API to create a grid to store results of a scheduled query - #444

Merged
n-riesco merged 5 commits into
masterfrom
plotlyapi/create-grid
May 28, 2018
Merged

Implement API to create a grid to store results of a scheduled query#444
n-riesco merged 5 commits into
masterfrom
plotlyapi/create-grid

Conversation

@n-riesco

Copy link
Copy Markdown
Contributor

This API is needed for the upcoming UI for scheduling queries.

Closes#440


I've also taken the opportunity to move all the code invoking plotlyAPIRequest into file backend/persistent/plotly-api.js.


@tarzzz , could you review this PR, please?

@shannonlal, this is a good PR to get familiar with the API in the backend that connects to Plotly.

cc/ @jackparmer

* Refactor code to retrieve a user's credentials into a function.
* Move all the code that invokes `plotlyAPIRequest` into
`backend/persistent/plotly-api.js`.
* Ensure grids created for testing are deleted when the test completes.
* POST queries accepts field `filename` to create a grid for storing the
results of the scheduled query.
Closes#440

@shannonlalshannonlal left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall really clean. Just some small comments on constants and names of variables. Was able to follow so not a show stopper.

Great job

//
// See API documentation at https://api.plot.ly/v2/
//
// TODO: Refactor as a class with a constructor that takes username as input,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this to be done as part of this PR? Or will you be creating a separate Issue

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, that's future TODO (a nice thing to have but it doesn't cause any issues at the moment).

}).then(res => {
Logger.log(`Request to Plotly for creating a grid took ${process.hrtime(startTime)[0]} seconds`, 2);

if (res.status !== 201) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should be putting this into a constants file with actual codes? I noticed below we have 200, 401, etc. If we used names would make code easier to read

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, it'd make the code less readable (in this context it's clear 201 is an HTTP status code).

Comment threadbackend/persistent/plotly-api.js Outdated
});
}

export function getGridMetadata(fid, requestor) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we use fid or filename? Above it is filename and now it is fid

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Plotly's API uses fid.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we can use getGridMeta as it is more consistent with Plotly nomenclature. Not a big deal though..

});
}

export function updateGrid(rows, fid, uids, requestor) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fid or filename?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Plotly's API uses fid.

accessToken,
method: 'GET'
}).then(function(res) {
if (res.status === 404) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should maybe flip the codes into constants with names?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, it'd make the code less readable (in this context it's clear 404 is an HTTP status code).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that using human readable constant names is generally a good approach. While it's clear that it's an HTTP status code, there are so many specific HTTP status codes, that it's not clear sometimes what an HTTP status code means exactly (e.g. 409 is not a very common status code).

https://philsturgeon.uk/http/2015/08/16/avoid-hardcoding-http-status-codes/

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Gzork One can always open a node session and run:

> http.STATUS_CODES[409]
'Conflict'

I can't think of any REST API that isn't defined in terms of numeric status codes. Let's say, I'm doing a review, and I come across an uncommon status code written like: if (res.status === CONFLICT) {...}. Then, I need to stop my review, and find where CONFLICT has been defined, to be able to confirm that the right status code has been used.

Comment threadbackend/settings.js
@@ -226,3 +228,8 @@ export function saveSetting(settingName, settingValue) {
*/
fs.writeFileSync(getSetting('SETTINGS_PATH'), YAML.stringify(settingsOnFile));

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should put an issue on this. If you remember when we tried to pump out the Athena client on this line it would cause an error.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I sneaked a fix for this in the PR that implemented the CSV connector. See f3df19f .

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Thanks

@n-riesco

Copy link
Copy Markdown
ContributorAuthor

@shannonlal I'm sorry about the quick replies (I'm rushing to wrap up a few things). If you want to discuss further the introduction of STATUS constants or Plotly API, let's open an issue for it.

@shannonlal

Copy link
Copy Markdown
Contributor

@n-riesco Nope. This is a small detail. Looks good and clean. It is a small detail. I would merge it.

@shannonlal

Copy link
Copy Markdown
Contributor

💃

* To be consistent with Plotly nomenclature:
#444 (comment)
getQueries,
saveQuery,
deleteQuery
} from './Queries.js';

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(Not necessarily in this PR) but we should small-case these filenames as well.. !! Queries, Datastore etc, and remove .js extensions to be consistent.. !!

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I want to keep the extensions, because:

  • it's grep-friendly
  • we have imports that only differ in the extension (e.g. code-editor.css and code-editor.jsx)

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The idea is to move to lower case, whenever we have a chance (instead of having a huge big PR). We don't really want to spend time on it.

Comment threadtest/backend/utils.js

return newGrid(uniqueFilename, names, rows, username);
}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

let startTime;

// Check if the user even exists
if (!username || !(apiKey || accessToken)) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can simplify it:

if !(username || apiKey || accessToken) {

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tricky, but not equivalent: the latter doesn't catch the case when username is defined but both apiKey and accessToken are undefined.

});
});

it('can create a grid when it registers a query', function() {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is better if you split this into two commits, one where you move the code into a different file, and anotherwhere you do updates/add new code.

Easier to review, and something to consider for next time.. !!

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK, will do next time.

@tarzzztarzzz left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some comments, but nothing blocking.. !!

💃

@n-riesco
n-riesco merged commit 1b98662 into masterMay 28, 2018
@n-riesco
n-riesco deleted the plotlyapi/create-grid branch June 5, 2018 15:09
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@n-riesco@shannonlal@tarzzz@deepstqte
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms"); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content
This repository was archived by the owner on Aug 29, 2025. It is now read-only.

Implement API to create a grid to store results of a scheduled query - #444

Merged
n-riesco merged 5 commits into
masterfrom
plotlyapi/create-grid
May 28, 2018
Merged

Implement API to create a grid to store results of a scheduled query#444
n-riesco merged 5 commits into
masterfrom
plotlyapi/create-grid

Conversation

@n-riesco

Copy link
Copy Markdown
Contributor

This API is needed for the upcoming UI for scheduling queries.

Closes#440


I've also taken the opportunity to move all the code invoking plotlyAPIRequest into file backend/persistent/plotly-api.js.


@tarzzz , could you review this PR, please?

@shannonlal, this is a good PR to get familiar with the API in the backend that connects to Plotly.

cc/ @jackparmer

* Refactor code to retrieve a user's credentials into a function.
* Move all the code that invokes `plotlyAPIRequest` into
`backend/persistent/plotly-api.js`.
* Ensure grids created for testing are deleted when the test completes.
* POST queries accepts field `filename` to create a grid for storing the
results of the scheduled query.
Closes#440

@shannonlalshannonlal left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall really clean. Just some small comments on constants and names of variables. Was able to follow so not a show stopper.

Great job

//
// See API documentation at https://api.plot.ly/v2/
//
// TODO: Refactor as a class with a constructor that takes username as input,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this to be done as part of this PR? Or will you be creating a separate Issue

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, that's future TODO (a nice thing to have but it doesn't cause any issues at the moment).

}).then(res => {
Logger.log(`Request to Plotly for creating a grid took ${process.hrtime(startTime)[0]} seconds`, 2);

if (res.status !== 201) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should be putting this into a constants file with actual codes? I noticed below we have 200, 401, etc. If we used names would make code easier to read

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, it'd make the code less readable (in this context it's clear 201 is an HTTP status code).

Comment threadbackend/persistent/plotly-api.js Outdated
});
}

export function getGridMetadata(fid, requestor) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we use fid or filename? Above it is filename and now it is fid

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Plotly's API uses fid.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we can use getGridMeta as it is more consistent with Plotly nomenclature. Not a big deal though..

});
}

export function updateGrid(rows, fid, uids, requestor) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fid or filename?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Plotly's API uses fid.

accessToken,
method: 'GET'
}).then(function(res) {
if (res.status === 404) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should maybe flip the codes into constants with names?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, it'd make the code less readable (in this context it's clear 404 is an HTTP status code).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that using human readable constant names is generally a good approach. While it's clear that it's an HTTP status code, there are so many specific HTTP status codes, that it's not clear sometimes what an HTTP status code means exactly (e.g. 409 is not a very common status code).

https://philsturgeon.uk/http/2015/08/16/avoid-hardcoding-http-status-codes/

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Gzork One can always open a node session and run:

> http.STATUS_CODES[409]
'Conflict'

I can't think of any REST API that isn't defined in terms of numeric status codes. Let's say, I'm doing a review, and I come across an uncommon status code written like: if (res.status === CONFLICT) {...}. Then, I need to stop my review, and find where CONFLICT has been defined, to be able to confirm that the right status code has been used.

Comment threadbackend/settings.js
@@ -226,3 +228,8 @@ export function saveSetting(settingName, settingValue) {
*/
fs.writeFileSync(getSetting('SETTINGS_PATH'), YAML.stringify(settingsOnFile));

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should put an issue on this. If you remember when we tried to pump out the Athena client on this line it would cause an error.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I sneaked a fix for this in the PR that implemented the CSV connector. See f3df19f .

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Thanks

@n-riesco

Copy link
Copy Markdown
ContributorAuthor

@shannonlal I'm sorry about the quick replies (I'm rushing to wrap up a few things). If you want to discuss further the introduction of STATUS constants or Plotly API, let's open an issue for it.

@shannonlal

Copy link
Copy Markdown
Contributor

@n-riesco Nope. This is a small detail. Looks good and clean. It is a small detail. I would merge it.

@shannonlal

Copy link
Copy Markdown
Contributor

💃

* To be consistent with Plotly nomenclature:
#444 (comment)
getQueries,
saveQuery,
deleteQuery
} from './Queries.js';

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(Not necessarily in this PR) but we should small-case these filenames as well.. !! Queries, Datastore etc, and remove .js extensions to be consistent.. !!

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I want to keep the extensions, because:

  • it's grep-friendly
  • we have imports that only differ in the extension (e.g. code-editor.css and code-editor.jsx)

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The idea is to move to lower case, whenever we have a chance (instead of having a huge big PR). We don't really want to spend time on it.

Comment threadtest/backend/utils.js

return newGrid(uniqueFilename, names, rows, username);
}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

let startTime;

// Check if the user even exists
if (!username || !(apiKey || accessToken)) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can simplify it:

if !(username || apiKey || accessToken) {

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tricky, but not equivalent: the latter doesn't catch the case when username is defined but both apiKey and accessToken are undefined.

});
});

it('can create a grid when it registers a query', function() {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is better if you split this into two commits, one where you move the code into a different file, and anotherwhere you do updates/add new code.

Easier to review, and something to consider for next time.. !!

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK, will do next time.

@tarzzztarzzz left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some comments, but nothing blocking.. !!

💃

@n-riesco
n-riesco merged commit 1b98662 into masterMay 28, 2018
@n-riesco
n-riesco deleted the plotlyapi/create-grid branch June 5, 2018 15:09
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@n-riesco@shannonlal@tarzzz@deepstqte
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links"); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + '
Skip to content
This repository was archived by the owner on Aug 29, 2025. It is now read-only.

Implement API to create a grid to store results of a scheduled query - #444

Merged
n-riesco merged 5 commits into
masterfrom
plotlyapi/create-grid
May 28, 2018
Merged

Implement API to create a grid to store results of a scheduled query#444
n-riesco merged 5 commits into
masterfrom
plotlyapi/create-grid

Conversation

@n-riesco

Copy link
Copy Markdown
Contributor

This API is needed for the upcoming UI for scheduling queries.

Closes#440


I've also taken the opportunity to move all the code invoking plotlyAPIRequest into file backend/persistent/plotly-api.js.


@tarzzz , could you review this PR, please?

@shannonlal, this is a good PR to get familiar with the API in the backend that connects to Plotly.

cc/ @jackparmer

* Refactor code to retrieve a user's credentials into a function.
* Move all the code that invokes `plotlyAPIRequest` into
`backend/persistent/plotly-api.js`.
* Ensure grids created for testing are deleted when the test completes.
* POST queries accepts field `filename` to create a grid for storing the
results of the scheduled query.
Closes#440

@shannonlalshannonlal left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall really clean. Just some small comments on constants and names of variables. Was able to follow so not a show stopper.

Great job

//
// See API documentation at https://api.plot.ly/v2/
//
// TODO: Refactor as a class with a constructor that takes username as input,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this to be done as part of this PR? Or will you be creating a separate Issue

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, that's future TODO (a nice thing to have but it doesn't cause any issues at the moment).

}).then(res => {
Logger.log(`Request to Plotly for creating a grid took ${process.hrtime(startTime)[0]} seconds`, 2);

if (res.status !== 201) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should be putting this into a constants file with actual codes? I noticed below we have 200, 401, etc. If we used names would make code easier to read

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, it'd make the code less readable (in this context it's clear 201 is an HTTP status code).

Comment threadbackend/persistent/plotly-api.js Outdated
});
}

export function getGridMetadata(fid, requestor) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we use fid or filename? Above it is filename and now it is fid

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Plotly's API uses fid.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we can use getGridMeta as it is more consistent with Plotly nomenclature. Not a big deal though..

});
}

export function updateGrid(rows, fid, uids, requestor) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fid or filename?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Plotly's API uses fid.

accessToken,
method: 'GET'
}).then(function(res) {
if (res.status === 404) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should maybe flip the codes into constants with names?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, it'd make the code less readable (in this context it's clear 404 is an HTTP status code).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that using human readable constant names is generally a good approach. While it's clear that it's an HTTP status code, there are so many specific HTTP status codes, that it's not clear sometimes what an HTTP status code means exactly (e.g. 409 is not a very common status code).

https://philsturgeon.uk/http/2015/08/16/avoid-hardcoding-http-status-codes/

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Gzork One can always open a node session and run:

> http.STATUS_CODES[409]
'Conflict'

I can't think of any REST API that isn't defined in terms of numeric status codes. Let's say, I'm doing a review, and I come across an uncommon status code written like: if (res.status === CONFLICT) {...}. Then, I need to stop my review, and find where CONFLICT has been defined, to be able to confirm that the right status code has been used.

Comment threadbackend/settings.js
@@ -226,3 +228,8 @@ export function saveSetting(settingName, settingValue) {
*/
fs.writeFileSync(getSetting('SETTINGS_PATH'), YAML.stringify(settingsOnFile));

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should put an issue on this. If you remember when we tried to pump out the Athena client on this line it would cause an error.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I sneaked a fix for this in the PR that implemented the CSV connector. See f3df19f .

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Thanks

@n-riesco

Copy link
Copy Markdown
ContributorAuthor

@shannonlal I'm sorry about the quick replies (I'm rushing to wrap up a few things). If you want to discuss further the introduction of STATUS constants or Plotly API, let's open an issue for it.

@shannonlal

Copy link
Copy Markdown
Contributor

@n-riesco Nope. This is a small detail. Looks good and clean. It is a small detail. I would merge it.

@shannonlal

Copy link
Copy Markdown
Contributor

💃

* To be consistent with Plotly nomenclature:
#444 (comment)
getQueries,
saveQuery,
deleteQuery
} from './Queries.js';

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(Not necessarily in this PR) but we should small-case these filenames as well.. !! Queries, Datastore etc, and remove .js extensions to be consistent.. !!

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I want to keep the extensions, because:

  • it's grep-friendly
  • we have imports that only differ in the extension (e.g. code-editor.css and code-editor.jsx)

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The idea is to move to lower case, whenever we have a chance (instead of having a huge big PR). We don't really want to spend time on it.

Comment threadtest/backend/utils.js

return newGrid(uniqueFilename, names, rows, username);
}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

let startTime;

// Check if the user even exists
if (!username || !(apiKey || accessToken)) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can simplify it:

if !(username || apiKey || accessToken) {

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tricky, but not equivalent: the latter doesn't catch the case when username is defined but both apiKey and accessToken are undefined.

});
});

it('can create a grid when it registers a query', function() {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is better if you split this into two commits, one where you move the code into a different file, and anotherwhere you do updates/add new code.

Easier to review, and something to consider for next time.. !!

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK, will do next time.

@tarzzztarzzz left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some comments, but nothing blocking.. !!

💃

@n-riesco
n-riesco merged commit 1b98662 into masterMay 28, 2018
@n-riesco
n-riesco deleted the plotlyapi/create-grid branch June 5, 2018 15:09
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@n-riesco@shannonlal@tarzzz@deepstqte
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default"); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content
This repository was archived by the owner on Aug 29, 2025. It is now read-only.

Implement API to create a grid to store results of a scheduled query - #444

Merged
n-riesco merged 5 commits into
masterfrom
plotlyapi/create-grid
May 28, 2018
Merged

Implement API to create a grid to store results of a scheduled query#444
n-riesco merged 5 commits into
masterfrom
plotlyapi/create-grid

Conversation

@n-riesco

Copy link
Copy Markdown
Contributor

This API is needed for the upcoming UI for scheduling queries.

Closes#440


I've also taken the opportunity to move all the code invoking plotlyAPIRequest into file backend/persistent/plotly-api.js.


@tarzzz , could you review this PR, please?

@shannonlal, this is a good PR to get familiar with the API in the backend that connects to Plotly.

cc/ @jackparmer

* Refactor code to retrieve a user's credentials into a function.
* Move all the code that invokes `plotlyAPIRequest` into
`backend/persistent/plotly-api.js`.
* Ensure grids created for testing are deleted when the test completes.
* POST queries accepts field `filename` to create a grid for storing the
results of the scheduled query.
Closes#440

@shannonlalshannonlal left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall really clean. Just some small comments on constants and names of variables. Was able to follow so not a show stopper.

Great job

//
// See API documentation at https://api.plot.ly/v2/
//
// TODO: Refactor as a class with a constructor that takes username as input,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this to be done as part of this PR? Or will you be creating a separate Issue

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, that's future TODO (a nice thing to have but it doesn't cause any issues at the moment).

}).then(res => {
Logger.log(`Request to Plotly for creating a grid took ${process.hrtime(startTime)[0]} seconds`, 2);

if (res.status !== 201) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should be putting this into a constants file with actual codes? I noticed below we have 200, 401, etc. If we used names would make code easier to read

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, it'd make the code less readable (in this context it's clear 201 is an HTTP status code).

Comment threadbackend/persistent/plotly-api.js Outdated
});
}

export function getGridMetadata(fid, requestor) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we use fid or filename? Above it is filename and now it is fid

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Plotly's API uses fid.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we can use getGridMeta as it is more consistent with Plotly nomenclature. Not a big deal though..

});
}

export function updateGrid(rows, fid, uids, requestor) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fid or filename?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Plotly's API uses fid.

accessToken,
method: 'GET'
}).then(function(res) {
if (res.status === 404) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should maybe flip the codes into constants with names?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, it'd make the code less readable (in this context it's clear 404 is an HTTP status code).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that using human readable constant names is generally a good approach. While it's clear that it's an HTTP status code, there are so many specific HTTP status codes, that it's not clear sometimes what an HTTP status code means exactly (e.g. 409 is not a very common status code).

https://philsturgeon.uk/http/2015/08/16/avoid-hardcoding-http-status-codes/

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Gzork One can always open a node session and run:

> http.STATUS_CODES[409]
'Conflict'

I can't think of any REST API that isn't defined in terms of numeric status codes. Let's say, I'm doing a review, and I come across an uncommon status code written like: if (res.status === CONFLICT) {...}. Then, I need to stop my review, and find where CONFLICT has been defined, to be able to confirm that the right status code has been used.

Comment threadbackend/settings.js
@@ -226,3 +228,8 @@ export function saveSetting(settingName, settingValue) {
*/
fs.writeFileSync(getSetting('SETTINGS_PATH'), YAML.stringify(settingsOnFile));

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should put an issue on this. If you remember when we tried to pump out the Athena client on this line it would cause an error.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I sneaked a fix for this in the PR that implemented the CSV connector. See f3df19f .

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Thanks

@n-riesco

Copy link
Copy Markdown
ContributorAuthor

@shannonlal I'm sorry about the quick replies (I'm rushing to wrap up a few things). If you want to discuss further the introduction of STATUS constants or Plotly API, let's open an issue for it.

@shannonlal

Copy link
Copy Markdown
Contributor

@n-riesco Nope. This is a small detail. Looks good and clean. It is a small detail. I would merge it.

@shannonlal

Copy link
Copy Markdown
Contributor

💃

* To be consistent with Plotly nomenclature:
#444 (comment)
getQueries,
saveQuery,
deleteQuery
} from './Queries.js';

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(Not necessarily in this PR) but we should small-case these filenames as well.. !! Queries, Datastore etc, and remove .js extensions to be consistent.. !!

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I want to keep the extensions, because:

  • it's grep-friendly
  • we have imports that only differ in the extension (e.g. code-editor.css and code-editor.jsx)

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The idea is to move to lower case, whenever we have a chance (instead of having a huge big PR). We don't really want to spend time on it.

Comment threadtest/backend/utils.js

return newGrid(uniqueFilename, names, rows, username);
}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

let startTime;

// Check if the user even exists
if (!username || !(apiKey || accessToken)) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can simplify it:

if !(username || apiKey || accessToken) {

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tricky, but not equivalent: the latter doesn't catch the case when username is defined but both apiKey and accessToken are undefined.

});
});

it('can create a grid when it registers a query', function() {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is better if you split this into two commits, one where you move the code into a different file, and anotherwhere you do updates/add new code.

Easier to review, and something to consider for next time.. !!

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK, will do next time.

@tarzzztarzzz left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some comments, but nothing blocking.. !!

💃

@n-riesco
n-riesco merged commit 1b98662 into masterMay 28, 2018
@n-riesco
n-riesco deleted the plotlyapi/create-grid branch June 5, 2018 15:09
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@n-riesco@shannonlal@tarzzz@deepstqte
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers"); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content
This repository was archived by the owner on Aug 29, 2025. It is now read-only.

Implement API to create a grid to store results of a scheduled query - #444

Merged
n-riesco merged 5 commits into
masterfrom
plotlyapi/create-grid
May 28, 2018
Merged

Implement API to create a grid to store results of a scheduled query#444
n-riesco merged 5 commits into
masterfrom
plotlyapi/create-grid

Conversation

@n-riesco

Copy link
Copy Markdown
Contributor

This API is needed for the upcoming UI for scheduling queries.

Closes#440


I've also taken the opportunity to move all the code invoking plotlyAPIRequest into file backend/persistent/plotly-api.js.


@tarzzz , could you review this PR, please?

@shannonlal, this is a good PR to get familiar with the API in the backend that connects to Plotly.

cc/ @jackparmer

* Refactor code to retrieve a user's credentials into a function.
* Move all the code that invokes `plotlyAPIRequest` into
`backend/persistent/plotly-api.js`.
* Ensure grids created for testing are deleted when the test completes.
* POST queries accepts field `filename` to create a grid for storing the
results of the scheduled query.
Closes#440

@shannonlalshannonlal left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall really clean. Just some small comments on constants and names of variables. Was able to follow so not a show stopper.

Great job

//
// See API documentation at https://api.plot.ly/v2/
//
// TODO: Refactor as a class with a constructor that takes username as input,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this to be done as part of this PR? Or will you be creating a separate Issue

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, that's future TODO (a nice thing to have but it doesn't cause any issues at the moment).

}).then(res => {
Logger.log(`Request to Plotly for creating a grid took ${process.hrtime(startTime)[0]} seconds`, 2);

if (res.status !== 201) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should be putting this into a constants file with actual codes? I noticed below we have 200, 401, etc. If we used names would make code easier to read

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, it'd make the code less readable (in this context it's clear 201 is an HTTP status code).

Comment threadbackend/persistent/plotly-api.js Outdated
});
}

export function getGridMetadata(fid, requestor) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we use fid or filename? Above it is filename and now it is fid

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Plotly's API uses fid.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we can use getGridMeta as it is more consistent with Plotly nomenclature. Not a big deal though..

});
}

export function updateGrid(rows, fid, uids, requestor) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fid or filename?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Plotly's API uses fid.

accessToken,
method: 'GET'
}).then(function(res) {
if (res.status === 404) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should maybe flip the codes into constants with names?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, it'd make the code less readable (in this context it's clear 404 is an HTTP status code).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that using human readable constant names is generally a good approach. While it's clear that it's an HTTP status code, there are so many specific HTTP status codes, that it's not clear sometimes what an HTTP status code means exactly (e.g. 409 is not a very common status code).

https://philsturgeon.uk/http/2015/08/16/avoid-hardcoding-http-status-codes/

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Gzork One can always open a node session and run:

> http.STATUS_CODES[409]
'Conflict'

I can't think of any REST API that isn't defined in terms of numeric status codes. Let's say, I'm doing a review, and I come across an uncommon status code written like: if (res.status === CONFLICT) {...}. Then, I need to stop my review, and find where CONFLICT has been defined, to be able to confirm that the right status code has been used.

Comment threadbackend/settings.js
@@ -226,3 +228,8 @@ export function saveSetting(settingName, settingValue) {
*/
fs.writeFileSync(getSetting('SETTINGS_PATH'), YAML.stringify(settingsOnFile));

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should put an issue on this. If you remember when we tried to pump out the Athena client on this line it would cause an error.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I sneaked a fix for this in the PR that implemented the CSV connector. See f3df19f .

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Thanks

@n-riesco

Copy link
Copy Markdown
ContributorAuthor

@shannonlal I'm sorry about the quick replies (I'm rushing to wrap up a few things). If you want to discuss further the introduction of STATUS constants or Plotly API, let's open an issue for it.

@shannonlal

Copy link
Copy Markdown
Contributor

@n-riesco Nope. This is a small detail. Looks good and clean. It is a small detail. I would merge it.

@shannonlal

Copy link
Copy Markdown
Contributor

💃

* To be consistent with Plotly nomenclature:
#444 (comment)
getQueries,
saveQuery,
deleteQuery
} from './Queries.js';

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(Not necessarily in this PR) but we should small-case these filenames as well.. !! Queries, Datastore etc, and remove .js extensions to be consistent.. !!

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I want to keep the extensions, because:

  • it's grep-friendly
  • we have imports that only differ in the extension (e.g. code-editor.css and code-editor.jsx)

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The idea is to move to lower case, whenever we have a chance (instead of having a huge big PR). We don't really want to spend time on it.

Comment threadtest/backend/utils.js

return newGrid(uniqueFilename, names, rows, username);
}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

let startTime;

// Check if the user even exists
if (!username || !(apiKey || accessToken)) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can simplify it:

if !(username || apiKey || accessToken) {

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tricky, but not equivalent: the latter doesn't catch the case when username is defined but both apiKey and accessToken are undefined.

});
});

it('can create a grid when it registers a query', function() {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is better if you split this into two commits, one where you move the code into a different file, and anotherwhere you do updates/add new code.

Easier to review, and something to consider for next time.. !!

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK, will do next time.

@tarzzztarzzz left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some comments, but nothing blocking.. !!

💃

@n-riesco
n-riesco merged commit 1b98662 into masterMay 28, 2018
@n-riesco
n-riesco deleted the plotlyapi/create-grid branch June 5, 2018 15:09
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@n-riesco@shannonlal@tarzzz@deepstqte
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode"); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })();
Skip to content
This repository was archived by the owner on Aug 29, 2025. It is now read-only.

Implement API to create a grid to store results of a scheduled query - #444

Merged
n-riesco merged 5 commits into
masterfrom
plotlyapi/create-grid
May 28, 2018
Merged

Implement API to create a grid to store results of a scheduled query#444
n-riesco merged 5 commits into
masterfrom
plotlyapi/create-grid

Conversation

@n-riesco

Copy link
Copy Markdown
Contributor

This API is needed for the upcoming UI for scheduling queries.

Closes#440


I've also taken the opportunity to move all the code invoking plotlyAPIRequest into file backend/persistent/plotly-api.js.


@tarzzz , could you review this PR, please?

@shannonlal, this is a good PR to get familiar with the API in the backend that connects to Plotly.

cc/ @jackparmer

* Refactor code to retrieve a user's credentials into a function.
* Move all the code that invokes `plotlyAPIRequest` into
`backend/persistent/plotly-api.js`.
* Ensure grids created for testing are deleted when the test completes.
* POST queries accepts field `filename` to create a grid for storing the
results of the scheduled query.
Closes#440

@shannonlalshannonlal left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall really clean. Just some small comments on constants and names of variables. Was able to follow so not a show stopper.

Great job

//
// See API documentation at https://api.plot.ly/v2/
//
// TODO: Refactor as a class with a constructor that takes username as input,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this to be done as part of this PR? Or will you be creating a separate Issue

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, that's future TODO (a nice thing to have but it doesn't cause any issues at the moment).

}).then(res => {
Logger.log(`Request to Plotly for creating a grid took ${process.hrtime(startTime)[0]} seconds`, 2);

if (res.status !== 201) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should be putting this into a constants file with actual codes? I noticed below we have 200, 401, etc. If we used names would make code easier to read

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, it'd make the code less readable (in this context it's clear 201 is an HTTP status code).

Comment threadbackend/persistent/plotly-api.js Outdated
});
}

export function getGridMetadata(fid, requestor) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we use fid or filename? Above it is filename and now it is fid

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Plotly's API uses fid.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we can use getGridMeta as it is more consistent with Plotly nomenclature. Not a big deal though..

});
}

export function updateGrid(rows, fid, uids, requestor) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fid or filename?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Plotly's API uses fid.

accessToken,
method: 'GET'
}).then(function(res) {
if (res.status === 404) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should maybe flip the codes into constants with names?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, it'd make the code less readable (in this context it's clear 404 is an HTTP status code).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that using human readable constant names is generally a good approach. While it's clear that it's an HTTP status code, there are so many specific HTTP status codes, that it's not clear sometimes what an HTTP status code means exactly (e.g. 409 is not a very common status code).

https://philsturgeon.uk/http/2015/08/16/avoid-hardcoding-http-status-codes/

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Gzork One can always open a node session and run:

> http.STATUS_CODES[409]
'Conflict'

I can't think of any REST API that isn't defined in terms of numeric status codes. Let's say, I'm doing a review, and I come across an uncommon status code written like: if (res.status === CONFLICT) {...}. Then, I need to stop my review, and find where CONFLICT has been defined, to be able to confirm that the right status code has been used.

Comment threadbackend/settings.js
@@ -226,3 +228,8 @@ export function saveSetting(settingName, settingValue) {
*/
fs.writeFileSync(getSetting('SETTINGS_PATH'), YAML.stringify(settingsOnFile));

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should put an issue on this. If you remember when we tried to pump out the Athena client on this line it would cause an error.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I sneaked a fix for this in the PR that implemented the CSV connector. See f3df19f .

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Thanks

@n-riesco

Copy link
Copy Markdown
ContributorAuthor

@shannonlal I'm sorry about the quick replies (I'm rushing to wrap up a few things). If you want to discuss further the introduction of STATUS constants or Plotly API, let's open an issue for it.

@shannonlal

Copy link
Copy Markdown
Contributor

@n-riesco Nope. This is a small detail. Looks good and clean. It is a small detail. I would merge it.

@shannonlal

Copy link
Copy Markdown
Contributor

💃

* To be consistent with Plotly nomenclature:
#444 (comment)
getQueries,
saveQuery,
deleteQuery
} from './Queries.js';

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(Not necessarily in this PR) but we should small-case these filenames as well.. !! Queries, Datastore etc, and remove .js extensions to be consistent.. !!

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I want to keep the extensions, because:

  • it's grep-friendly
  • we have imports that only differ in the extension (e.g. code-editor.css and code-editor.jsx)

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The idea is to move to lower case, whenever we have a chance (instead of having a huge big PR). We don't really want to spend time on it.

Comment threadtest/backend/utils.js

return newGrid(uniqueFilename, names, rows, username);
}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

let startTime;

// Check if the user even exists
if (!username || !(apiKey || accessToken)) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can simplify it:

if !(username || apiKey || accessToken) {

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tricky, but not equivalent: the latter doesn't catch the case when username is defined but both apiKey and accessToken are undefined.

});
});

it('can create a grid when it registers a query', function() {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is better if you split this into two commits, one where you move the code into a different file, and anotherwhere you do updates/add new code.

Easier to review, and something to consider for next time.. !!

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK, will do next time.

@tarzzztarzzz left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some comments, but nothing blocking.. !!

💃

@n-riesco
n-riesco merged commit 1b98662 into masterMay 28, 2018
@n-riesco
n-riesco deleted the plotlyapi/create-grid branch June 5, 2018 15:09
Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@n-riesco@shannonlal@tarzzz@deepstqte