Skip to content

[BEAM-173] Publish DisplayData for PipelineOptions - #127

Closed
swegner wants to merge 13 commits into
apache:masterfrom
swegner:displaydata-pipeline
Closed

[BEAM-173] Publish DisplayData for PipelineOptions#127
swegner wants to merge 13 commits into
apache:masterfrom
swegner:displaydata-pipeline

Conversation

@swegner

Copy link
Copy Markdown
Contributor

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

  • Make sure the PR title is formatted like:
    [BEAM-<Jira issue #>] Description of pull request
  • Make sure tests pass via mvn clean verify. (Even better, enable
    Travis-CI on your fork and ensure the whole test matrix passes).
  • Replace "<Jira issue #>" in the title with the actual Jira issue
    number, if there is one.
  • If this contribution is large, please file an Apache
    Individual Contributor License Agreement.

@swegner

Copy link
Copy Markdown
ContributorAuthor

R: @lukecwik

/**
* A property defined in a {@link PipelineOptions} interface.
*/
static class Property {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Perhaps this should be a PipelineOption (since it makes sense that a PipelineOptions object contains PipelineOption objects).

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, I'm not very happy with the current name. I'm weary of introducing PipelineOption as it sounds like a primitive, and I don't want the scope of this to balloon too much. But maybe..

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be nice to only have either PropertyDescriptor or Property but not both.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I looked further into this, and it seems we really have two disjoint concepts that won't merge well together. We're using PropertyDescriptor to represent the combined options surface for all known PipelineOptions interfaces. What we need for DisplayData is information about the specific PipelineOptions interface(s) than an option comes from. PropertyDescription doesn't work well here. I think it's best to keep the two concepts separate.

I've renamed this class to PipelineOptionSpec-- let me know what you think.

@swegner
swegnerforce-pushed the displaydata-pipeline branch 2 times, most recently from 16802b9 to 7573549CompareApril 7, 2016 17:43
tgroh pushed a commit to tgroh/beam that referenced this pull request Apr 7, 2016
@Override
public void setTempLocation(String tempLocation) {
}

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Replace with PipelineOptionsFactory.create() instead of anonymous inner class of PipelineOptions

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done. /cc @mxm

@swegner
swegnerforce-pushed the displaydata-pipeline branch 3 times, most recently from 251ef71 to 3769ef4CompareApril 14, 2016 16:11
@swegner

Copy link
Copy Markdown
ContributorAuthor

I've addressed all feedback so far. Please take another look. @lukecwik

}
}

/**

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

avaialble -> available

+ Arrays.toString(args) + "].");
}

/**

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it won't be retrieved from deserialized JSON since that is contained completely within a different map.

This just tracks whether came from a default vs being explicitly set.

@lukecwik

Copy link
Copy Markdown
Member

Last minor fixups and then LGTM

@swegner
swegnerforce-pushed the displaydata-pipeline branch from 946d56d to 249aa93CompareApril 21, 2016 21:26
@swegner

Copy link
Copy Markdown
ContributorAuthor

I've addressed all feedback so far. Please take another look. @lukecwik

@lukecwik

Copy link
Copy Markdown
Member

It looks like you missed two comments about fixing javadoc.

@swegner
swegnerforce-pushed the displaydata-pipeline branch from 5c7bcb5 to 45aa73cCompareApril 22, 2016 21:41
@swegner

Copy link
Copy Markdown
ContributorAuthor

Sorry, missed those javadoc comments. this should be ready now. @lukecwik

@lukecwik

Copy link
Copy Markdown
Member

LGTM

@swegner
swegner deleted the displaydata-pipeline branch April 22, 2016 23:03
@swegner

Copy link
Copy Markdown
ContributorAuthor

Backported via GoogleCloudPlatform/DataflowJavaSDK#216

iemejia referenced this pull request in iemejia/beam Jan 12, 2018
pl04351820 pushed a commit to pl04351820/beam that referenced this pull request Dec 20, 2023
* feat: create AsyncIter class for mocking
* fix: type error on mocked return on batch_get_documents
* feat: integrate microgen async client to query
FuRyanf pushed a commit to FuRyanf/beam that referenced this pull request Sep 20, 2024
…y-name-cache
Introduce CachedToStringMetricKey and CachedToStringMetricName for Improved Performance
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@swegner@lukecwik@bjchambers