Bigtable: 02. Surface: Readrows by igorbernstein2 · Pull Request #2849 · googleapis/google-cloud-java

igorbernstein2 · 2018-02-03T03:39:29Z

Adding the user facing api for ReadRows:

Adds wrappers for the ReadRowsRequest and Response
Introduces a fluent DSL for filters
Introduces the custom RowAdapter api where the user can customize the logical rows without introducing extra copies

This has been reviewed Kevin. However some things have changed since the original review:

The filter DSL has done through another iteration in Adding a wrapper for RowFilter java-bigtable-hbase#1617
The original code was adapted to use the StubSettings
As per Solomon's suggestion, the custom RowAdapter was localized to a special callable instead of the whole client
The filter range api was re-worked

igorbernstein2 · 2018-02-08T16:14:35Z

rebased

Adding the user facing api for ReadRows: - Adds wrappers for the ReadRowsRequest and Response - Introduces a fluent DSL for filters - Introduces the custom RowAdapter api where the user can customize the logical rows without introducing extra copies

Sign in to view

+ * // Do something with row
+ * }
+ *
+ * // Point look ups


Sign in to view

+import java.util.List;
+
+/**
+ * An extension point that allows end users to plugin a custom implementation of logical rows. This


Sign in to view

+/**
+ * An extension point that allows end users to plugin a custom implementation of logical rows. This
+ * useful in cases where the user would like to apply advanced client side filtering of cells. This
+ * adapter acts like a factory for SAX style a row builder.


Sign in to view

+
+ /** Returns the row key */
+ @Nonnull
+ public abstract ByteString key();


Sign in to view

+
+ /** Default representation of a cell in a {@link Row}. */
+ @AutoValue
+ public abstract static class Cell {


Sign in to view

+/**
+ * A Fluent DSL to create a hierarchy of filters for the CheckAndMutateRow RPCs and ReadRows Query.
+ *
+ * <p>Intended usage is to statically import, or in case of conflict assign the static variable


Sign in to view


 // Per-method settings using baseSettings for defaults.
+ readRowsSettings = ServerStreamingCallSettings.newBuilder();
+ /* TODO: copy timeouts, retryCodes & retrySettings from baseSettings.readRows once it exists in GAPIC */


Sign in to view

 stub.close();
 }
+
+ /**


kevinsi4508

Will look at some more later.

Sign in to view

+ * @see Query For query options.
+ * @see com.google.cloud.bigtable.data.v2.wrappers.Filters For the filter building DSL.
+ */
+ public <RowT> ServerStreamingCallable<Query, RowT> readRowsCallable(RowAdapter<RowT> rowAdapter) {


Sign in to view

+ /** {@inheritDoc} */
+ @Override
+ public void cellValue(ByteString value) {
+ this.value = this.value.concat(value);


kevinsi4508

Some more comments. It is a Big PR.

Sign in to view

+ /**
+ * Constructs a new Query object for the specified table id. The table id will be resolved against
+ * the instance id specified in the {@link
+ * com.google.cloud.bigtable.data.v2.BigtableDataSettings}.


Sign in to view

+ public Query range(ByteStringRange range) {
+ RowRange.Builder rangeBuilder = RowRange.newBuilder();
+
+ switch (range.getStartBound()) {


Sign in to view

+ rangeBuilder.setStartKeyClosed(range.getStart());
+ break;
+ default:
+ throw new IllegalStateException("Unknown range bound: " + range.getStartBound());


Sign in to view

+ rangeBuilder.setEndKeyClosed(range.getEnd());
+ break;
+ default:
+ throw new IllegalStateException("Unknown range bound: " + range.getEndBound());


Sign in to view

+ }
+
+ /**
+ * Sets the filter to look apply to each row. Only one filter can be set at a time. To use


Sign in to view

+ return builder
+ .setTableName(tableName.toString())
+ .setAppProfileId(requestContext.getAppProfileId())
+ .build();


Sign in to view

+ public enum BoundType {
+ OPEN,
+ CLOSED,
+ UNBOUNDED


Sign in to view

+ this.start = start;
+ this.startBound = startBound;
+ this.end = end;
+ this.endBound = endBound;


Sign in to view

+ /**
+ * Creates a new {@link Range} with the specified inclusive start and the specified exclusive end.
+ */
+ public R of(T startClosed, T endOpen) {


Sign in to view

+import com.google.protobuf.ByteString;
+
+/**
+ * Range API.


igorbernstein2 · 2018-02-09T15:52:43Z

Thanks for reviewing! I think addressed all feedback, PTAL

garrettjonesgoogle

@pongad , could you take a look too?

Sign in to view

+ case UNBOUNDED:
+ break;
+ default:
+ throw new IllegalStateException("Unknown end bound: " + getStartBound());


Sign in to view

+
+ // Extracted from: re2 QuoteMeta:
+ // https://github.com/google/re2/blob/70f66454c255080a54a8da806c52d1f618707f8a/re2/re2.cc#L456
+ private static void writeLiteralRegex(ByteIterator input, OutputStream output)


Sign in to view

+import java.io.OutputStream;
+
+@InternalApi
+public final class RegexUtil {


igorbernstein2 · 2018-02-12T15:55:11Z

All feedback addressed. Please merge when ready

…54.0 (#2849)

🤖 I have created a release *beep* *boop* --- ### Updating meta-information for bleeding-edge SNAPSHOT release. --- This PR was generated with [Release Please](https://togithub.com/googleapis/release-please). See [documentation](https://togithub.com/googleapis/release-please#release-please).

* test: clean up instance in test Change-Id: Ib3a73e2cc24f7e27fd346eb80b7ec5175e3c11a4 * format Change-Id: I41393dc1a87fffa0e8ec72d791a80f6e1434ab65

igorbernstein2 requested a review from pongad as a code owner February 3, 2018 03:39

googlebot added the cla: yes This human has signed the Contributor License Agreement. label Feb 3, 2018

igorbernstein2 force-pushed the 02-surface-readrows branch 7 times, most recently from 454512e to 58c62b0Compare February 6, 2018 01:46

This was referenced Feb 6, 2018
Bigtable: 04. Surface: MutateRow #2861
Merged
Server streaming retries take 2 googleapis/gax-java#463
Merged

igorbernstein2 force-pushed the 02-surface-readrows branch from 58c62b0 to 1eb9a51Compare February 8, 2018 16:13

igorbernstein2 added 8 commits February 8, 2018 18:59

02. Surface: ReadRows
f374e66
Adding the user facing api for ReadRows: - Adds wrappers for the ReadRowsRequest and Response - Introduces a fluent DSL for filters - Introduces the custom RowAdapter api where the user can customize the logical rows without introducing extra copies

codacy fixes
8b838cd

Refactor Range support to allow for a consistent api
cd41c0f

tweaks
9b46ae4

Truth static import
fa5aafc

cleanup imports
88da7de

reformat
e3684fb

remove placeholder
90cc127

igorbernstein2 force-pushed the 02-surface-readrows branch from d18ab82 to 90cc127Compare February 9, 2018 00:07

googleapis deleted a comment Feb 9, 2018

igorbernstein2 added 3 commits February 8, 2018 19:11

fix visibility of clone
0e8ff21

tweaks
db00235

tweaks
45c7b05

kevinsi4508 reviewed Feb 9, 2018
View reviewed changes

Comment threadgoogle-cloud-bigtable/src/main/java/com/google/cloud/bigtable/data/v2/BigtableDataClient.java Outdated
* // Do something with row
* }
*
* // Point look ups
This comment was marked as spam.
Sign in to view
This comment was marked as spam.
Sign in to view

garrettjonesgoogle reviewed Feb 9, 2018
View reviewed changes

kevinsi4508 reviewed Feb 9, 2018
View reviewed changes

igorbernstein2 added 3 commits February 9, 2018 10:44

address feedback
106b54a

move close()
bc0dae6

sanity check query limit
8be1339

oops, forgot to commit this
1328f6a

garrettjonesgoogle reviewed Feb 10, 2018
View reviewed changes

fix error message
e9c7439

pongad reviewed Feb 12, 2018
View reviewed changes

address feedback
6e64dc3

move close to end
869da95

pongad merged commit afba679 into googleapis:masterFeb 12, 2018

igorbernstein2 deleted the 02-surface-readrows branch February 20, 2018 17:06

chingor13 pushed a commit that referenced this pull request Feb 20, 2026
chore(deps): update dependency com.google.cloud:libraries-bom to v26.…
62ceed6
…54.0 (#2849)

chingor13 pushed a commit that referenced this pull request Mar 30, 2026
test(deps): update cross product test dependencies (#2849)
5f1680a

Uh oh!

Conversation

igorbernstein2 commented Feb 3, 2018• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

igorbernstein2 commented Feb 8, 2018

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

kevinsi4508 left a comment

Choose a reason for hiding this comment

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

kevinsi4508 left a comment

Choose a reason for hiding this comment

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

Uh oh!

This comment was marked as spam.

igorbernstein2 commented Feb 3, 2018•
edited
Loading