Uh oh!
There was an error while loading. Please reload this page.
HBASE-22625 documet use scan snapshot feature - #496
Conversation
Apache-HBase
commented
Aug 15, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 15, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 16, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 16, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 16, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 16, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 17, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 17, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 17, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 17, 2019
🎊 +1 overall
This message was automatically generated. |
| === TableSnapshotScanner | ||
| TableSnapshotScanner provide a way to do single client side scan over snapshot files. | ||
| When use TableSnapshotScanner, we must specify a temporary directory to copy the snapshot files into. Current user should have write permissions to this directory, and this should not be a subdirectory of rootdir. The scanner deletes the contents of the directory once the scanner is closed. |
There was a problem hiding this comment.
copy the snapshot files into. -> restore the snapshot
| :source-language: java | ||
| In HBase, scan a table costs many CPU, memory... resources. Luckily, HBase provides a TableSnapshotScanner and TableSnapshotInputFormat (introduced by link:https://issues.apache.org/jira/browse/HBASE-8369[HBASE-8369]), which performs a scan over snapshot files. | ||
| By this way, we can bypasse HBase servers, and access the underlying files directly to provide maximum performance. And can also be used with offline HBase with in-place or exported snapshot files. |
| :toc: left | ||
| :source-language: java | ||
| In HBase, scan a table costs many CPU, memory... resources. Luckily, HBase provides a TableSnapshotScanner and TableSnapshotInputFormat (introduced by link:https://issues.apache.org/jira/browse/HBASE-8369[HBASE-8369]), which performs a scan over snapshot files. |
There was a problem hiding this comment.
scan a table costs many CPU, memory... resources -> scanning a big table will put tremendous pressure on the cluster.
| [source,java] | ||
| ---- | ||
| Job job = new Job(conf); | ||
| Path restoreDir = new Path("XX"); // restore dir should not be a subdirectory HBase rootdir |
| ==== HDFS ACLs | ||
| HDFS ACLs supports an "access ACL", which defines the rules to enforce during permission checks, and a "default ACL", which defines the ACL entries that new child files or sub-directories receive automatically during creation. |
There was a problem hiding this comment.
Provide a link referring to the document of HDFS ACL ?
| hbase.acl.sync.to.hdfs.enable=true | ||
| ---- | ||
| * Modify table scheme to enable this feature for a specified table, this config is false by default for every table, this means the HBase granted acls will not synced to HDFS |
There was a problem hiding this comment.
will not synced -> will not be synced
Apache-HBase
commented
Aug 18, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 19, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 19, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 19, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 20, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 20, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 21, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 21, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 21, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 21, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 21, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 22, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 22, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 22, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 22, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 22, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 23, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 23, 2019
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 23, 2019
🎊 +1 overall
This message was automatically generated. |
Addendum adding Zheng Hu feedback.
saintstack
commented
Aug 23, 2019
I pushed @openinx review edits as an addendum. |
| ==== Basic idea | ||
| The HBase files are orginazed as the following ways: |
| hbase.acl.sync.to.hdfs.enable=true | ||
| ---- | ||
| * Modify table scheme to enable this feature for a specified table, this config is false by default for every table, this means the HBase granted acls will not synced to HDFS |
There was a problem hiding this comment.
scheme->schema (or CONFIGURATION)?
Fix feedback from Clay Baenziger. Signed-off-by: Clay Baenziger <cwb@clayb.net>
No description provided.