Skip to content

HDDS-5158. Add documentation for SCM HA Security. - #2205

Merged
xiaoyuyao merged 4 commits into
apache:masterfrom
bharatviswa504:HDDS-5158
May 26, 2021
Merged

HDDS-5158. Add documentation for SCM HA Security.#2205
xiaoyuyao merged 4 commits into
apache:masterfrom
bharatviswa504:HDDS-5158

Conversation

@bharatviswa504

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

Add SCM HA security documentation.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-5158

How was this patch tested?

Deployed docs locally and verified content.

Comment threadhadoop-hdds/docs/content/feature/SCM-HA.md Outdated

@xiaoyuyaoxiaoyuyao left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @bharatviswa504 for the PR. It looks good to me overall. A few suggestions added inline.

Comment threadhadoop-hdds/docs/content/feature/SCM-HA.md Outdated
</property>
```

Above configs are needed in addition to normal SCM HA configuration.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we add some details about how primordial SCM is determined by SCM? Like, the first node in the SCM node list or a specific configuration key?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

@bharatviswa504bharatviswa504 left a comment

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank You @xiaoyuyao for the review. I have addressed review comments.


### Primordial SCM:

Primordial SCM is determined from the config ozone.scm.primordial.node.id.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we add some description about how it is determined when ozone.scm.primordial.node.id is not defined?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated it

@xiaoyuyao

Copy link
Copy Markdown
Contributor

/retest

@github-actions

Copy link
Copy Markdown

@bharatviswa504 please trigger new CI check by following these steps:

git commit --allow-empty -m 'trigger new CI check'
git push

@xiaoyuyaoxiaoyuyao left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, +1.

@xiaoyuyao
xiaoyuyao merged commit 4301315 into apache:masterMay 26, 2021
errose28 added a commit to errose28/ozone that referenced this pull request Jun 1, 2021
…ing-upgrade-master-merge
* upstream/master: (76 commits)
HDDS-5280. Make XceiverClientManager creation when necessary in ContainerOperationClient (apache#2289)
HDDS-5272. Make ozonefs.robot execution repeatable (apache#2280)
HDDS-5123. Use the pre-created apache/ozone-testkrb5 image during secure acceptance tests (apache#2165)
HDDS-4993. Add guardrail for reserved buffer size when DN reads a chunk (apache#2058)
HDDS-4936. Change ozone groupId from org.apache.hadoop to org.apache.ozone (apache#2018)
HDDS-4043. allow deletion from Trash directory without -skipTrash option (apache#2110)
HDDS-4927. Determine over and under utilized datanodes in Container Balancer. (apache#2230)
HDDS-5273. Handle unsecure cluster convert to secure cluster for SCM. (apache#2281)
HDDS-5158. Add documentation for SCM HA Security. (apache#2205)
HDDS-5275. Datanode Report Publisher publishes one extra report after DN shutdown (apache#2283)
HDDS-5241. SCM UI should have leader/follower and Primordial SCM information (apache#2260)
HDDS-5219. Limit number of bad volumes by dfs.datanode.failed.volumes.tolerated. (apache#2243)
HDDS-5252. PipelinePlacementPolicy filter out datanodes with not enough space. (apache#2271)
HDDS-5191. Increase default pvc storage size (apache#2219)
HDDS-5073. Use ReplicationConfig on client side (apache#2136)
HDDS-5250. Build integration tests with Maven cache (apache#2269)
HDDS-5236. Require block token for more operations (apache#2254)
HDDS-5266 Misspelt words in S3MultipartUploadCommitPartRequest.java line 202 (apache#2279)
HDDS-5249. Race Condition between Full and Incremental Container Reports (apache#2268)
HDDS-5142. Make generic streaming client/service for container re-replication, data read, scm/om snapshot download (apache#2256)
...
Conflicts:
hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/protocol/StorageContainerLocationProtocol.java
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/scm/protocolPB/StorageContainerLocationProtocolClientSideTranslatorPB.java
hadoop-hdds/interface-admin/src/main/proto/ScmAdminProtocol.proto
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/server/StorageContainerManager.java
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/MockNodeManager.java
hadoop-ozone/dist/src/main/compose/testlib.sh
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/TestStorageContainerManager.java
hadoop-ozone/interface-client/src/main/proto/OmClientProtocol.proto
hadoop-ozone/ozone-manager/pom.xml
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/ratis/utils/OzoneManagerRatisUtils.java
hadoop-ozone/s3gateway/pom.xml
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@bharatviswa504@xiaoyuyao