Skip to content

HDDS-8237. [Snapshot] loadDb() used by SstFiltering service creates extraneous directories. - #4446

Merged
smengcl merged 13 commits into
apache:masterfrom
GeorgeJahad:HDDS-8237
Apr 5, 2023
Merged

HDDS-8237. [Snapshot] loadDb() used by SstFiltering service creates extraneous directories.#4446
smengcl merged 13 commits into
apache:masterfrom
GeorgeJahad:HDDS-8237

Conversation

@GeorgeJahad

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

Fix bug that creates extraneous snapshot directories

ls -ld /data/metadata/db.snapshots/db*
drwxr-xr-x 2 hadoop hadoop 4096 Mar 22 03:27 /data/metadata/db.snapshots/db.checkpoints
drwxr-xr-x 2 hadoop hadoop 4096 Mar 22 03:27 /data/metadata/db.snapshots/db.snapshots

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-8237

How was this patch tested?

Ran 'ls' again as above.

@adoroszlaiadoroszlai added the snapshot https://issues.apache.org/jira/browse/HDDS-6517 label Mar 22, 2023

@hemantk-12hemantk-12 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the patch @GeorgeJahad.

+1.

Left couple of minor comments.

GeorgeJahadand others added 2 commits March 24, 2023 12:21
…ls/db/RDBStore.java
Co-authored-by: Hemant Kumar <hemantadhvaniya@gmail.com>

@prashantpogdeprashantpogde left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM with a minor nit.

@prashantpogde

Copy link
Copy Markdown
Contributor

@GeorgeJahad Can you please resolve the conflict ?

@smengclsmengcl left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @GeorgeJahad for taking care of this.

@smengcl

Copy link
Copy Markdown
Contributor

CI passed on @GeorgeJahad 's fork's branch: https://github.com/GeorgeJahad/ozone/actions/runs/4613253792

But there are some (seemingly irrelevant) flakiness in PR CI:

https://github.com/apache/ozone/actions/runs/4613253988/jobs/8155048388

Error: Failures: Error: TestContainerStateCounts.testDeletedContainerCount:383 expected: <5> but was: <2>

https://github.com/apache/ozone/actions/runs/4613253988/jobs/8155259011

Error: Failed to execute goal org.apache.hadoop:hadoop-maven-plugins:3.3.5:version-info (version-info) on project ozone-common: java.util.ConcurrentModificationException -> [Help 1]

Retriggered PR CI.

@smengcl

Copy link
Copy Markdown
Contributor

Thanks @hemantk-12 and @prashantpogde for reviewing this.

@smengcl
smengcl merged commit 05d9d85 into apache:masterApr 5, 2023
errose28 added a commit to errose28/ozone that referenced this pull request Apr 6, 2023
* master: (155 commits)
update readme (apache#4535)
HDDS-8374. Disable flaky unit test: TestContainerStateCounts
HDDS-8016. updated the ozone doc for linked bucket and deletion async limitation (apache#4526)
HDDS-8237. [Snapshot] loadDb() used by SstFiltering service creates extraneous directories. (apache#4446)
HDDS-8035. Intermittent timeout in TestOzoneManagerHAWithData.testOMHAMetrics (apache#4362)
HDDS-8039. Allow container inspector to run from ozone debug. (apache#4337)
HDDS-8304. [Snapshot] Reduce flakiness in testSkipTrackingWithZeroSnapshot (apache#4487)
HDDS-7974. [Snapshot] KeyDeletingService to be aware of Ozone snapshots (apache#4486)
HDDS-8368. ReplicationManager: Create ContainerReplicaOp with correct target Datanode (apache#4532)
HDDS-8358. Fix the space usage comparator in ContainerBalancerSelectionCriteria (apache#4527)
HDDS-8359. ReplicationManager: Fix getContainerReplicationHealth() so that it builds ContainerCheckRequest correctly (apache#4528)
HDDS-8361. Useless object in TestOzoneBlockTokenIdentifier (apache#4517)
HDDS-8325. Consolidate and refine RocksDB metrics of services (apache#4506)
HDDS-8135. Incorrect synchronization during certificate renewal in DefaultCertificateClient. (apache#4381)
HDDS-8127. Exclude deleted containers from Recon container count (apache#4440)
HDDS-8364. ReadReplicas may give wrong results with topology-aware read enabled (apache#4522)
HDDS-8354. Avoid WARNING about ObjectEndpoint#get (apache#4515)
HDDS-8324. DN data cache gets removed randomly asking for data from disk (apache#4499)
HDDS-8291. Upgrade to Hadoop 3.3.5 (apache#4484)
HDDS-8355. Mark TestOMRatisSnapshots#testInstallSnapshot as flaky
...
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

snapshothttps://issues.apache.org/jira/browse/HDDS-6517

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@GeorgeJahad@prashantpogde@smengcl@hemantk-12@adoroszlai@neils-dev