Skip to content

HDDS-623. On SCM UI, Node Manager info is empty - #523

Merged
ajayydv merged 3 commits into
apache:trunkfrom
elek:HDDS-623
Mar 4, 2019
Merged

HDDS-623. On SCM UI, Node Manager info is empty#523
ajayydv merged 3 commits into
apache:trunkfrom
elek:HDDS-623

Conversation

@elek

@elekelek commented Feb 27, 2019

Copy link
Copy Markdown
Member

Fields like below are empty

Node Manager: Minimum chill mode nodes
Node Manager: Out-of-node chill mode
Node Manager: Chill mode status
Node Manager: Manual chill mode

Please see attached screenshot !Screen Shot 2018-10-10 at 4.19.59 PM.png!

See: https://issues.apache.org/jira/browse/HDDS-623

@elekelek added the ozone label Feb 27, 2019
@hadoop-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec30Docker mode activated.
_ Prechecks _
+1@author0The patch does not contain any @author tags.
-1test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+1mvninstall1027trunk passed
+1compile46trunk passed
+1mvnsite34trunk passed
+1shadedclient1769branch has no errors when building and testing our client artifacts.
+1javadoc25trunk passed
_ Patch Compile Tests _
+1mvninstall33the patch passed
+1compile26the patch passed
+1javac26the patch passed
+1mvnsite28the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedclient746patch has no errors when building and testing our client artifacts.
+1javadoc23the patch passed
_ Other Tests _
-1unit102server-scm in the patch failed.
+1asflicense28The patch does not generate ASF License warnings.
2940
ReasonTests
Failed junit testshadoop.hdds.scm.block.TestBlockManager
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-523/1/artifact/out/Dockerfile
GITHUB PR#523
Optional Testsdupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient
unameLinux 81a86b7df65c 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/hadoop.sh
git revisiontrunk / 6c8c422
mavenversion: Apache Maven 3.3.9
Default Java1.8.0_191
unithttps://builds.apache.org/job/hadoop-multibranch/job/PR-523/1/artifact/out/patch-unit-hadoop-hdds_server-scm.txt
Test Resultshttps://builds.apache.org/job/hadoop-multibranch/job/PR-523/1/testReport/
Max. process+thread count446 (vs. ulimit of 5500)
modulesC: hadoop-hdds/server-scm U: hadoop-hdds/server-scm
Console outputhttps://builds.apache.org/job/hadoop-multibranch/job/PR-523/1/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@bharatviswa504

Copy link
Copy Markdown
Contributor

+1 LGTM. (Not a frontend guy, but as this is not adding any code, so had taken a look at it)

But one more thing I have observed is
Block Manager: Open containers this is also broken, as currently in the code we have a TODO for this
in BlockManagerImpl.java

This also needs to be fixed.

 @Override
public int getOpenContainersNo() {
return 0;
// TODO : FIX ME : The open container being a single number does not make
// sense.
// We have to get open containers by Replication Type and Replication
// factor. Hence returning 0 for now.
// containers.get(HddsProtos.LifeCycleState.OPEN).size();
}

@elek

elek commented Mar 1, 2019

Copy link
Copy Markdown
MemberAuthor

Yup. Nice catch, thank you. I removed that line, too.

@hadoop-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec36Docker mode activated.
_ Prechecks _
+1@author0The patch does not contain any @author tags.
-1test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
-1mvninstall396root in trunk failed.
-1compile22server-scm in trunk failed.
+1mvnsite44trunk passed
+1shadedclient1097branch has no errors when building and testing our client artifacts.
+1javadoc23trunk passed
_ Patch Compile Tests _
+1mvninstall32the patch passed
+1compile25the patch passed
+1javac25the patch passed
+1mvnsite27the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedclient749patch has no errors when building and testing our client artifacts.
+1javadoc18the patch passed
_ Other Tests _
+1unit152server-scm in the patch passed.
+1asflicense27The patch does not generate ASF License warnings.
2306
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-523/2/artifact/out/Dockerfile
GITHUB PR#523
Optional Testsdupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient
unameLinux a7cf3f31e092 4.4.0-139-generic #165-Ubuntu SMP Wed Oct 24 10:58:50 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/hadoop.sh
git revisiontrunk / dcaca19
mavenversion: Apache Maven 3.3.9
Default Java1.8.0_191
mvninstallhttps://builds.apache.org/job/hadoop-multibranch/job/PR-523/2/artifact/out/branch-mvninstall-root.txt
compilehttps://builds.apache.org/job/hadoop-multibranch/job/PR-523/2/artifact/out/branch-compile-hadoop-hdds_server-scm.txt
Test Resultshttps://builds.apache.org/job/hadoop-multibranch/job/PR-523/2/testReport/
Max. process+thread count576 (vs. ulimit of 5500)
modulesC: hadoop-hdds/server-scm U: hadoop-hdds/server-scm
Console outputhttps://builds.apache.org/job/hadoop-multibranch/job/PR-523/2/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@bharatviswa504

Copy link
Copy Markdown
Contributor

Sorry missed in my earlier review, we need to remove below code from scm.js

 var ctrl = this;
$http.get("jmx?qry=Hadoop:service=BlockManager,name=*")
.then(function (result) {
ctrl.blockmanagermetrics = result.data.beans[0];
});
$http.get("jmx?qry=Hadoop:service=SCMNodeManager,name=SCMNodeManagerInfo")
.then(function (result) {
ctrl.nodemanagermetrics = result.data.beans[0];
});

@bharatviswa504bharatviswa504 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Need to update scm.js also to remove few parts of code.

@elek

elek commented Mar 4, 2019

Copy link
Copy Markdown
MemberAuthor

nodemanagermetrics is still required as it's used in the scm-overview.html (NodeCount)

blockmanagermetrics can be removed and I removed it in the last commit.

@hadoop-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec25Docker mode activated.
_ Prechecks _
+1@author0The patch does not contain any @author tags.
-1test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+1mvninstall964trunk passed
+1compile44trunk passed
+1mvnsite30trunk passed
+1shadedclient750branch has no errors when building and testing our client artifacts.
+1javadoc18trunk passed
_ Patch Compile Tests _
+1mvninstall31the patch passed
-1jshint65The patch generated 293 new + 1954 unchanged - 1053 fixed = 2247 total (was 3007)
+1compile24the patch passed
+1javac24the patch passed
+1mvnsite25the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedclient733patch has no errors when building and testing our client artifacts.
+1javadoc18the patch passed
_ Other Tests _
+1unit145server-scm in the patch passed.
+1asflicense25The patch does not generate ASF License warnings.
2897
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-523/3/artifact/out/Dockerfile
GITHUB PR#523
Optional Testsdupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient jshint
unameLinux e8c4c580a94b 4.4.0-139-generic #165-Ubuntu SMP Wed Oct 24 10:58:50 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/hadoop.sh
git revisiontrunk / 15098df
mavenversion: Apache Maven 3.3.9
Default Java1.8.0_191
jshinthttps://builds.apache.org/job/hadoop-multibranch/job/PR-523/3/artifact/out/diff-patch-jshint.txt
Test Resultshttps://builds.apache.org/job/hadoop-multibranch/job/PR-523/3/testReport/
Max. process+thread count577 (vs. ulimit of 5500)
modulesC: hadoop-hdds/server-scm U: hadoop-hdds/server-scm
Console outputhttps://builds.apache.org/job/hadoop-multibranch/job/PR-523/3/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@bharatviswa504

Copy link
Copy Markdown
Contributor

yes, we still need nodemetrics.
+1 LGTM.

@ajayydv

Copy link
Copy Markdown
Contributor

+1

@ajayydv
ajayydv merged commit 90c37ac into apache:trunkMar 4, 2019
asfgit pushed a commit that referenced this pull request Mar 5, 2019
* HDDS-623. On SCM UI, Node Manager info is empty. Contributed by Elek, Marton.
(cherry picked from commit 90c37ac)
shanthoosh pushed a commit to shanthoosh/hadoop that referenced this pull request Oct 15, 2019
Test locally and works.
Author: Yi Pan (Data Infrastructure) <yipan@yipan-mn1.linkedin.biz>
Reviewers: Jagadish <jagadish@apache.org>
Closesapache#523 from nickpan47/fix-unittest-deleted-messages
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@elek@hadoop-yetus@bharatviswa504@ajayydv