Skip to content

TEZ-4352: Add a web ui interface for TezChild - #248

Open
abstractdog wants to merge 1 commit into
apache:masterfrom
abstractdog:TEZ-4352
Open

TEZ-4352: Add a web ui interface for TezChild#248
abstractdog wants to merge 1 commit into
apache:masterfrom
abstractdog:TEZ-4352

Conversation

@abstractdog

Copy link
Copy Markdown
Contributor

No description provided.

@tez-yetus

This comment was marked as outdated.

@tez-yetus

This comment was marked as outdated.

@abstractdog

Copy link
Copy Markdown
ContributorAuthor

can I have a review on this @rbalamohan? the (optional) web ui interface of TezChild is supposed to be the starting point for further improvements like TEZ-4344, TEZ-4345

@guptashailesh92

Copy link
Copy Markdown

Hi @abstractdog ,
I just have few basic questions. I donot have full context on it so if you can point to some doc that would be great.

  1. Who will be the consumer of the API? How it'll be consumed?
  2. Since ports are dynamic, how will the consumer know service is running on which port? Do you have plan to send this info to Tez AM?

@abstractdog

Copy link
Copy Markdown
ContributorAuthor

hey, good questions @guptashailesh92 , here are my thoughts so far:

  1. Consumer can be immediately a human being troubleshooting on a cluster, and also TezAM if we implement TEZ-4344 and TEZ-4345

  2. Yes, exactly, I was about to send this to AM, but the patch suddenly became much more complicated, so I decided to use this as a minimal patch for introducing the web ui only

@guptashailesh92

Copy link
Copy Markdown

Sure, Thanks a lot.

@abstractdog

Copy link
Copy Markdown
ContributorAuthor

@rbalamohan: can you please take a look at this one?

@tez-yetus

This comment was marked as outdated.

@tez-yetus

This comment was marked as outdated.

@tez-yetus

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec12m 5sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 1sNo case conflicting files found.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ master Compile Tests _
+0 🆗mvndep2m 18sMaven dependency ordering for branch
+1 💚mvninstall10m 19smaster passed
+1 💚compile1m 2smaster passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu122.04
+1 💚compile1m 2smaster passed with JDK Private Build-1.8.0_432-8u432-gaus1-0ubuntu222.04-ga
+1 💚checkstyle1m 17smaster passed
+1 💚javadoc1m 8smaster passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu122.04
+1 💚javadoc0m 54smaster passed with JDK Private Build-1.8.0_432-8u432-gaus1-0ubuntu222.04-ga
+0 🆗spotbugs0m 29sUsed deprecated FindBugs config; considering switching to SpotBugs.
+1 💚findbugs2m 6smaster passed
_ Patch Compile Tests _
+0 🆗mvndep0m 7sMaven dependency ordering for patch
+1 💚mvninstall0m 40sthe patch passed
+1 💚compile0m 38sthe patch passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu122.04
+1 💚javac0m 38sthe patch passed
+1 💚compile0m 37sthe patch passed with JDK Private Build-1.8.0_432-8u432-gaus1-0ubuntu222.04-ga
+1 💚javac0m 37sthe patch passed
+1 💚checkstyle0m 8stez-api: The patch generated 0 new + 35 unchanged - 1 fixed = 35 total (was 36)
-0 ⚠️checkstyle0m 6stez-runtime-internals: The patch generated 1 new + 7 unchanged - 0 fixed = 8 total (was 7)
+1 💚checkstyle0m 8sThe patch passed checkstyle in tez-tests
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚javadoc0m 26sthe patch passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu122.04
+1 💚javadoc0m 29sthe patch passed with JDK Private Build-1.8.0_432-8u432-gaus1-0ubuntu222.04-ga
+1 💚findbugs1m 37sthe patch passed
_ Other Tests _
+1 💚unit1m 52stez-api in the patch passed.
+1 💚unit0m 39stez-runtime-internals in the patch passed.
+1 💚unit33m 29stez-tests in the patch passed.
+1 💚asflicense0m 24sThe patch does not generate ASF License warnings.
74m 43s
SubsystemReport/Notes
DockerClientAPI=1.47 ServerAPI=1.47 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/5/artifact/out/Dockerfile
GITHUB PR#248
JIRA IssueTEZ-4352
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs checkstyle compile
unameLinux ed896af482cd 5.15.0-124-generic #134-Ubuntu SMP Fri Sep 27 20:20:17 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/tez.sh
git revisionmaster / b95defc
Default JavaPrivate Build-1.8.0_432-8u432-gaus1-0ubuntu222.04-ga
Multi-JDK versions/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu122.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_432-8u432-gaus1-0ubuntu222.04-ga
checkstylehttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/5/artifact/out/diff-checkstyle-tez-runtime-internals.txt
Test Resultshttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/5/testReport/
Max. process+thread count1179 (vs. ulimit of 5500)
modulesC: tez-api tez-runtime-internals tez-tests U: .
Console outputhttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/5/console
versionsgit=2.34.1 maven=3.6.3 findbugs=3.0.1
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@tez-yetus

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec0m 9sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ master Compile Tests _
+0 🆗mvndep2m 24sMaven dependency ordering for branch
+1 💚mvninstall10m 16smaster passed
+1 💚compile0m 59smaster passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu122.04
+1 💚compile0m 53smaster passed with JDK Private Build-1.8.0_432-8u432-gaus1-0ubuntu222.04-ga
+1 💚checkstyle1m 15smaster passed
+1 💚javadoc1m 6smaster passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu122.04
+1 💚javadoc0m 54smaster passed with JDK Private Build-1.8.0_432-8u432-gaus1-0ubuntu222.04-ga
+0 🆗spotbugs0m 30sUsed deprecated FindBugs config; considering switching to SpotBugs.
+1 💚findbugs2m 6smaster passed
_ Patch Compile Tests _
+0 🆗mvndep0m 7sMaven dependency ordering for patch
+1 💚mvninstall0m 39sthe patch passed
+1 💚compile0m 38sthe patch passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu122.04
+1 💚javac0m 38sthe patch passed
+1 💚compile0m 35sthe patch passed with JDK Private Build-1.8.0_432-8u432-gaus1-0ubuntu222.04-ga
+1 💚javac0m 35sthe patch passed
+1 💚checkstyle0m 8stez-api: The patch generated 0 new + 35 unchanged - 1 fixed = 35 total (was 36)
-0 ⚠️checkstyle0m 6stez-runtime-internals: The patch generated 1 new + 7 unchanged - 0 fixed = 8 total (was 7)
+1 💚checkstyle0m 7sThe patch passed checkstyle in tez-tests
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚javadoc0m 27sthe patch passed with JDK Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu122.04
+1 💚javadoc0m 30sthe patch passed with JDK Private Build-1.8.0_432-8u432-gaus1-0ubuntu222.04-ga
+1 💚findbugs1m 30sthe patch passed
_ Other Tests _
+1 💚unit1m 51stez-api in the patch passed.
+1 💚unit0m 36stez-runtime-internals in the patch passed.
+1 💚unit33m 43stez-tests in the patch passed.
+1 💚asflicense0m 28sThe patch does not generate ASF License warnings.
62m 37s
SubsystemReport/Notes
DockerClientAPI=1.47 ServerAPI=1.47 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/6/artifact/out/Dockerfile
GITHUB PR#248
JIRA IssueTEZ-4352
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs checkstyle compile
unameLinux 6e9832d0f9d2 5.15.0-124-generic #134-Ubuntu SMP Fri Sep 27 20:20:17 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/tez.sh
git revisionmaster / b95defc
Default JavaPrivate Build-1.8.0_432-8u432-gaus1-0ubuntu222.04-ga
Multi-JDK versions/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.25+9-post-Ubuntu-1ubuntu122.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_432-8u432-gaus1-0ubuntu222.04-ga
checkstylehttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/6/artifact/out/diff-checkstyle-tez-runtime-internals.txt
Test Resultshttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/6/testReport/
Max. process+thread count1172 (vs. ulimit of 5500)
modulesC: tez-api tez-runtime-internals tez-tests U: .
Console outputhttps://ci-hadoop.apache.org/job/tez-multibranch/job/PR-248/6/console
versionsgit=2.34.1 maven=3.6.3 findbugs=3.0.1
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@abstractdog@tez-yetus@guptashailesh92