Uh oh!
There was an error while loading. Please reload this page.
HBASE-27938 - PE load any custom implementation of tests at runtime - #5307
Conversation
virajjasani
left a comment
There was a problem hiding this comment.
Thanks @gvprathyusha6, could you please also update printUsage with this new option?
protected static void printUsage(final String shortName, final String message) {
Apache-HBase
commented
Jun 22, 2023
💔 -1 overall
This message was automatically generated. |
Apache-HBase
commented
Jun 22, 2023
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Jun 22, 2023
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Jun 26, 2023
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Jun 26, 2023
💔 -1 overall
This message was automatically generated. |
Apache-HBase
commented
Jun 26, 2023
🎊 +1 overall
This message was automatically generated. |
wchevreuil
left a comment
There was a problem hiding this comment.
Please explain how this should be used;
Add command/option explanation in the printUsage method;
We should encourage custom tests to be contributed back as part of the PerformanceEvaluation tool.
Apache-HBase
commented
Jun 27, 2023
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Jun 27, 2023
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Jun 27, 2023
🎊 +1 overall
This message was automatically generated. |
Instead of Command name we need to give the classname of Test impl and it should work as is.
That is true, but if the custom test impl is very much usecase specific and isnt generic enough to be contributed back we wont be able to utilise the framework code completely, because as of now it mandates to have a compile time dependency of the implemented test class. |
wchevreuil
commented
Jul 10, 2023
So we need to explicitly say that in the printUsage. I couldn't get that by the
What I meant was to put some notes on the description for this generic command option. Something like "Please consider contribute back this custom command into a builtin PE command for the benefit of the community". |
gvprathyusha6
commented
Jul 17, 2023
Got it, how about we update
And add a section for Class just below Commad: Seems inline with current documentation standard also to me |
wchevreuil
commented
Jul 26, 2023
Yeah, that would be good. Thanks! |
Apache-HBase
commented
Aug 6, 2023
💔 -1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 6, 2023
💔 -1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 6, 2023
🎊 +1 overall
This message was automatically generated. |
wchevreuil
left a comment
There was a problem hiding this comment.
LGTM, but need to fix the spotless reported issue before I can merge this, @gvprathyusha6 .
| private static boolean isCommandClass(String cmd) { | ||
| return COMMANDS.containsKey(cmd); | ||
| return !COMMANDS.containsKey(cmd) ? isCustomTestClass(cmd) : true; |
There was a problem hiding this comment.
return COMMANDS.containsKey(cmd) || isCustomTestClass(cmd);
Apache9
commented
Aug 13, 2023
Could you please provide a UT or add an example in hbase-examples to show how to make use of this feature? Thanks. |
fc77191 to
986f71bCompareApache-HBase
commented
Aug 17, 2023
🎊 +1 overall
This message was automatically generated. |
gvprathyusha6
commented
Apr 16, 2024
| @Override | ||
| boolean testRow(final int i, final long startTime) throws IOException { | ||
| protected boolean testRow(final int i, final long startTime) throws IOException { |
There was a problem hiding this comment.
to override this in impl class, so that we can customise row format. If the custom test knows the dataset, it would be beneficial to repro any specific scenario, like if I have the rowkey similar to what tsdb puts, I can create scan load on particular dataset and write load on another and try to get closer to prod scenarios
There was a problem hiding this comment.
But the methods in TestBase class are all package private? Even if you change this to protected, you can not inherit this class in other package because you can not call the constructor?
There was a problem hiding this comment.
I was managing them by using the same package name, removing it
Apache-HBase
commented
May 10, 2024
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
May 10, 2024
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
May 10, 2024
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
May 10, 2024
🎊 +1 overall
This message was automatically generated. |
Apache9
left a comment
There was a problem hiding this comment.
Please try fixing the checkstyle issue, just line length.
I have no other concerns.
Apache-HBase
commented
May 14, 2024
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
May 14, 2024
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
May 14, 2024
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
May 14, 2024
💔 -1 overall
This message was automatically generated. |
…test class and properties
Apache-HBase
commented
May 14, 2024
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
May 14, 2024
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
May 14, 2024
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
May 14, 2024
🎊 +1 overall
This message was automatically generated. |
virajjasani
commented
May 14, 2024
@gvprathyusha6 could you also create branch-2 PR? we can merge both of them together and backport as required. |
) (#5899) Signed-off-by: Duo Zhang <zhangduo@apache.org> Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org> Signed-off-by: Viraj Jasani <vjasani@apache.org>
) (#5899) Signed-off-by: Duo Zhang <zhangduo@apache.org> Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org> Signed-off-by: Viraj Jasani <vjasani@apache.org>
) (#5899) Signed-off-by: Duo Zhang <zhangduo@apache.org> Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org> Signed-off-by: Viraj Jasani <vjasani@apache.org>
…ache#5307) Signed-off-by: Duo Zhang <zhangduo@apache.org> Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org> Signed-off-by: Viraj Jasani <vjasani@apache.org>
Enable PE to load any custom implementation of tests at runtime