HIVE-24331: Add Jenkinsfile for branch-3.1

[sunchao]

What changes were proposed in this pull request?

Two changes combined in this PR:

• backport HIVE-23323 to enable better parallelism for qtests
• Add Jenkinsfile

Why are the changes needed?

Without a Jenkinsfile we won't trigger CI for new PRs against the branch-3.1. This allows ppl to test their code.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Existing tests

[sunchao]

seems the TestMiniDruidKafkaCliDriver is timing out and we need https://issues.apache.org/jira/browse/HIVE-19170

[dongjoon-hyun]

+1, LGTM. Thank you so much, @sunchao !

[dongjoon-hyun]

Interesting. It seems that we need more patches.

There are 1 new tests failing, 62 existing failing and 249 skipped.

[sunchao]

I think these failures are not related to the PR - at least the PR itself gives us a baseline for the test results.

[sunchao]

cc @kgyrtkirk could you take a look? thanks.

[kgyrtkirk]

thank you @sunchao for working on this! these failures were most likely there before as well. I haven't noticed anything problematic (with the test execution stuff)
+1

[dongjoon-hyun]

Thank you, @kgyrtkirk and @sunchao .
Then, can we merge this and proceed to fix the bug based on this CI failures?

[sunchao]

Thanks @kgyrtkirk . I'll backport HIVE-23323 and HIVE-19170 separately to the branch-3.1 to retain a clean commit history, and then create a new PR with just the jenkins file change and merge it.

[sunchao]

Merged. Thanks @kgyrtkirk for the review.

[dongjoon-hyun]

Thank you so much!