JDK11 support

[yadvr]

• Make CloudStack build against JDK11 (with -Dmaven.test.skip=true)
• Run mgmt server, deploy db, work against simulator
• Upgrade mvn dependencies
• Fix compatible dependency issue build(deps): bump netty-all from 4.0.33.Final to 4.1.42.Final in /services/secondary-storage/server #3660build(deps): bump commons-compress from 1.15 to 1.19 #3671build(deps): bump xstream from 1.4.10 to 1.4.10-java7 #3672build(deps): bump tomcat-embed-core from 8.0.30 to 8.5.40 #3673build(deps): bump amqp-client from 5.1.1 to 5.4.0 #3674build(deps): bump checkstyle from 8.7 to 8.18 #3675build(deps): bump cs.jetty.version from 9.4.8.v20171121 to 9.4.22.v20191022 #3676
• Fix/support JDK11 in systemvmtemplate (make it work)
• Fix docker container packaging images to have jdk11
• Use jdk11 compatible mysql-connector via maven, instead of distro-provided
• Fix failing tests and runtime issues against JDK11
• Ready for smoketest matrix and testing

This splits the Debian10 base/template changes to this PR #3797

Types of changes

• Breaking change (fix or feature that would cause existing functionality to change)
• New feature (non-breaking change which adds functionality)
• Bug fix (non-breaking change which fixes an issue)
• Enhancement (improves an existing feature and functionality)
• Cleanup (Code refactoring and cleanup, that may add test cases)

[wido]

This is a good start!

In #3195@GabrielBrascher and me are working on porting scripts to Python 3.

Inside the SSVM we have a lot of Python 2 code which needs to be looked at.

Debian 10 still has Python 2, but the next Debian release won't have it anymore.

[weizhouapache]

@weizhouapache this maybe related to jdk or mvn version. Can you try with latest mvn, I'm using 3.6.3 and jdk11 11.0.4 or above?

@rhtyd could be maven version related. I am using maven 3.6.0 and openjdk 11.0.6.
anyway, maven-jaxb2-plugin 0.7.1 is too old, it was released in 2010...
it should be better to use latest 0.14.0
https://mvnrepository.com/artifact/org.jvnet.jaxb2.maven2/maven-jaxb2-plugin

[yadvr]

Fixed dependency version @weizhouapache
@blueorangutan package

[blueorangutan]

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

[yadvr]

@blueorangutan package

[blueorangutan]

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

[yadvr]

Manually rekicked packaging

[blueorangutan]

Packaging result: ✖centos6 ✔centos7 ✔debian. JID-794

[weizhouapache]

@rhtyd have you build new systemvm template with jdk11 ?

[yadvr]

@weizhouapachehttp://download.cloudstack.org/systemvm/4.14/

[weizhouapache]

@weizhouapachehttp://download.cloudstack.org/systemvm/4.14/

@rhtyd thanks.
my mistake, I re-upload new systemvm template but did not clean template_spool_ref so systemvms still use old 4.11.3 template.
I will test it.

[blueorangutan]

Trillian test result (tid-940)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 31000 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3601-t940-kvm-centos7.zip
Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
Smoke tests completed. 78 look OK, 1 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_02_vpc_privategw_static_routes	Failure	223.32	test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup	Failure	222.00	test_privategw_acl.py
test_04_rvpc_privategw_static_routes	Failure	320.87	test_privategw_acl.py

[yadvr]

@blueorangutan package

[blueorangutan]

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result: ✖centos6 ✔centos7 ✔debian. JID-798

[blueorangutan]

Trillian test result (tid-941)
Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7
Total time taken: 35935 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3601-t941-vmware-65u2.zip
Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Smoke tests completed. 73 look OK, 1 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_02_vpc_privategw_static_routes	Failure	333.01	test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup	Failure	338.23	test_privategw_acl.py
test_04_rvpc_privategw_static_routes	Failure	520.67	test_privategw_acl.py

[yadvr]

VP failures are consistently failing on few others PRs.

The following tests on Travis are consistently failing:

| test_03_delete_detached_volume | Failure | 90.193 | test_volumes |
| test_11_destroy_vm_and_volumes | Failure | 46.104 | test_vm_life_cycle |
| test_09_delete_detached_volume | Failure | 5.401 | test_volumes 

@weizhouapache can you check ^^ and advise? This is also seen on master. cc @DaanHoogland@andrijapanicsb

[weizhouapache]

@rhtyd @DaanHoogland I will check
Do we have same issue on other PRs ?

[yadvr]

Possibly @weizhouapache, the test failures hint at the recently merged feature perhaps. Can you check?

[blueorangutan]

Trillian test result (tid-944)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 31118 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3601-t944-kvm-centos7.zip
Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
Smoke tests completed. 78 look OK, 1 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_02_vpc_privategw_static_routes	Failure	215.17	test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup	Failure	211.53	test_privategw_acl.py
test_04_rvpc_privategw_static_routes	Failure	315.04	test_privategw_acl.py

[blueorangutan]

Trillian test result (tid-945)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 45861 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3601-t945-xenserver-71.zip
Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
Smoke tests completed. 77 look OK, 2 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_02_vpc_privategw_static_routes	Failure	355.77	test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup	Failure	348.59	test_privategw_acl.py
test_04_rvpc_privategw_static_routes	Failure	555.38	test_privategw_acl.py
test_01_scale_vm	Failure	19.60	test_scale_vm.py

[yadvr]

Smoketests LGTM, except for test_privategw_acl.py failures which are known. Travis LGTM except for the failures shared, I'll collaborate with @weizhouapache to get it addressed via #3880

[yadvr]

Considering no objections and lgtm from Andrija and Daan will merge this.