Skip to content

CLOUDSTACK-9503: Increased the VR script timeout. Most of the changes… - #1745

Merged
asfgit merged 1 commit into
apache:4.8from
shapeblue:CLOUDSTACK-9503
Nov 23, 2016
Merged

CLOUDSTACK-9503: Increased the VR script timeout. Most of the changes…#1745
asfgit merged 1 commit into
apache:4.8from
shapeblue:CLOUDSTACK-9503

Conversation

@abhinandanprateek

Copy link
Copy Markdown
Contributor

… are about converting int/long time values to joda Duration.

@abhinandanprateek

Copy link
Copy Markdown
ContributorAuthor

Moved PR from 4.9 (#1678) to 4.8 here.

@abhinandanprateek

Copy link
Copy Markdown
ContributorAuthor

@karuturi I guess jenkins' failure is due to env ?
"ERROR: Step ‘Archive the artifacts’ failed: no workspace for cloudstack-pr-analysis #2184"

@yadvr

yadvr commented Nov 1, 2016

Copy link
Copy Markdown
Member

@blueorangutan package

@blueorangutan

Copy link
Copy Markdown

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan

Copy link
Copy Markdown

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-118

@yadvr

yadvr commented Nov 1, 2016

Copy link
Copy Markdown
Member

@blueorangutan test

@blueorangutan

Copy link
Copy Markdown

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@jburwell

Copy link
Copy Markdown
Contributor

@abhinandanprateek the Jenkins build failed. Could you please investigate?

@abhinandanprateek

Copy link
Copy Markdown
ContributorAuthor

@jburwell The reason is ""ERROR: Step ‘Archive the artifacts’ failed: no workspace for cloudstack-pr-analysis #2184""
I will force push again.

… are about converting int/long time values to joda Duration.
@blueorangutan

Copy link
Copy Markdown

Trillian test result (tid-237)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 24826 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1745-t237-kvm-centos7.zip
Test completed. 42 look ok, 1 have error(s)

TestResultTime (s)Test File
test_02_redundant_VPC_default_routesFailure876.11test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACLFailure366.45test_vpc_redundant.py
test_01_vpc_site2site_vpnSuccess166.15test_vpc_vpn.py
test_01_vpc_remote_access_vpnSuccess61.76test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpnSuccess276.72test_vpc_vpn.py
test_02_VPC_default_routesSuccess315.94test_vpc_router_nics.py
test_01_VPC_nics_after_destroySuccess527.78test_vpc_router_nics.py
test_05_rvpc_multi_tiersSuccess517.54test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nicsSuccess1367.12test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routersSuccess629.06test_vpc_redundant.py
test_09_delete_detached_volumeSuccess11.25test_volumes.py
test_08_resize_volumeSuccess15.54test_volumes.py
test_07_resize_failSuccess20.58test_volumes.py
test_06_download_detached_volumeSuccess15.31test_volumes.py
test_05_detach_volumeSuccess100.28test_volumes.py
test_04_delete_attached_volumeSuccess10.23test_volumes.py
test_03_download_attached_volumeSuccess15.38test_volumes.py
test_02_attach_volumeSuccess43.97test_volumes.py
test_01_create_volumeSuccess622.90test_volumes.py
test_deploy_vm_multipleSuccess239.86test_vm_life_cycle.py
test_deploy_vmSuccess0.03test_vm_life_cycle.py
test_advZoneVirtualRouterSuccess0.02test_vm_life_cycle.py
test_10_attachAndDetach_isoSuccess26.54test_vm_life_cycle.py
test_09_expunge_vmSuccess125.25test_vm_life_cycle.py
test_08_migrate_vmSuccess41.44test_vm_life_cycle.py
test_07_restore_vmSuccess0.21test_vm_life_cycle.py
test_06_destroy_vmSuccess126.01test_vm_life_cycle.py
test_03_reboot_vmSuccess125.97test_vm_life_cycle.py
test_02_start_vmSuccess10.17test_vm_life_cycle.py
test_01_stop_vmSuccess40.35test_vm_life_cycle.py
test_CreateTemplateWithDuplicateNameSuccess126.06test_templates.py
test_08_list_system_templatesSuccess0.03test_templates.py
test_07_list_public_templatesSuccess0.03test_templates.py
test_05_template_permissionsSuccess0.05test_templates.py
test_04_extract_templateSuccess5.32test_templates.py
test_03_delete_templateSuccess5.13test_templates.py
test_02_edit_templateSuccess90.12test_templates.py
test_01_create_templateSuccess60.85test_templates.py
test_10_destroy_cpvmSuccess196.67test_ssvm.py
test_09_destroy_ssvmSuccess225.04test_ssvm.py
test_08_reboot_cpvmSuccess101.71test_ssvm.py
test_07_reboot_ssvmSuccess133.13test_ssvm.py
test_06_stop_cpvmSuccess131.72test_ssvm.py
test_05_stop_ssvmSuccess134.76test_ssvm.py
test_04_cpvm_internalsSuccess1.20test_ssvm.py
test_03_ssvm_internalsSuccess2.89test_ssvm.py
test_02_list_cpvm_vmSuccess0.10test_ssvm.py
test_01_list_sec_storage_vmSuccess0.11test_ssvm.py
test_01_snapshot_root_diskSuccess11.27test_snapshots.py
test_04_change_offering_smallSuccess204.65test_service_offerings.py
test_03_delete_service_offeringSuccess0.05test_service_offerings.py
test_02_edit_service_offeringSuccess0.05test_service_offerings.py
test_01_create_service_offeringSuccess0.10test_service_offerings.py
test_02_sys_template_readySuccess0.10test_secondary_storage.py
test_01_sys_vm_startSuccess0.15test_secondary_storage.py
test_09_reboot_routerSuccess45.40test_routers.py
test_08_start_routerSuccess35.29test_routers.py
test_07_stop_routerSuccess10.24test_routers.py
test_06_router_advancedSuccess0.15test_routers.py
test_05_router_basicSuccess0.03test_routers.py
test_04_restart_network_wo_cleanupSuccess5.77test_routers.py
test_03_restart_network_cleanupSuccess55.70test_routers.py
test_02_router_internal_advSuccess1.15test_routers.py
test_01_router_internal_basicSuccess0.60test_routers.py
test_router_dhcphostsSuccess241.55test_router_dhcphosts.py
test_01_updatevolumedetailSuccess0.07test_resource_detail.py
test_01_reset_vm_on_rebootSuccess161.38test_reset_vm_on_reboot.py
test_createRegionSuccess0.07test_regions.py
test_create_pvlan_networkSuccess5.23test_pvlan.py
test_dedicatePublicIpRangeSuccess0.39test_public_ip_range.py
test_04_rvpc_privategw_static_routesSuccess499.98test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanupSuccess473.03test_privategw_acl.py
test_02_vpc_privategw_static_routesSuccess397.05test_privategw_acl.py
test_01_vpc_privategw_aclSuccess113.90test_privategw_acl.py
test_01_primary_storage_nfsSuccess36.03test_primary_storage.py
test_createPortablePublicIPRangeSuccess15.19test_portable_publicip.py
test_createPortablePublicIPAcquireSuccess15.55test_portable_publicip.py
test_isolate_network_password_serverSuccess89.44test_password_server.py
test_UpdateStorageOverProvisioningFactorSuccess0.28test_over_provisioning.py
test_extendPhysicalNetworkVlanSuccess15.32test_non_contigiousvlan.py
test_01_nicSuccess773.11test_nic.py
test_releaseIPSuccess194.53test_network.py
test_reboot_routerSuccess435.69test_network.py
test_public_ip_user_accountSuccess10.46test_network.py
test_public_ip_admin_accountSuccess40.43test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_RuleSuccess67.15test_network.py
test_network_rules_acquired_public_ip_2_nat_ruleSuccess61.80test_network.py
test_network_rules_acquired_public_ip_1_static_nat_ruleSuccess124.98test_network.py
test_delete_accountSuccess269.59test_network.py
test_02_port_fwd_on_non_src_natSuccess55.85test_network.py
test_01_port_fwd_on_src_natSuccess108.75test_network.py
test_nic_secondaryip_add_removeSuccess220.17test_multipleips_per_nic.py
login_test_saml_userSuccess26.82test_login.py
test_assign_and_removal_lbSuccess134.67test_loadbalance.py
test_02_create_lb_rule_non_natSuccess187.46test_loadbalance.py
test_01_create_lb_rule_src_natSuccess188.86test_loadbalance.py
test_07_list_default_isoSuccess0.06test_iso.py
test_05_iso_permissionsSuccess0.06test_iso.py
test_04_extract_IsoSuccess5.49test_iso.py
test_03_delete_isoSuccess95.24test_iso.py
test_02_edit_isoSuccess0.05test_iso.py
test_01_create_isoSuccess21.89test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfacesSuccess360.46test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfacesSuccess239.19test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80Success552.41test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80Success486.28test_internal_lb.py
test_dedicateGuestVlanRangeSuccess10.26test_guest_vlan_range.py
test_UpdateConfigParamWithScopeSuccess0.57test_global_settings.py
test_04_create_fat_type_disk_offeringSuccess0.06test_disk_offerings.py
test_03_delete_disk_offeringSuccess0.03test_disk_offerings.py
test_02_edit_disk_offeringSuccess0.04test_disk_offerings.py
test_02_create_sparse_type_disk_offeringSuccess0.06test_disk_offerings.py
test_01_create_disk_offeringSuccess0.09test_disk_offerings.py
test_deployvm_userdispersingSuccess20.79test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentratedSuccess56.39test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfitSuccess45.90test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_postSuccess10.41test_deploy_vm_with_userdata.py
test_deployvm_userdataSuccess66.17test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resizeSuccess7.82test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resizeSuccess6.96test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resizeSuccess239.16test_deploy_vm_root_resize.py
test_deploy_vm_from_isoSuccess203.44test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroupSuccess111.63test_affinity_groups.py
test_03_delete_vm_snapshotsSkipped0.00test_vm_snapshots.py
test_02_revert_vm_snapshotsSkipped0.00test_vm_snapshots.py
test_01_test_vm_volume_snapshotSkipped0.00test_vm_snapshots.py
test_01_create_vm_snapshotsSkipped0.00test_vm_snapshots.py
test_06_copy_templateSkipped0.00test_templates.py
test_01_scale_vmSkipped0.00test_scale_vm.py
test_01_primary_storage_iscsiSkipped0.09test_primary_storage.py
test_06_copy_isoSkipped0.00test_iso.py
test_deploy_vgpu_enabled_vmSkipped0.00test_deploy_vgpu_enabled_vm.py

@yadvr

yadvr commented Nov 2, 2016

Copy link
Copy Markdown
Member

The following will run an additional component tests:
@blueorangutan test centos7 kvm-centos7 component/test_routers.py component/test_acl_isolatednetwork.py component/test_add_remove_network.py component/test_network_offering.py component/test_persistent_networks.py

@blueorangutan

Copy link
Copy Markdown

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan

Copy link
Copy Markdown

Trillian test result (tid-263)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 30880 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1745-t263-kvm-centos7.zip

Additional tests completed. 1 look ok, 0 have error(s)

TestResultTime (s)Test File

@yadvr

yadvr commented Nov 3, 2016

Copy link
Copy Markdown
Member

There was an issue with the additionaltests script that caused no outputs in the last comment. I've re-kicked the tests now.

@blueorangutan

Copy link
Copy Markdown

Trillian test result (tid-275)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 28972 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1745-t275-kvm-centos7.zip
Test completed. 42 look ok, 1 have error(s)

TestResultTime (s)Test File
test_02_redundant_VPC_default_routesFailure870.32test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACLFailure376.01test_vpc_redundant.py
test_01_vpc_site2site_vpnSuccess171.12test_vpc_vpn.py
test_01_vpc_remote_access_vpnSuccess87.25test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpnSuccess277.82test_vpc_vpn.py
test_02_VPC_default_routesSuccess296.83test_vpc_router_nics.py
test_01_VPC_nics_after_destroySuccess551.72test_vpc_router_nics.py
test_05_rvpc_multi_tiersSuccess525.09test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nicsSuccess1463.08test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routersSuccess554.08test_vpc_redundant.py
test_09_delete_detached_volumeSuccess15.77test_volumes.py
test_08_resize_volumeSuccess15.55test_volumes.py
test_07_resize_failSuccess20.56test_volumes.py
test_06_download_detached_volumeSuccess15.37test_volumes.py
test_05_detach_volumeSuccess100.28test_volumes.py
test_04_delete_attached_volumeSuccess10.24test_volumes.py
test_03_download_attached_volumeSuccess15.38test_volumes.py
test_02_attach_volumeSuccess45.92test_volumes.py
test_01_create_volumeSuccess711.89test_volumes.py
test_deploy_vm_multipleSuccess330.35test_vm_life_cycle.py
test_deploy_vmSuccess0.03test_vm_life_cycle.py
test_advZoneVirtualRouterSuccess0.02test_vm_life_cycle.py
test_10_attachAndDetach_isoSuccess26.99test_vm_life_cycle.py
test_09_expunge_vmSuccess125.28test_vm_life_cycle.py
test_08_migrate_vmSuccess36.01test_vm_life_cycle.py
test_07_restore_vmSuccess0.14test_vm_life_cycle.py
test_06_destroy_vmSuccess131.06test_vm_life_cycle.py
test_03_reboot_vmSuccess125.94test_vm_life_cycle.py
test_02_start_vmSuccess10.27test_vm_life_cycle.py
test_01_stop_vmSuccess40.40test_vm_life_cycle.py
test_CreateTemplateWithDuplicateNameSuccess91.05test_templates.py
test_08_list_system_templatesSuccess0.04test_templates.py
test_07_list_public_templatesSuccess0.04test_templates.py
test_05_template_permissionsSuccess0.07test_templates.py
test_04_extract_templateSuccess5.22test_templates.py
test_03_delete_templateSuccess5.21test_templates.py
test_02_edit_templateSuccess90.30test_templates.py
test_01_create_templateSuccess56.55test_templates.py
test_10_destroy_cpvmSuccess161.80test_ssvm.py
test_09_destroy_ssvmSuccess225.07test_ssvm.py
test_08_reboot_cpvmSuccess161.72test_ssvm.py
test_07_reboot_ssvmSuccess134.01test_ssvm.py
test_06_stop_cpvmSuccess131.63test_ssvm.py
test_05_stop_ssvmSuccess133.90test_ssvm.py
test_04_cpvm_internalsSuccess1.20test_ssvm.py
test_03_ssvm_internalsSuccess3.34test_ssvm.py
test_02_list_cpvm_vmSuccess0.13test_ssvm.py
test_01_list_sec_storage_vmSuccess0.16test_ssvm.py
test_01_snapshot_root_diskSuccess11.55test_snapshots.py
test_04_change_offering_smallSuccess210.64test_service_offerings.py
test_03_delete_service_offeringSuccess0.04test_service_offerings.py
test_02_edit_service_offeringSuccess0.10test_service_offerings.py
test_01_create_service_offeringSuccess0.23test_service_offerings.py
test_02_sys_template_readySuccess0.10test_secondary_storage.py
test_01_sys_vm_startSuccess0.15test_secondary_storage.py
test_09_reboot_routerSuccess35.58test_routers.py
test_08_start_routerSuccess30.29test_routers.py
test_07_stop_routerSuccess10.26test_routers.py
test_06_router_advancedSuccess0.11test_routers.py
test_05_router_basicSuccess0.04test_routers.py
test_04_restart_network_wo_cleanupSuccess5.76test_routers.py
test_03_restart_network_cleanupSuccess60.63test_routers.py
test_02_router_internal_advSuccess0.99test_routers.py
test_01_router_internal_basicSuccess0.54test_routers.py
test_router_dhcphostsSuccess277.96test_router_dhcphosts.py
test_01_updatevolumedetailSuccess0.28test_resource_detail.py
test_01_reset_vm_on_rebootSuccess156.22test_reset_vm_on_reboot.py
test_createRegionSuccess0.04test_regions.py
test_create_pvlan_networkSuccess5.20test_pvlan.py
test_dedicatePublicIpRangeSuccess0.37test_public_ip_range.py
test_04_rvpc_privategw_static_routesSuccess538.23test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanupSuccess489.68test_privategw_acl.py
test_02_vpc_privategw_static_routesSuccess383.19test_privategw_acl.py
test_01_vpc_privategw_aclSuccess94.30test_privategw_acl.py
test_01_primary_storage_nfsSuccess35.70test_primary_storage.py
test_createPortablePublicIPRangeSuccess20.31test_portable_publicip.py
test_createPortablePublicIPAcquireSuccess15.62test_portable_publicip.py
test_isolate_network_password_serverSuccess90.28test_password_server.py
test_UpdateStorageOverProvisioningFactorSuccess0.14test_over_provisioning.py
test_extendPhysicalNetworkVlanSuccess15.55test_non_contigiousvlan.py
test_01_nicSuccess834.23test_nic.py
test_releaseIPSuccess271.25test_network.py
test_reboot_routerSuccess409.80test_network.py
test_public_ip_user_accountSuccess10.23test_network.py
test_public_ip_admin_accountSuccess40.32test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_RuleSuccess67.88test_network.py
test_network_rules_acquired_public_ip_2_nat_ruleSuccess61.84test_network.py
test_network_rules_acquired_public_ip_1_static_nat_ruleSuccess124.15test_network.py
test_delete_accountSuccess304.48test_network.py
test_02_port_fwd_on_non_src_natSuccess55.72test_network.py
test_01_port_fwd_on_src_natSuccess112.09test_network.py
test_nic_secondaryip_add_removeSuccess208.52test_multipleips_per_nic.py
login_test_saml_userSuccess27.00test_login.py
test_assign_and_removal_lbSuccess133.36test_loadbalance.py
test_02_create_lb_rule_non_natSuccess187.09test_loadbalance.py
test_01_create_lb_rule_src_natSuccess198.04test_loadbalance.py
test_07_list_default_isoSuccess0.06test_iso.py
test_05_iso_permissionsSuccess0.06test_iso.py
test_04_extract_IsoSuccess5.17test_iso.py
test_03_delete_isoSuccess95.16test_iso.py
test_02_edit_isoSuccess0.09test_iso.py
test_01_create_isoSuccess22.27test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfacesSuccess243.53test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfacesSuccess188.51test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80Success557.05test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80Success482.20test_internal_lb.py
test_dedicateGuestVlanRangeSuccess10.37test_guest_vlan_range.py
test_UpdateConfigParamWithScopeSuccess0.13test_global_settings.py
test_04_create_fat_type_disk_offeringSuccess0.22test_disk_offerings.py
test_03_delete_disk_offeringSuccess0.09test_disk_offerings.py
test_02_edit_disk_offeringSuccess0.06test_disk_offerings.py
test_02_create_sparse_type_disk_offeringSuccess0.22test_disk_offerings.py
test_01_create_disk_offeringSuccess0.28test_disk_offerings.py
test_deployvm_userdispersingSuccess25.76test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentratedSuccess20.87test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfitSuccess96.43test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_postSuccess10.63test_deploy_vm_with_userdata.py
test_deployvm_userdataSuccess50.71test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resizeSuccess7.63test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resizeSuccess6.86test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resizeSuccess294.86test_deploy_vm_root_resize.py
test_deploy_vm_from_isoSuccess228.85test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroupSuccess71.05test_affinity_groups.py
test_03_delete_vm_snapshotsSkipped0.00test_vm_snapshots.py
test_02_revert_vm_snapshotsSkipped0.00test_vm_snapshots.py
test_01_test_vm_volume_snapshotSkipped0.00test_vm_snapshots.py
test_01_create_vm_snapshotsSkipped0.00test_vm_snapshots.py
test_06_copy_templateSkipped0.00test_templates.py
test_01_scale_vmSkipped0.00test_scale_vm.py
test_01_primary_storage_iscsiSkipped0.03test_primary_storage.py
test_06_copy_isoSkipped0.00test_iso.py
test_deploy_vgpu_enabled_vmSkipped0.00test_deploy_vgpu_enabled_vm.py

Additional tests completed. 1 look ok, 0 have error(s)

TestResultTime (s)Test File
test_01_RouterStopCreateFWFailure45.96test_routers.py
ContextSuite context=TestVPCNetworkOperations>:setupError0.00test_persistent_networks.py
ContextSuite context=TestRestartPersistentNetwork>:setupError0.00test_persistent_networks.py
ContextSuite context=TestProjectAccountOperations>:setupError0.00test_persistent_networks.py
ContextSuite context=TestPersistentNetworks>:setupError0.00test_persistent_networks.py
ContextSuite context=TestAssignVirtualMachine>:setupError0.00test_persistent_networks.py
ContextSuite context=TestNOWithOnlySourceNAT>:setupError0.00test_network_offering.py
ContextSuite context=TestNOVirtualRouter>:setupError0.00test_network_offering.py
ContextSuite context=TestUpdateVirtualMachineNIC>:setupError0.00test_add_remove_network.py
ContextSuite context=TestRemoveNetworkFromVirtualMachine>:setupError0.00test_add_remove_network.py
ContextSuite context=TestFailureScenariosUpdateVirtualMachineNIC>:setupError0.00test_add_remove_network.py
ContextSuite context=TestFailureScenariosRemoveNicFromVM>:setupError0.00test_add_remove_network.py
ContextSuite context=TestFailureScenariosAddNetworkToVM>:setupError0.00test_add_remove_network.py
ContextSuite context=TestAddNetworkToVirtualMachine>:setupError0.00test_add_remove_network.py
ContextSuite context=TestIsolatedNetwork>:teardownError534.18test_acl_isolatednetwork.py
test_03_RouterStartOnVmDeploySuccess35.66test_routers.py
test_02_NetworkGarbageCollectionSuccess861.15test_routers.py
test_01_RouterStopCreatePFSuccess82.15test_routers.py
test_01_RouterStopCreateLBSuccess86.37test_routers.py
test_01_AdvancedZoneRouterServicesSuccess0.12test_routers.py
test_30_restartNetwork_user_foruserinotherdomainSuccess0.01test_acl_isolatednetwork.py
test_29_restartNetwork_user_foruserinsamedomainSuccess0.01test_acl_isolatednetwork.py
test_28_restartNetwork_userSuccess75.57test_acl_isolatednetwork.py
test_27_restartNetwork_domaindmin_forcrossdomainuserSuccess0.01test_acl_isolatednetwork.py
test_26_restartNetwork_domaindmin_foruserinsubdomainSuccess70.61test_acl_isolatednetwork.py
test_25_restartNetwork_domaindmin_foruserinsamedomainSuccess70.67test_acl_isolatednetwork.py
test_24_restartNetwork_domaindminSuccess70.59test_acl_isolatednetwork.py
test_23_restartNetwork_admin_foruserinotherdomainSuccess80.55test_acl_isolatednetwork.py
test_22_restartNetwork_admin_foruserinsamedomainSuccess85.73test_acl_isolatednetwork.py
test_21_restartNetwork_adminSuccess85.78test_acl_isolatednetwork.py
test_20_deployvm_user_foruserincrossdomainSuccess0.05test_acl_isolatednetwork.py
test_20_1_deployvm_user_incrossnetworkSuccess0.09test_acl_isolatednetwork.py
test_19_deployvm_user_foruserinsamedomainSuccess0.03test_acl_isolatednetwork.py
test_18_deployvm_userSuccess10.26test_acl_isolatednetwork.py
test_17_deployvm_domaindmin_forcrossdomainuserSuccess0.02test_acl_isolatednetwork.py
test_17_1_deployvm_domainadmin_foruserinotherdomain_crossnetworkSuccess0.05test_acl_isolatednetwork.py
test_16_deployvm_domaindmin_foruserinsubdomainSuccess10.30test_acl_isolatednetwork.py
test_15_deployvm_domaindmin_foruserinsamedomainSuccess10.45test_acl_isolatednetwork.py
test_14_deployvm_domaindminSuccess10.28test_acl_isolatednetwork.py
test_13_deployvm_admin_foruserinotherdomainSuccess10.27test_acl_isolatednetwork.py
test_13_1_deployvm_admin_foruserinotherdomain_crossnetworkSuccess0.03test_acl_isolatednetwork.py
test_12_deployvm_admin_foruserinsamedomainSuccess10.43test_acl_isolatednetwork.py
test_11_deployvm_adminSuccess10.23test_acl_isolatednetwork.py
test_10_createNetwork_user_foruserinotherdomainSuccess0.03test_acl_isolatednetwork.py
test_09_createNetwork_user_foruserinsamedomainSuccess0.03test_acl_isolatednetwork.py
test_08_createNetwork_userSuccess0.09test_acl_isolatednetwork.py
test_07_createNetwork_domaindmin_forcrossdomainuserSuccess0.03test_acl_isolatednetwork.py
test_06_createNetwork_domaindmin_foruserinsubdomainSuccess0.10test_acl_isolatednetwork.py
test_05_createNetwork_domaindmin_foruserinsamedomainSuccess0.10test_acl_isolatednetwork.py
test_04_createNetwork_domaindminSuccess0.10test_acl_isolatednetwork.py
test_03_createNetwork_admin_foruserinotherdomainSuccess0.11test_acl_isolatednetwork.py
test_02_createNetwork_admin_foruserinsamedomainSuccess0.10test_acl_isolatednetwork.py
test_01_createNetwork_adminSuccess0.10test_acl_isolatednetwork.py

@karuturi

Copy link
Copy Markdown
Member

@blueorangutan test matrix component/test_routers.py component/test_acl_isolatednetwork.py component/test_add_remove_network.py component/test_network_offering.py component/test_persistent_networks.py

@karuturi

Copy link
Copy Markdown
Member

@blueorangutan help

@blueorangutan

Copy link
Copy Markdown

@karuturi I understand these words: "help", "hello", "thanks", "package", "test"
Test command usage: test [mgmt os] [hypervisor] [additional tests]
Mgmt OS options: ['centos6', 'centos7', 'ubuntu']
Hypervisor options: ['kvm-centos6', 'kvm-centos7', 'kvm-ubuntu', 'xenserver-65sp1', 'xenserver-62sp1', 'vmware-60u2', 'vmware-55u3', 'vmware-51u1', 'vmware-50u1']
Additional tests: list of comma separated tests with paths relative to the test/integration directory, for example: component/test_acl_listvm.py, component/test_volumes.py
Note: when additional tests are passed, you need to specify mgmt server os and hypervisor or use the matrix command.

Blessed contributors for kicking Trillian test jobs: ['rhtyd', 'jburwell', 'murali-reddy', 'abhinandanprateek', 'PaulAngus', 'borisstoyanov', 'karuturi']

@karuturi

Copy link
Copy Markdown
Member

@blueorangutan test matrix

@blueorangutan

Copy link
Copy Markdown

@karuturi a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan

Copy link
Copy Markdown

Trillian test result (tid-297)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 24264 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1745-t297-kvm-centos7.zip
Test completed. 43 look ok, 0 have error(s)

TestResultTime (s)Test File
test_01_vpc_site2site_vpnSuccess161.36test_vpc_vpn.py
test_01_vpc_remote_access_vpnSuccess61.22test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpnSuccess221.10test_vpc_vpn.py
test_02_VPC_default_routesSuccess264.34test_vpc_router_nics.py
test_01_VPC_nics_after_destroySuccess550.99test_vpc_router_nics.py
test_05_rvpc_multi_tiersSuccess507.26test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nicsSuccess1440.30test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routersSuccess555.47test_vpc_redundant.py
test_02_redundant_VPC_default_routesSuccess750.05test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACLSuccess1287.92test_vpc_redundant.py
test_09_delete_detached_volumeSuccess15.56test_volumes.py
test_08_resize_volumeSuccess15.56test_volumes.py
test_07_resize_failSuccess20.52test_volumes.py
test_06_download_detached_volumeSuccess15.34test_volumes.py
test_05_detach_volumeSuccess100.36test_volumes.py
test_04_delete_attached_volumeSuccess10.20test_volumes.py
test_03_download_attached_volumeSuccess15.34test_volumes.py
test_02_attach_volumeSuccess43.69test_volumes.py
test_01_create_volumeSuccess754.30test_volumes.py
test_deploy_vm_multipleSuccess238.93test_vm_life_cycle.py
test_deploy_vmSuccess0.03test_vm_life_cycle.py
test_advZoneVirtualRouterSuccess0.02test_vm_life_cycle.py
test_10_attachAndDetach_isoSuccess26.91test_vm_life_cycle.py
test_09_expunge_vmSuccess125.26test_vm_life_cycle.py
test_08_migrate_vmSuccess35.98test_vm_life_cycle.py
test_07_restore_vmSuccess0.25test_vm_life_cycle.py
test_06_destroy_vmSuccess125.98test_vm_life_cycle.py
test_03_reboot_vmSuccess126.04test_vm_life_cycle.py
test_02_start_vmSuccess10.16test_vm_life_cycle.py
test_01_stop_vmSuccess40.41test_vm_life_cycle.py
test_CreateTemplateWithDuplicateNameSuccess75.67test_templates.py
test_08_list_system_templatesSuccess0.02test_templates.py
test_07_list_public_templatesSuccess0.03test_templates.py
test_05_template_permissionsSuccess0.05test_templates.py
test_04_extract_templateSuccess5.12test_templates.py
test_03_delete_templateSuccess5.21test_templates.py
test_02_edit_templateSuccess90.15test_templates.py
test_01_create_templateSuccess71.14test_templates.py
test_10_destroy_cpvmSuccess131.36test_ssvm.py
test_09_destroy_ssvmSuccess169.15test_ssvm.py
test_08_reboot_cpvmSuccess131.33test_ssvm.py
test_07_reboot_ssvmSuccess133.65test_ssvm.py
test_06_stop_cpvmSuccess101.43test_ssvm.py
test_05_stop_ssvmSuccess133.91test_ssvm.py
test_04_cpvm_internalsSuccess0.97test_ssvm.py
test_03_ssvm_internalsSuccess3.20test_ssvm.py
test_02_list_cpvm_vmSuccess0.12test_ssvm.py
test_01_list_sec_storage_vmSuccess0.11test_ssvm.py
test_01_snapshot_root_diskSuccess11.36test_snapshots.py
test_04_change_offering_smallSuccess210.00test_service_offerings.py
test_03_delete_service_offeringSuccess0.03test_service_offerings.py
test_02_edit_service_offeringSuccess0.07test_service_offerings.py
test_01_create_service_offeringSuccess0.09test_service_offerings.py
test_02_sys_template_readySuccess0.10test_secondary_storage.py
test_01_sys_vm_startSuccess0.15test_secondary_storage.py
test_09_reboot_routerSuccess35.33test_routers.py
test_08_start_routerSuccess35.29test_routers.py
test_07_stop_routerSuccess10.15test_routers.py
test_06_router_advancedSuccess0.04test_routers.py
test_05_router_basicSuccess0.03test_routers.py
test_04_restart_network_wo_cleanupSuccess5.55test_routers.py
test_03_restart_network_cleanupSuccess65.59test_routers.py
test_02_router_internal_advSuccess1.05test_routers.py
test_01_router_internal_basicSuccess0.61test_routers.py
test_router_dhcphostsSuccess242.28test_router_dhcphosts.py
test_01_updatevolumedetailSuccess0.08test_resource_detail.py
test_01_reset_vm_on_rebootSuccess131.07test_reset_vm_on_reboot.py
test_createRegionSuccess0.07test_regions.py
test_create_pvlan_networkSuccess5.19test_pvlan.py
test_dedicatePublicIpRangeSuccess0.39test_public_ip_range.py
test_04_rvpc_privategw_static_routesSuccess513.50test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanupSuccess497.62test_privategw_acl.py
test_02_vpc_privategw_static_routesSuccess373.27test_privategw_acl.py
test_01_vpc_privategw_aclSuccess83.84test_privategw_acl.py
test_01_primary_storage_nfsSuccess35.79test_primary_storage.py
test_createPortablePublicIPRangeSuccess15.17test_portable_publicip.py
test_createPortablePublicIPAcquireSuccess15.65test_portable_publicip.py
test_isolate_network_password_serverSuccess57.07test_password_server.py
test_UpdateStorageOverProvisioningFactorSuccess0.26test_over_provisioning.py
test_extendPhysicalNetworkVlanSuccess15.27test_non_contigiousvlan.py
test_01_nicSuccess809.43test_nic.py
test_releaseIPSuccess289.91test_network.py
test_reboot_routerSuccess390.57test_network.py
test_public_ip_user_accountSuccess10.41test_network.py
test_public_ip_admin_accountSuccess40.23test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_RuleSuccess66.70test_network.py
test_network_rules_acquired_public_ip_2_nat_ruleSuccess61.72test_network.py
test_network_rules_acquired_public_ip_1_static_nat_ruleSuccess123.92test_network.py
test_delete_accountSuccess309.28test_network.py
test_02_port_fwd_on_non_src_natSuccess55.84test_network.py
test_01_port_fwd_on_src_natSuccess111.73test_network.py
test_nic_secondaryip_add_removeSuccess203.93test_multipleips_per_nic.py
login_test_saml_userSuccess26.53test_login.py
test_assign_and_removal_lbSuccess133.14test_loadbalance.py
test_02_create_lb_rule_non_natSuccess186.96test_loadbalance.py
test_01_create_lb_rule_src_natSuccess187.84test_loadbalance.py
test_07_list_default_isoSuccess0.08test_iso.py
test_05_iso_permissionsSuccess0.13test_iso.py
test_04_extract_IsoSuccess5.19test_iso.py
test_03_delete_isoSuccess95.19test_iso.py
test_02_edit_isoSuccess0.05test_iso.py
test_01_create_isoSuccess22.81test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfacesSuccess229.11test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfacesSuccess178.28test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80Success555.75test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80Success472.67test_internal_lb.py
test_dedicateGuestVlanRangeSuccess10.29test_guest_vlan_range.py
test_UpdateConfigParamWithScopeSuccess0.13test_global_settings.py
test_04_create_fat_type_disk_offeringSuccess0.05test_disk_offerings.py
test_03_delete_disk_offeringSuccess0.03test_disk_offerings.py
test_02_edit_disk_offeringSuccess0.05test_disk_offerings.py
test_02_create_sparse_type_disk_offeringSuccess0.06test_disk_offerings.py
test_01_create_disk_offeringSuccess0.09test_disk_offerings.py
test_deployvm_userdispersingSuccess21.42test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentratedSuccess20.82test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfitSuccess70.85test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_postSuccess10.42test_deploy_vm_with_userdata.py
test_deployvm_userdataSuccess45.66test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resizeSuccess6.95test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resizeSuccess7.64test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resizeSuccess225.60test_deploy_vm_root_resize.py
test_deploy_vm_from_isoSuccess205.41test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroupSuccess106.26test_affinity_groups.py
test_03_delete_vm_snapshotsSkipped0.00test_vm_snapshots.py
test_02_revert_vm_snapshotsSkipped0.00test_vm_snapshots.py
test_01_test_vm_volume_snapshotSkipped0.00test_vm_snapshots.py
test_01_create_vm_snapshotsSkipped0.00test_vm_snapshots.py
test_06_copy_templateSkipped0.00test_templates.py
test_01_scale_vmSkipped0.00test_scale_vm.py
test_01_primary_storage_iscsiSkipped0.03test_primary_storage.py
test_06_copy_isoSkipped0.00test_iso.py
test_deploy_vgpu_enabled_vmSkipped0.00test_deploy_vgpu_enabled_vm.py

@blueorangutan

Copy link
Copy Markdown

Trillian test result (tid-296)
Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 6
Total time taken: 30497 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1745-t296-xenserver-65sp1.zip
Test completed. 40 look ok, 3 have error(s)

TestResultTime (s)Test File
test_05_rvpc_multi_tiersFailure430.81test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nicsFailure1321.49test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACLFailure509.68test_vpc_redundant.py
test_04_rvpc_privategw_static_routesFailure695.38test_privategw_acl.py
ContextSuite context=TestRVPCSite2SiteVpn>:setupError0.00test_vpc_vpn.py
test_01_vpc_site2site_vpnSuccess297.61test_vpc_vpn.py
test_01_vpc_remote_access_vpnSuccess126.66test_vpc_vpn.py
test_02_VPC_default_routesSuccess321.25test_vpc_router_nics.py
test_01_VPC_nics_after_destroySuccess617.60test_vpc_router_nics.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routersSuccess826.96test_vpc_redundant.py
test_02_redundant_VPC_default_routesSuccess983.75test_vpc_redundant.py
test_09_delete_detached_volumeSuccess15.73test_volumes.py
test_08_resize_volumeSuccess101.07test_volumes.py
test_07_resize_failSuccess106.15test_volumes.py
test_06_download_detached_volumeSuccess25.58test_volumes.py
test_05_detach_volumeSuccess100.50test_volumes.py
test_04_delete_attached_volumeSuccess10.26test_volumes.py
test_03_download_attached_volumeSuccess15.36test_volumes.py
test_02_attach_volumeSuccess10.75test_volumes.py
test_01_create_volumeSuccess392.36test_volumes.py
test_03_delete_vm_snapshotsSuccess280.28test_vm_snapshots.py
test_02_revert_vm_snapshotsSuccess186.45test_vm_snapshots.py
test_01_create_vm_snapshotsSuccess133.79test_vm_snapshots.py
test_deploy_vm_multipleSuccess178.57test_vm_life_cycle.py
test_deploy_vmSuccess0.03test_vm_life_cycle.py
test_advZoneVirtualRouterSuccess0.02test_vm_life_cycle.py
test_10_attachAndDetach_isoSuccess26.79test_vm_life_cycle.py
test_09_expunge_vmSuccess125.25test_vm_life_cycle.py
test_08_migrate_vmSuccess61.43test_vm_life_cycle.py
test_07_restore_vmSuccess0.14test_vm_life_cycle.py
test_06_destroy_vmSuccess10.16test_vm_life_cycle.py
test_03_reboot_vmSuccess15.21test_vm_life_cycle.py
test_02_start_vmSuccess20.26test_vm_life_cycle.py
test_01_stop_vmSuccess30.39test_vm_life_cycle.py
test_CreateTemplateWithDuplicateNameSuccess111.11test_templates.py
test_08_list_system_templatesSuccess0.03test_templates.py
test_07_list_public_templatesSuccess0.03test_templates.py
test_05_template_permissionsSuccess0.06test_templates.py
test_04_extract_templateSuccess5.18test_templates.py
test_03_delete_templateSuccess5.12test_templates.py
test_02_edit_templateSuccess90.23test_templates.py
test_01_create_templateSuccess60.71test_templates.py
test_10_destroy_cpvmSuccess196.59test_ssvm.py
test_09_destroy_ssvmSuccess198.92test_ssvm.py
test_08_reboot_cpvmSuccess146.66test_ssvm.py
test_07_reboot_ssvmSuccess148.65test_ssvm.py
test_06_stop_cpvmSuccess136.78test_ssvm.py
test_05_stop_ssvmSuccess169.13test_ssvm.py
test_04_cpvm_internalsSuccess1.14test_ssvm.py
test_03_ssvm_internalsSuccess3.70test_ssvm.py
test_02_list_cpvm_vmSuccess0.12test_ssvm.py
test_01_list_sec_storage_vmSuccess0.14test_ssvm.py
test_01_snapshot_root_diskSuccess31.75test_snapshots.py
test_04_change_offering_smallSuccess74.09test_service_offerings.py
test_03_delete_service_offeringSuccess0.05test_service_offerings.py
test_02_edit_service_offeringSuccess0.10test_service_offerings.py
test_01_create_service_offeringSuccess0.10test_service_offerings.py
test_02_sys_template_readySuccess0.12test_secondary_storage.py
test_01_sys_vm_startSuccess0.17test_secondary_storage.py
test_01_scale_vmSuccess5.27test_scale_vm.py
test_09_reboot_routerSuccess55.46test_routers.py
test_08_start_routerSuccess45.45test_routers.py
test_07_stop_routerSuccess15.21test_routers.py
test_06_router_advancedSuccess0.05test_routers.py
test_05_router_basicSuccess0.04test_routers.py
test_04_restart_network_wo_cleanupSuccess5.52test_routers.py
test_03_restart_network_cleanupSuccess115.99test_routers.py
test_02_router_internal_advSuccess0.79test_routers.py
test_01_router_internal_basicSuccess0.42test_routers.py
test_router_dhcphostsSuccess132.82test_router_dhcphosts.py
test_01_updatevolumedetailSuccess5.14test_resource_detail.py
test_01_reset_vm_on_rebootSuccess80.75test_reset_vm_on_reboot.py
test_createRegionSuccess0.05test_regions.py
test_create_pvlan_networkSuccess5.29test_pvlan.py
test_dedicatePublicIpRangeSuccess0.60test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanupSuccess790.08test_privategw_acl.py
test_02_vpc_privategw_static_routesSuccess523.89test_privategw_acl.py
test_01_vpc_privategw_aclSuccess138.97test_privategw_acl.py
test_01_primary_storage_nfsSuccess38.76test_primary_storage.py
test_01_primary_storage_iscsiSuccess80.83test_primary_storage.py
test_createPortablePublicIPRangeSuccess15.24test_portable_publicip.py
test_createPortablePublicIPAcquireSuccess15.58test_portable_publicip.py
test_isolate_network_password_serverSuccess61.14test_password_server.py
test_UpdateStorageOverProvisioningFactorSuccess0.20test_over_provisioning.py
test_extendPhysicalNetworkVlanSuccess15.38test_non_contigiousvlan.py
test_01_nicSuccess930.68test_nic.py
test_releaseIPSuccess204.36test_network.py
test_reboot_routerSuccess546.85test_network.py
test_public_ip_user_accountSuccess10.28test_network.py
test_public_ip_admin_accountSuccess40.38test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_RuleSuccess71.79test_network.py
test_network_rules_acquired_public_ip_2_nat_ruleSuccess62.25test_network.py
test_network_rules_acquired_public_ip_1_static_nat_ruleSuccess92.69test_network.py
test_delete_accountSuccess304.25test_network.py
test_02_port_fwd_on_non_src_natSuccess55.79test_network.py
test_01_port_fwd_on_src_natSuccess78.86test_network.py
test_nic_secondaryip_add_removeSuccess128.33test_multipleips_per_nic.py
login_test_saml_userSuccess24.88test_login.py
test_assign_and_removal_lbSuccess143.82test_loadbalance.py
test_02_create_lb_rule_non_natSuccess192.51test_loadbalance.py
test_01_create_lb_rule_src_natSuccess193.16test_loadbalance.py
test_07_list_default_isoSuccess0.08test_iso.py
test_05_iso_permissionsSuccess0.07test_iso.py
test_04_extract_IsoSuccess5.16test_iso.py
test_03_delete_isoSuccess95.25test_iso.py
test_02_edit_isoSuccess0.06test_iso.py
test_01_create_isoSuccess21.96test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfacesSuccess451.31test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfacesSuccess336.24test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80Success894.62test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80Success674.38test_internal_lb.py
test_dedicateGuestVlanRangeSuccess10.35test_guest_vlan_range.py
test_UpdateConfigParamWithScopeSuccess0.20test_global_settings.py
test_04_create_fat_type_disk_offeringSuccess0.09test_disk_offerings.py
test_03_delete_disk_offeringSuccess0.04test_disk_offerings.py
test_02_edit_disk_offeringSuccess0.06test_disk_offerings.py
test_02_create_sparse_type_disk_offeringSuccess0.08test_disk_offerings.py
test_01_create_disk_offeringSuccess0.14test_disk_offerings.py
test_deployvm_userdispersingSuccess35.90test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentratedSuccess106.33test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfitSuccess166.57test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_postSuccess15.68test_deploy_vm_with_userdata.py
test_deployvm_userdataSuccess111.44test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resizeSuccess6.97test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resizeSuccess6.83test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resizeSuccess7.00test_deploy_vm_root_resize.py
test_deploy_vm_from_isoSuccess173.71test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroupSuccess192.09test_affinity_groups.py
test_01_test_vm_volume_snapshotSkipped0.00test_vm_snapshots.py
test_06_copy_templateSkipped0.00test_templates.py
test_06_copy_isoSkipped0.00test_iso.py
test_deploy_vgpu_enabled_vmSkipped0.01test_deploy_vgpu_enabled_vm.py

@blueorangutan

Copy link
Copy Markdown

Trillian test result (tid-298)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 31109 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1745-t298-vmware-55u3.zip
Test completed. 40 look ok, 3 have error(s)

TestResultTime (s)Test File
test_01_vpc_site2site_vpnError441.25test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpnError662.47test_vpc_vpn.py
test_CreateTemplateWithDuplicateNameError181.25test_templates.py
test_01_create_templateError25.19test_templates.py
ContextSuite context=TestTemplates>:setupError481.87test_templates.py
test_01_snapshot_root_diskError10.15test_snapshots.py
test_01_vpc_remote_access_vpnSuccess151.56test_vpc_vpn.py
test_02_VPC_default_routesSuccess327.66test_vpc_router_nics.py
test_01_VPC_nics_after_destroySuccess656.65test_vpc_router_nics.py
test_05_rvpc_multi_tiersSuccess495.85test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nicsSuccess1514.10test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routersSuccess633.79test_vpc_redundant.py
test_02_redundant_VPC_default_routesSuccess528.85test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACLSuccess1142.68test_vpc_redundant.py
test_09_delete_detached_volumeSuccess30.79test_volumes.py
test_06_download_detached_volumeSuccess50.54test_volumes.py
test_05_detach_volumeSuccess105.33test_volumes.py
test_04_delete_attached_volumeSuccess20.20test_volumes.py
test_03_download_attached_volumeSuccess15.27test_volumes.py
test_02_attach_volumeSuccess53.65test_volumes.py
test_01_create_volumeSuccess513.52test_volumes.py
test_03_delete_vm_snapshotsSuccess275.27test_vm_snapshots.py
test_02_revert_vm_snapshotsSuccess189.06test_vm_snapshots.py
test_01_test_vm_volume_snapshotSuccess151.28test_vm_snapshots.py
test_01_create_vm_snapshotsSuccess161.62test_vm_snapshots.py
test_deploy_vm_multipleSuccess247.87test_vm_life_cycle.py
test_deploy_vmSuccess0.02test_vm_life_cycle.py
test_advZoneVirtualRouterSuccess0.01test_vm_life_cycle.py
test_10_attachAndDetach_isoSuccess21.73test_vm_life_cycle.py
test_09_expunge_vmSuccess185.30test_vm_life_cycle.py
test_08_migrate_vmSuccess61.33test_vm_life_cycle.py
test_07_restore_vmSuccess0.08test_vm_life_cycle.py
test_06_destroy_vmSuccess10.12test_vm_life_cycle.py
test_03_reboot_vmSuccess5.10test_vm_life_cycle.py
test_02_start_vmSuccess20.17test_vm_life_cycle.py
test_01_stop_vmSuccess10.14test_vm_life_cycle.py
test_10_destroy_cpvmSuccess226.55test_ssvm.py
test_09_destroy_ssvmSuccess238.43test_ssvm.py
test_08_reboot_cpvmSuccess156.27test_ssvm.py
test_07_reboot_ssvmSuccess158.45test_ssvm.py
test_06_stop_cpvmSuccess226.66test_ssvm.py
test_05_stop_ssvmSuccess173.74test_ssvm.py
test_04_cpvm_internalsSuccess1.03test_ssvm.py
test_03_ssvm_internalsSuccess3.90test_ssvm.py
test_02_list_cpvm_vmSuccess0.07test_ssvm.py
test_01_list_sec_storage_vmSuccess0.07test_ssvm.py
test_04_change_offering_smallSuccess96.90test_service_offerings.py
test_03_delete_service_offeringSuccess0.03test_service_offerings.py
test_02_edit_service_offeringSuccess0.19test_service_offerings.py
test_01_create_service_offeringSuccess0.07test_service_offerings.py
test_02_sys_template_readySuccess0.13test_secondary_storage.py
test_01_sys_vm_startSuccess0.13test_secondary_storage.py
test_09_reboot_routerSuccess165.90test_routers.py
test_08_start_routerSuccess120.75test_routers.py
test_07_stop_routerSuccess25.18test_routers.py
test_06_router_advancedSuccess0.03test_routers.py
test_05_router_basicSuccess0.02test_routers.py
test_04_restart_network_wo_cleanupSuccess5.54test_routers.py
test_03_restart_network_cleanupSuccess170.91test_routers.py
test_02_router_internal_advSuccess1.09test_routers.py
test_01_router_internal_basicSuccess1.02test_routers.py
test_router_dhcphostsSuccess150.19test_router_dhcphosts.py
test_01_updatevolumedetailSuccess0.06test_resource_detail.py
test_01_reset_vm_on_rebootSuccess60.47test_reset_vm_on_reboot.py
test_createRegionSuccess0.07test_regions.py
test_create_pvlan_networkSuccess5.14test_pvlan.py
test_dedicatePublicIpRangeSuccess0.27test_public_ip_range.py
test_04_rvpc_privategw_static_routesSuccess1049.83test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanupSuccess912.04test_privategw_acl.py
test_02_vpc_privategw_static_routesSuccess561.44test_privategw_acl.py
test_01_vpc_privategw_aclSuccess188.04test_privategw_acl.py
test_01_primary_storage_nfsSuccess38.55test_primary_storage.py
test_createPortablePublicIPRangeSuccess15.37test_portable_publicip.py
test_createPortablePublicIPAcquireSuccess15.43test_portable_publicip.py
test_isolate_network_password_serverSuccess92.00test_password_server.py
test_UpdateStorageOverProvisioningFactorSuccess0.37test_over_provisioning.py
test_extendPhysicalNetworkVlanSuccess15.21test_non_contigiousvlan.py
test_01_nicSuccess821.60test_nic.py
test_releaseIPSuccess313.35test_network.py
test_reboot_routerSuccess625.16test_network.py
test_public_ip_user_accountSuccess10.16test_network.py
test_public_ip_admin_accountSuccess40.30test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_RuleSuccess66.62test_network.py
test_network_rules_acquired_public_ip_2_nat_ruleSuccess61.63test_network.py
test_network_rules_acquired_public_ip_1_static_nat_ruleSuccess124.67test_network.py
test_delete_accountSuccess353.72test_network.py
test_02_port_fwd_on_non_src_natSuccess55.48test_network.py
test_01_port_fwd_on_src_natSuccess111.68test_network.py
test_nic_secondaryip_add_removeSuccess223.56test_multipleips_per_nic.py
login_test_saml_userSuccess22.76test_login.py
test_assign_and_removal_lbSuccess133.64test_loadbalance.py
test_02_create_lb_rule_non_natSuccess187.05test_loadbalance.py
test_01_create_lb_rule_src_natSuccess187.89test_loadbalance.py
test_07_list_default_isoSuccess0.04test_iso.py
test_05_iso_permissionsSuccess0.04test_iso.py
test_04_extract_IsoSuccess5.22test_iso.py
test_03_delete_isoSuccess95.16test_iso.py
test_02_edit_isoSuccess0.03test_iso.py
test_01_create_isoSuccess21.36test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfacesSuccess590.32test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfacesSuccess355.54test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80Success929.59test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80Success757.90test_internal_lb.py
test_dedicateGuestVlanRangeSuccess10.31test_guest_vlan_range.py
test_UpdateConfigParamWithScopeSuccess0.09test_global_settings.py
test_04_create_fat_type_disk_offeringSuccess0.04test_disk_offerings.py
test_03_delete_disk_offeringSuccess0.02test_disk_offerings.py
test_02_edit_disk_offeringSuccess0.03test_disk_offerings.py
test_02_create_sparse_type_disk_offeringSuccess0.04test_disk_offerings.py
test_01_create_disk_offeringSuccess0.06test_disk_offerings.py
test_deployvm_userdispersingSuccess51.27test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentratedSuccess90.81test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfitSuccess212.04test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_postSuccess30.44test_deploy_vm_with_userdata.py
test_deployvm_userdataSuccess166.20test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resizeSuccess6.50test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resizeSuccess6.18test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resizeSuccess6.31test_deploy_vm_root_resize.py
test_deploy_vm_from_isoSuccess237.84test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroupSuccess222.01test_affinity_groups.py
test_08_resize_volumeSkipped5.18test_volumes.py
test_07_resize_failSkipped10.39test_volumes.py
test_01_scale_vmSkipped66.31test_scale_vm.py
test_01_primary_storage_iscsiSkipped0.02test_primary_storage.py
test_06_copy_isoSkipped0.00test_iso.py
test_deploy_vgpu_enabled_vmSkipped0.00test_deploy_vgpu_enabled_vm.py

@yadvr

yadvr commented Nov 8, 2016

Copy link
Copy Markdown
Member

LGTM. Reviews -- @karuturi@jburwell@murali-reddy and others ?

@jburwell

jburwell commented Nov 8, 2016

Copy link
Copy Markdown
Contributor

@rhtyd we have the following failures in the blueoraguntan vmware run that were fixed as part of #1692:

  • test_CreateTemplateWithDuplicateName
  • test_01_create_template
  • ContextSuite context=TestTemplates>:setup

Do we have an explanation for these failures?

The other failures are related to redundant VPC which will be addressed in 4.9.2.0.

@yadvr

yadvr commented Nov 9, 2016

Copy link
Copy Markdown
Member

@jburwell I'm running tests on 4.8+ branches to see what tests may have regressed on these branches.
PR #1752 - 4.8
PR #1753 - 4.9
PR #1754 - 4.10

@blueorangutan package

@blueorangutan

Copy link
Copy Markdown

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan

Copy link
Copy Markdown

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-159

@jburwell

Copy link
Copy Markdown
Contributor

@rhtyd where do we stand determining the root cause of the test failures?

@yadvr

Copy link
Copy Markdown
Member

@blueorangutan package

@yadvr

Copy link
Copy Markdown
Member

@jburwell I'll need to rebuild packages, and re-run tests to see where we currently are.

@yadvr

Copy link
Copy Markdown
Member

@blueorangutan test

@blueorangutan

Copy link
Copy Markdown

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan

Copy link
Copy Markdown

Trillian test result (tid-376)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 25923 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1745-t376-kvm-centos7.zip
Test completed. 43 look ok, 0 have error(s)

TestResultTime (s)Test File
test_01_vpc_site2site_vpnSuccess260.69test_vpc_vpn.py
test_01_vpc_remote_access_vpnSuccess126.83test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpnSuccess258.09test_vpc_vpn.py
test_02_VPC_default_routesSuccess331.81test_vpc_router_nics.py
test_01_VPC_nics_after_destroySuccess534.70test_vpc_router_nics.py
test_05_rvpc_multi_tiersSuccess526.50test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nicsSuccess1449.74test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routersSuccess573.28test_vpc_redundant.py
test_02_redundant_VPC_default_routesSuccess763.84test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACLSuccess1289.88test_vpc_redundant.py
test_09_delete_detached_volumeSuccess15.59test_volumes.py
test_08_resize_volumeSuccess15.37test_volumes.py
test_07_resize_failSuccess20.56test_volumes.py
test_06_download_detached_volumeSuccess15.39test_volumes.py
test_05_detach_volumeSuccess100.31test_volumes.py
test_04_delete_attached_volumeSuccess10.35test_volumes.py
test_03_download_attached_volumeSuccess15.40test_volumes.py
test_02_attach_volumeSuccess45.38test_volumes.py
test_01_create_volumeSuccess720.17test_volumes.py
test_deploy_vm_multipleSuccess295.56test_vm_life_cycle.py
test_deploy_vmSuccess0.05test_vm_life_cycle.py
test_advZoneVirtualRouterSuccess0.04test_vm_life_cycle.py
test_10_attachAndDetach_isoSuccess27.45test_vm_life_cycle.py
test_09_expunge_vmSuccess125.24test_vm_life_cycle.py
test_08_migrate_vmSuccess41.00test_vm_life_cycle.py
test_07_restore_vmSuccess0.14test_vm_life_cycle.py
test_06_destroy_vmSuccess125.99test_vm_life_cycle.py
test_03_reboot_vmSuccess126.29test_vm_life_cycle.py
test_02_start_vmSuccess10.22test_vm_life_cycle.py
test_01_stop_vmSuccess40.43test_vm_life_cycle.py
test_CreateTemplateWithDuplicateNameSuccess80.79test_templates.py
test_08_list_system_templatesSuccess0.07test_templates.py
test_07_list_public_templatesSuccess0.05test_templates.py
test_05_template_permissionsSuccess0.06test_templates.py
test_04_extract_templateSuccess5.17test_templates.py
test_03_delete_templateSuccess5.11test_templates.py
test_02_edit_templateSuccess90.16test_templates.py
test_01_create_templateSuccess60.80test_templates.py
test_10_destroy_cpvmSuccess191.91test_ssvm.py
test_09_destroy_ssvmSuccess164.28test_ssvm.py
test_08_reboot_cpvmSuccess102.16test_ssvm.py
test_07_reboot_ssvmSuccess133.66test_ssvm.py
test_06_stop_cpvmSuccess131.78test_ssvm.py
test_05_stop_ssvmSuccess133.69test_ssvm.py
test_04_cpvm_internalsSuccess1.22test_ssvm.py
test_03_ssvm_internalsSuccess3.37test_ssvm.py
test_02_list_cpvm_vmSuccess0.11test_ssvm.py
test_01_list_sec_storage_vmSuccess0.12test_ssvm.py
test_01_snapshot_root_diskSuccess11.54test_snapshots.py
test_04_change_offering_smallSuccess209.95test_service_offerings.py
test_03_delete_service_offeringSuccess0.04test_service_offerings.py
test_02_edit_service_offeringSuccess0.05test_service_offerings.py
test_01_create_service_offeringSuccess0.11test_service_offerings.py
test_02_sys_template_readySuccess0.20test_secondary_storage.py
test_01_sys_vm_startSuccess0.46test_secondary_storage.py
test_09_reboot_routerSuccess35.39test_routers.py
test_08_start_routerSuccess30.37test_routers.py
test_07_stop_routerSuccess10.16test_routers.py
test_06_router_advancedSuccess0.05test_routers.py
test_05_router_basicSuccess0.04test_routers.py
test_04_restart_network_wo_cleanupSuccess5.76test_routers.py
test_03_restart_network_cleanupSuccess60.56test_routers.py
test_02_router_internal_advSuccess1.03test_routers.py
test_01_router_internal_basicSuccess0.59test_routers.py
test_router_dhcphostsSuccess303.16test_router_dhcphosts.py
test_01_updatevolumedetailSuccess0.08test_resource_detail.py
test_01_reset_vm_on_rebootSuccess131.07test_reset_vm_on_reboot.py
test_createRegionSuccess0.04test_regions.py
test_create_pvlan_networkSuccess5.28test_pvlan.py
test_dedicatePublicIpRangeSuccess0.42test_public_ip_range.py
test_04_rvpc_privategw_static_routesSuccess533.88test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanupSuccess497.82test_privategw_acl.py
test_02_vpc_privategw_static_routesSuccess424.38test_privategw_acl.py
test_01_vpc_privategw_aclSuccess88.78test_privategw_acl.py
test_01_primary_storage_nfsSuccess35.83test_primary_storage.py
test_createPortablePublicIPRangeSuccess15.78test_portable_publicip.py
test_createPortablePublicIPAcquireSuccess15.51test_portable_publicip.py
test_isolate_network_password_serverSuccess90.04test_password_server.py
test_UpdateStorageOverProvisioningFactorSuccess0.15test_over_provisioning.py
test_extendPhysicalNetworkVlanSuccess15.33test_non_contigiousvlan.py
test_01_nicSuccess814.99test_nic.py
test_releaseIPSuccess250.66test_network.py
test_reboot_routerSuccess451.29test_network.py
test_public_ip_user_accountSuccess10.36test_network.py
test_public_ip_admin_accountSuccess40.43test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_RuleSuccess67.10test_network.py
test_network_rules_acquired_public_ip_2_nat_ruleSuccess62.02test_network.py
test_network_rules_acquired_public_ip_1_static_nat_ruleSuccess124.28test_network.py
test_delete_accountSuccess279.39test_network.py
test_02_port_fwd_on_non_src_natSuccess55.99test_network.py
test_01_port_fwd_on_src_natSuccess111.93test_network.py
test_nic_secondaryip_add_removeSuccess234.16test_multipleips_per_nic.py
login_test_saml_userSuccess26.74test_login.py
test_assign_and_removal_lbSuccess134.51test_loadbalance.py
test_02_create_lb_rule_non_natSuccess189.00test_loadbalance.py
test_01_create_lb_rule_src_natSuccess193.70test_loadbalance.py
test_07_list_default_isoSuccess0.06test_iso.py
test_05_iso_permissionsSuccess0.06test_iso.py
test_04_extract_IsoSuccess5.87test_iso.py
test_03_delete_isoSuccess95.21test_iso.py
test_02_edit_isoSuccess0.06test_iso.py
test_01_create_isoSuccess21.91test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfacesSuccess285.96test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfacesSuccess230.34test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80Success576.04test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80Success503.76test_internal_lb.py
test_dedicateGuestVlanRangeSuccess10.29test_guest_vlan_range.py
test_UpdateConfigParamWithScopeSuccess0.14test_global_settings.py
test_04_create_fat_type_disk_offeringSuccess0.06test_disk_offerings.py
test_03_delete_disk_offeringSuccess0.04test_disk_offerings.py
test_02_edit_disk_offeringSuccess0.05test_disk_offerings.py
test_02_create_sparse_type_disk_offeringSuccess0.06test_disk_offerings.py
test_01_create_disk_offeringSuccess0.10test_disk_offerings.py
test_deployvm_userdispersingSuccess20.96test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentratedSuccess51.37test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfitSuccess55.73test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_postSuccess10.44test_deploy_vm_with_userdata.py
test_deployvm_userdataSuccess101.23test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resizeSuccess8.14test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resizeSuccess6.87test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resizeSuccess244.14test_deploy_vm_root_resize.py
test_deploy_vm_from_isoSuccess213.69test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroupSuccess66.36test_affinity_groups.py
test_03_delete_vm_snapshotsSkipped0.00test_vm_snapshots.py
test_02_revert_vm_snapshotsSkipped0.00test_vm_snapshots.py
test_01_test_vm_volume_snapshotSkipped0.00test_vm_snapshots.py
test_01_create_vm_snapshotsSkipped0.00test_vm_snapshots.py
test_06_copy_templateSkipped0.00test_templates.py
test_01_scale_vmSkipped0.00test_scale_vm.py
test_01_primary_storage_iscsiSkipped0.03test_primary_storage.py
test_06_copy_isoSkipped0.00test_iso.py
test_deploy_vgpu_enabled_vmSkipped0.01test_deploy_vgpu_enabled_vm.py

@yadvr

Copy link
Copy Markdown
Member

LGTM, merging this based on last test run and code reviews.

@asfgit
asfgit merged commit 83b5a8b into apache:4.8Nov 23, 2016
asfgit pushed a commit that referenced this pull request Nov 23, 2016
CLOUDSTACK-9503: Increased the VR script timeout. Most of the changes are about converting int/long time values to joda Duration.
* pr/1745:
CLOUDSTACK-9503: Increased the VR script timeout. Most of the changes are about converting int/long time values to joda Duration.
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@abhinandanprateek@yadvr@blueorangutan@jburwell@karuturi@asfgit