Skip to content

CLOUDSTACK-10163: Component tests sanity - #2344

Merged
yadvr merged 25 commits into
apache:masterfrom
shapeblue:component-tests-sanity
Jan 1, 2018
Merged

CLOUDSTACK-10163: Component tests sanity#2344
yadvr merged 25 commits into
apache:masterfrom
shapeblue:component-tests-sanity

Conversation

@borisstoyanov

@borisstoyanovborisstoyanov commented Nov 29, 2017

Copy link
Copy Markdown
Contributor

I've fixed quite a few component tests, most of them should pass now.

@borisstoyanov
CLOUDSTACK-10070: Fixing some component tests and adding them in travis
476e691
@borisstoyanov
Re-arranging travis test jobs to avoid test timeout
5f91e6b
@borisstoyanov
Fixing component tests
02498d5
@borisstoyanov
Adding fixes for component tests
1cf31c0
@borisstoyanov
Fix merge conflicts
1052f5a
Merge branch 'master' of https://github.com/shapeblue/cloudstack into component-tests-sanity
@borisstoyanov
Merge branch 'master' ofhttps://github.com/shapeblue/cloudstackinto…
54cb719
… component-tests-sanity
@borisstoyanov
Adding fixes for: test_escalation_listTemplateDomainAdmin.py, test_es…
6a59255
…calations_templates.py, test_persistent_networks.py, test_vpc_vm_life_cycle.py, test_vpn_service.py
@borisstoyanov
fixing browser templates test
b660109
@borisstoyanov
Fixing test_template_from_snapshot_with_template_details.py, it was l…
a2d0cca
…ooking for a VM that was never defined in test
@borisstoyanov
Adding fixes for test_volumes
6411555
@borisstoyanov
CLOUDSTACK-9586: Adding local storage test
3fcc909
@borisstoyanov
Add fix for test_ss_limits.py, it was lacking a timeout for the secon…
2fb90f3
…dary storage count to sync
@borisstoyanov

borisstoyanov commented Nov 29, 2017

Copy link
Copy Markdown
ContributorAuthor

@blueorangutan package

@blueorangutan

blueorangutan commented Nov 29, 2017

Copy link
Copy Markdown

@borisstoyanov a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan

blueorangutan commented Nov 29, 2017

Copy link
Copy Markdown

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-1319

@borisstoyanov

borisstoyanov commented Nov 29, 2017

Copy link
Copy Markdown
ContributorAuthor

@blueorangutan help

@blueorangutan

blueorangutan commented Nov 29, 2017

Copy link
Copy Markdown

@borisstoyanov I understand these words: "help", "hello", "thanks", "package", "test"
Test command usage: test [mgmt os] [hypervisor] [additional tests]
Mgmt OS options: ['centos6', 'centos7', 'ubuntu']
Hypervisor options: ['kvm-centos6', 'kvm-centos7', 'kvm-ubuntu', 'xenserver-65sp1', 'xenserver-62sp1', 'vmware-60u2', 'vmware-55u3', 'vmware-51u1', 'vmware-50u1']
Additional tests: list of space separated tests with paths relative to the test/integration directory, for example: component/test_acl_listvm.py component/test_volumes.py
Note: when additional tests are passed, you need to specify mgmt server os and hypervisor or use the matrix command.

Blessed contributors for kicking Trillian test jobs: ['rhtyd', 'nvazquez', 'PaulAngus', 'borisstoyanov', 'DaanHoogland']

@blueorangutan

blueorangutan commented Dec 1, 2017

Copy link
Copy Markdown

Trillian test result (tid-1710)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 207591 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr2344-t1710-kvm-centos7.zip
Test completed. 110 look ok, 39 have errors

TestResultTime (s)Test File
test_05_destroy_instance_in_networkFailure747.37test_vpc_vm_life_cycle.py
test_04_reboot_instance_in_networkFailure820.93test_vpc_vm_life_cycle.py
test_06_network_services_VPC_DeleteAllMultiplePFFailure222.57test_vpc_network_staticnatrule.py
test_05_network_services_VPC_DeleteAllPFFailure195.38test_vpc_network_staticnatrule.py
test_01_VPC_StaticNatRuleCreateStoppedStateFailure1104.77test_vpc_network_staticnatrule.py
test_10_network_services_VPC_DeleteAllMultiplePFFailure232.95test_vpc_network_pfrules.py
test_09_network_services_VPC_StopDeleteAllMultiplePFFailure248.01test_vpc_network_pfrules.py
test_08_network_services_VPC_DeleteAllPFFailure155.05test_vpc_network_pfrules.py
test_07_network_services_VPC_StopDeleteAllPFFailure174.76test_vpc_network_pfrules.py
test_06_network_services_VPC_DeletePFFailure156.93test_vpc_network_pfrules.py
test_05_network_services_VPC_StopDeletePFFailure202.09test_vpc_network_pfrules.py
test_03_internallb_rules_vpc_network_restarts_trafficFailure376.03test_vpc_network_internal_lbrules.py
test_02_internallb_rules_trafficFailure563.72test_vpc_network_internal_lbrules.py
test_02_create_template_snapshot_1_root_domain_adminFailure494.89test_ss_limits.py
test_01_register_template_2_child_domain_adminFailure1562.41test_ss_limits.py
test_04_reset_key_passwd_enabled_no_keyFailure785.49test_reset_ssh_keypair.py
test_03_reset_ssh_with_no_keyFailure780.59test_reset_ssh_keypair.py
test_03_reset_keypair_root_adminFailure891.88test_reset_ssh_keypair.py
test_02_reset_ssh_key_password_enabled_templateFailure805.28test_reset_ssh_keypair.py
test_02_reset_keypair_domain_adminFailure886.82test_reset_ssh_keypair.py
test_01_reset_ssh_keysFailure816.18test_reset_ssh_keypair.py
test_01_reset_keypair_normal_userFailure907.11test_reset_ssh_keypair.py
test_restart_network_with_destroyed_masterVRFailure187.34test_redundant_router_cleanups.py
test_list_portable_ip_range_non_root_adminFailure1259.33test_portable_ip.py
test_associate_ip_address_services_enable_disableFailure1383.40test_portable_ip.py
test_vpc_delete_accountFailure1383.19test_persistent_networks.py
test_46_disableHost_user_stop_startVMFailure131.20test_organization_states.py
test_44_disableHost_admin_stop_startVMFailure35.44test_organization_states.py
test_43_disableHost_admin_deployVMFailure5.18test_organization_states.py
test_12_list_create_delete_networkACLFailure0.04test_escalations_networks.py
test_11_update_vpcFailure0.04test_escalations_networks.py
test_10_list_networks_in_vpcFailure0.04test_escalations_networks.py
test_04_disable_host_unmanage_cluster_check_hosts_statusFailure125.24test_escalations_hosts.py
test_03_op_host_capacity_disable_zoneFailure0.05test_escalations_hosts.py
test_02_op_host_capacity_disable_podFailure0.04test_escalations_hosts.py
test_01_op_host_capacity_disable_clusterFailure0.04test_escalations_hosts.py
test_listtemplateFailure171.51test_escalation_listTemplateDomainAdmin.py
test_01_2_egress_fr1Failure134.04test_egress_fw_rules.py
test_browser_upload_template_incompleteFailure310.72test_browse_templates2.py
test_browser_upload_template_incompleteFailure105.49test_browse_templates.py
test_06_Browser_Upload_template_resource_limitsFailure371.55test_browse_templates.py
test_05_Browser_Upload_Template_with_all_API_parametersFailure4.36test_browse_templates.py
test_04_Browser_template_ResetVM_With_Deleted_TemplateFailure10.29test_browse_templates.py
test_14_add_nw_different_account_2_sharedFailure197.09test_add_remove_network.py
test_14_add_nw_different_account_1_isolatedFailure61.16test_add_remove_network.py
ContextSuite context=TestSystemVmLocalStorage>:setupError0.00test_zone_level_local_storage_setting.py
test_01_VPN_serviceError86.73test_vpn_service.py
ContextSuite context=TestVMLifeCycleSharedNwVPC>:setupError889.41test_vpc_vm_life_cycle.py
ContextSuite context=TestVPCHostMaintenance>:setupError0.00test_vpc_on_host_maintenance.py
test_04_internallb_appliance_operations_trafficError1010.48test_vpc_network_internal_lbrules.py
ContextSuite context=TestVMLifeCycleHostmaintenance>:setupError0.00test_vpc_host_maintenance.py
test_04_vmreset_after_migrate_vm__rootvolume_resizedError121.62test_rootvolume_resize.py
test_03_vmsnapshot__on_resized_rootvolume_vmError181.56test_rootvolume_resize.py
test_networkRules_afterRebootRoutersError6.18test_redundant_router_network_rules.py
test_apply_and__delete_NetworkRulesOnRvRError6.30test_redundant_router_network_rules.py
test_applyRules_restartRvRNetworkError6.13test_redundant_router_network_rules.py
test_applyNetworkRules_MasterDown_deleteNetworkRulesError6.25test_redundant_router_network_rules.py
test_RvR_multiprimarystorageError6.55test_redundant_router_deployment_planning.py
test_RvR_multihostsError6.54test_redundant_router_deployment_planning.py
test_redundantVR_internalsError6.14test_redundant_router.py
test_createRvRNetworkError6.10test_redundant_router.py
test_createRvRNetworkError6.11test_redundant_router.py
test_05_stopBackupRvR_startInstanceError6.04test_redundant_router.py
test_04_rebootBackupRvRError6.13test_redundant_router.py
test_03_rebootMasterRvRError6.03test_redundant_router.py
test_02_stopBackupRvRError6.00test_redundant_router.py
test_01_stopMasterRvRError6.03test_redundant_router.py
ContextSuite context=TestRvRRedundancy>:teardownError6.17test_redundant_router.py
test_attach_volume_exceeding_primary_limitsError107.06test_ps_resource_limits_volume.py
test_attach_volume_exceeding_primary_limitsError127.38test_ps_resource_limits_volume.py
ContextSuite context=TestProjectInviteRequired>:setupError0.00test_project_configs.py
test_22_disablePod_admin_deployVMError5.22test_organization_states.py
test_static_nat_on_ip_from_non_src_nat_ip_rangeError0.03test_multiple_public_interfaces.py
test_routing_tablesError0.03test_multiple_public_interfaces.py
test_port_forwarding_on_ip_from_non_src_nat_ip_rangeError0.03test_multiple_public_interfaces.py
test_network_services_VPC_CreatePFError81.86test_multiple_public_interfaces.py
test_network_services_VPC_CreatePFError56.67test_multiple_public_interfaces.py
test_iptable_rulesError0.05test_multiple_public_interfaces.py
test_01_ip_resouce_count_vpc_networkError16.44test_ip_resource_count_for_vpc.py
test_01_host_ha_with_nfs_storagepool_with_vmError63.29test_host.py
test_02_update_vpncustomergatewaysError5.11test_escalations_vpncustomergateways.py
test_01_list_vpncustomergateways_paginationError5.14test_escalations_vpncustomergateways.py
test_03_edit_template_detailsError368.44test_escalations_templates.py
test_01_list_templates_paginationError369.12test_escalations_templates.py
test_19_create_list_reset_delete_vpnconnectionsError50.75test_escalations_networks.py
test_06_create_network_in_vpcError40.62test_escalations_networks.py
test_15_enable_disable_staticnat_forvpcError41.37test_escalations_ipaddresses.py
test_10_create_delete_portforwarding_forvpcError41.36test_escalations_ipaddresses.py
test_05_create_delete_lbrule_forvpcError41.36test_escalations_ipaddresses.py
ContextSuite context=TestIpAddresses>:teardownError5.96test_escalations_ipaddresses.py
test_02_template_permissionsError93.31test_escalation_templates.py
ContextSuite context=TestlistTemplates>:teardownError93.32test_escalation_templates.py
test_06_1_egress_fr6Error735.40test_egress_fw_rules.py
ContextSuite context=TestDeployVMs>:setupError0.00test_dhcp_dns_offload.py
test_es_1863_register_template_s3_domain_admin_userError0.88test_bugs.py
ContextSuite context=TestBrowseUploadVolume>:setupError0.00test_browse_volumes.py
test_03_reuse_template_nameError40.56test_blocker_bugs.py
test_02_check_size_snapshotTemplateError146.99test_blocker_bugs.py
test_06_update_aff_grp_invalid_argsError202.18test_affinity_groups.py
test_04_update_aff_grp_remove_allError0.19test_affinity_groups.py
test_14_add_nw_different_account_2_sharedError207.29test_add_remove_network.py
test_06_add_nw_ipaddress_running_vmError65.95test_add_remove_network.py
test_03_add_nw_multiple_times_2_sharedError30.73test_add_remove_network.py
test_02_add_nw_stopped_vm_2_sharedError130.94test_add_remove_network.py
ContextSuite context=TestAddNetworkToVirtualMachine>:teardownError223.96test_add_remove_network.py
test_09_create_network_shared_nwoff_2_network_offering_vpcnsSkipped0.66test_vpc_network.py
test_06_create_network_with_rvrSkipped0.00test_vpc_network.py
test_05_create_network_diff_account_2_network_offering_vpcnsSkipped0.66test_vpc_network.py
test_04_create_network_overlapping_range_2_network_offering_vpcnsSkipped0.70test_vpc_network.py
test_04_create_multiple_networks_with_lb_2_network_offering_vpcnsSkipped0.63test_vpc_network.py
test_04_create_multiple_networks_with_lb_1_network_offeringSkipped0.62test_vpc_network.py
test_03_create_network_inside_range_2_network_offering_vpcnsSkipped0.63test_vpc_network.py
test_02_create_network_fail_2_network_offering_vpcnsSkipped0.64test_vpc_network.py
test_01_create_network_outside_range_2_network_offering_vpcnsSkipped0.82test_vpc_network.py
test_01_create_network_2_network_offering_vpcnsSkipped0.62test_vpc_network.py
test_03_deploy_vms_in_vpc_with_distributedrouterSkipped0.63test_vpc_distributed_routing_offering.py
test_02_create_vpc_from_offering_with_distributedrouter_service_capabilitySkipped0.62test_vpc_distributed_routing_offering.py
test_01_create_tier_Vmxnet3Skipped0.64test_vpc.py
test_01_migrateVolumeSkipped10.31test_volumes.py
ContextSuite context=TestAntiAffinityRules>:setupSkipped0.00test_vmware_drs.py
ContextSuite context=TestAffinityRules>:setupSkipped0.00test_vmware_drs.py
test_04_vpn_tagSkipped0.00test_tags.py
test_02_migrate_volumeSkipped0.05test_storage_motion.py
test_01_migrate_vm_with_volumeSkipped0.04test_storage_motion.py
test_upload_attach_volumeSkipped0.00test_stopped_vm.py
test_06_deploy_startvm_attach_detachSkipped0.62test_stopped_vm.py
test_04_deploy_startvm_false_attach_volumeSkipped0.62test_stopped_vm.py
test_04_copy_template_2_child_domain_adminSkipped0.02test_ss_limits.py
test_04_copy_template_1_root_domain_adminSkipped0.02test_ss_limits.py
test_03_copy_templateSkipped0.02test_ss_domain_limits.py
test_createSharedNetwork_usedVlanSkipped0.00test_shared_networks.py
test_03_deploy_vms_in_vpc_with_regionlevelvpcSkipped0.68test_region_vpc.py
test_02_create_vpc_from_offering_with_regionlevelvpc_service_capabilitySkipped0.64test_region_vpc.py
test_RvR_multipodsSkipped0.81test_redundant_router_deployment_planning.py
test_RvR_multiclusterSkipped0.74test_redundant_router_deployment_planning.py
test_destroy_recover_vm_2_child_domain_adminSkipped0.00test_ps_limits.py
test_destroy_recover_vm_1_root_domain_adminSkipped0.00test_ps_limits.py
test_01_vmsnapshot_usageSkipped0.00test_project_usage.py
ContextSuite context=TestProjectInviteTimeout>:setupSkipped0.00test_project_configs.py
ContextSuite context=TestProjectInviteRequiredTrue>:setupSkipped0.00test_project_configs.py
ContextSuite context=TestProjectCreationNegative>:setupSkipped0.00test_project_configs.py
test_vpc_private_gateway_static_routeSkipped0.00test_persistent_networks.py
test_upgrade_to_persistent_services_VR_2_LB_NSSkipped0.00test_persistent_networks.py
test_upgrade_network_NS_to_persistent_NSSkipped0.00test_persistent_networks.py
test_pf_nat_rule_persistent_network_2_LB_NetscalerSkipped0.00test_persistent_networks.py
test_cleanup_persistent_network_lb_netscaler_2_falseSkipped0.00test_persistent_networks.py
test_cleanup_persistent_network_lb_netscaler_1_trueSkipped0.00test_persistent_networks.py
test_assign_vm_different_account_VR_3_LB_NSSkipped1.28test_persistent_networks.py
test_04_deploy_multiple_vmSkipped1.44test_memory_limits.py
test_11_ldapSkipped0.07test_ldap_auto_import.py
test_10_ldapSkipped0.10test_ldap_auto_import.py
test_09_ldapSkipped0.06test_ldap_auto_import.py
test_08_ldapSkipped0.07test_ldap_auto_import.py
test_07_ldapSkipped0.07test_ldap_auto_import.py
test_06_ldapSkipped0.08test_ldap_auto_import.py
test_05_ldapSkipped0.08test_ldap_auto_import.py
test_04_ldapSkipped0.08test_ldap_auto_import.py
test_03_ldapSkipped0.07test_ldap_auto_import.py
test_02_ldapSkipped0.07test_ldap_auto_import.py
test_01_ldapSkipped0.12test_ldap_auto_import.py
test_01_addLdapConfigurationSkipped0.00test_ldap.py
test_check_hypervisor_max_limit_effectSkipped0.00test_hypervisor_limit.py
ContextSuite context=TestHostHighAvailability>:setupSkipped0.00test_host_high_availability.py
test_03_host_ha_with_only_local_storageSkipped0.03test_host_ha.py
test_02_host_ha_with_local_storage_and_nfsSkipped0.04test_host_ha.py
test_02_host_maintenance_mode_with_activitiesSkipped0.75test_high_availability.py
test_01_host_maintenance_modeSkipped1.05test_high_availability.py
test_04_check_vm_snapshot_creation_after_Instance_creationSkipped0.00test_escalations_vmware.py
test3_attach_ISO_in_RHEL7OSVMSkipped0.03test_escalations_vmware.py
test2_attach_ISO_in_CentOSVMSkipped0.03test_escalations_vmware.py
test1_attach_volume_ideSkipped0.03test_escalations_vmware.py
test_04_copy_templateSkipped0.82test_escalations_templates.py
test_04_list_vm_snapshots_byidSkipped0.00test_escalations_snapshots.py
test_03_list_vm_snapshots_paginationSkipped0.00test_escalations_snapshots.py
test_04_copy_isoSkipped0.03test_escalations_isos.py
test_19_create_update_autoscalevmgroupSkipped0.82test_escalations_ipaddresses.py
test_18_create_update_autoscaleprofilesSkipped0.80test_escalations_ipaddresses.py
test_17_create_update_autoscalepolicySkipped0.79test_escalations_ipaddresses.py
test_Scale_VMSkipped0.05test_escalations_instances.py
test1_attach_volumeSkipped0.04test_escalations_instances.py
test_01_CS40139_listtemplate_with_different_pagesizeSkipped0.00test_escalation_templates.py
test_08_egress_fr8Skipped0.00test_egress_fw_rules.py
test_08_1_egress_fr8Skipped0.00test_egress_fw_rules.py
test_05_egress_fr5Skipped0.00test_egress_fw_rules.py
test_05_1_egress_fr5Skipped0.00test_egress_fw_rules.py
test_change_so_running_vm_static_to_static_2_USER_ACCOUNTSkipped0.02test_dynamic_compute_offering.py
test_change_so_running_vm_static_to_static_1_ADMIN_ACCOUNTSkipped0.02test_dynamic_compute_offering.py
test_change_so_running_vm_static_to_dynamic_2_USER_ACCOUNTSkipped0.02test_dynamic_compute_offering.py
test_change_so_running_vm_static_to_dynamic_1_ADMIN_ACCOUNTSkipped0.02test_dynamic_compute_offering.py
test_change_so_running_vm_dynamic_to_static_2_USER_ACCOUNTSkipped0.02test_dynamic_compute_offering.py
test_change_so_running_vm_dynamic_to_static_1_ADMIN_ACCOUNTSkipped0.02test_dynamic_compute_offering.py
test_change_so_running_vm_dynamic_to_dynamic_2_USER_ACCOUNTSkipped0.03test_dynamic_compute_offering.py
test_change_so_running_vm_dynamic_to_dynamic_1_ADMIN_ACCOUNTSkipped0.04test_dynamic_compute_offering.py
ContextSuite context=TestvGPUWindowsVm>:setupSkipped0.00test_deploy_vgpu_vm.py
ContextSuite context=TestInstanceNameFlagTrue>:setupSkipped111.09test_custom_hostname.py
test_04_deploy_multiple_vm_with_multiple_cpusSkipped1.41test_cpu_limits.py
test_02_concurrent_snapshot_global_limitSkipped0.02test_concurrent_snapshots_limit.py
test_local_storage_data_disk_tagSkipped0.00test_bugs.py
test_es_47_list_os_types_win_2012Skipped0.02test_bugs.py
test_es_1223_apply_algo_to_podsSkipped0.02test_bugs.py
test_add_cluster_datacenter_spacesSkipped0.00test_bugs.py
test_CLOUDSTACK_5023Skipped0.00test_bugs.py
test_03_Browser_template_upload_multiple_zonesSkipped0.04test_browse_templates.py

@yadvr

yadvr commented Dec 19, 2017

Copy link
Copy Markdown
Member

@borisstoyanov can you fix conflicts, let's re-review/test and merge this?

@borisstoyanov

borisstoyanov commented Dec 20, 2017

Copy link
Copy Markdown
ContributorAuthor

@blueorangutan package

@blueorangutan

blueorangutan commented Dec 20, 2017

Copy link
Copy Markdown

@borisstoyanov a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan

blueorangutan commented Dec 20, 2017

Copy link
Copy Markdown

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-1435

@borisstoyanov

borisstoyanov commented Dec 20, 2017

Copy link
Copy Markdown
ContributorAuthor

@blueorangutan test centos7 kvm-centos7 component/test_*.py

@blueorangutan

blueorangutan commented Dec 20, 2017

Copy link
Copy Markdown

@borisstoyanov a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan

blueorangutan commented Dec 20, 2017

Copy link
Copy Markdown

Trillian test result (tid-1838)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 30522 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr2344-t1838-kvm-centos7.zip
Smoke tests completed. 63 look OK, 4 have error(s)
Only failed tests results shown below:

TestResultTime (s)Test File
test_01_vpc_privategw_aclFailure57.06test_privategw_acl.py
test_02_vpc_privategw_static_routesFailure163.20test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanupFailure128.13test_privategw_acl.py
test_04_rvpc_privategw_static_routesFailure299.39test_privategw_acl.py
ContextSuite context=TestSnapshotRootDisk>:setupError0.00test_snapshots.py
test_02_create_template_with_checksum_sha1Error15.32test_templates.py
test_03_create_template_with_checksum_sha256Error5.24test_templates.py
test_04_create_template_with_checksum_md5Error5.23test_templates.py
test_01_vpc_remote_access_vpnError50.78test_vpc_vpn.py

Additional tests completed. 1 look ok, 0 have error(s)

TestResultTime (s)Test File

@yadvr

yadvr commented Dec 20, 2017

Copy link
Copy Markdown
Member

Looks like wildcard passing of component tests did not work, this only ran smoke tests. Maybe use jenkins directly to kick component tests @borisstoyanov?

@borisstoyanov

borisstoyanov commented Dec 21, 2017

Copy link
Copy Markdown
ContributorAuthor

@blueorangutan test centos7 kvm-centos7 component/test_lb_secondary_ip.py component/test_acl_listvm.py component/test_snapshots.py component/test_ldap_auto_import.py component/test_host_maintenance.py component/test_assign_vm.py component/test_invalid_gw_nm.py component/test_cpu_limits.py component/test_storage_motion.py component/test_host_ha.py component/test_escalations_routers.py component/test_secsr_mount.py component/test_escalations_volumes.py component/test_recurring_snapshots.py component/test_browse_volumes.py component/test_stopped_vm.py component/test_allocation_states.py component/test_snapshot_gc.py component/test_mm_max_limits.py component/test_interop_xd_ccp.py component/test_acl_listvolume.py component/test_tags.py component/test_affinity_groups_projects.py component/test_resource_limits.py component/test_security_groups.py component/test_escalations_ipaddresses.py component/test_cpu_project_limits.py component/test_mm_domain_limits.py component/test_cpu_max_limits.py component/test_ps_max_limits.py component/test_vpc_network_internal_lbrules.py component/test_ps_resize_volume.py component/test_escalations_templates.py component/test_vpc_network.py component/test_eip_elb.py component/test_deploy_vgpu_vm.py component/test_vm_passwdenabled.py component/test_browse_templates2.py component/test_separate_backup_from_snapshot.py component/test_escalations_vpncustomergateways.py component/test_project_resources.py component/test_multiple_ips_per_nic.py component/test_template_from_snapshot_with_template_details.py component/test_add_remove_network.py component/test_ncc_integration_dedicated.py component/test_acl_isolatednetwork_delete.py component/test_templates.py component/test_overcommit.py component/test_reset_ssh_keypair.py component/test_ps_resource_limits_volume.py component/test_escalations_vmware.py component/test_mm_project_limits.py component/test_simultaneous_volume_attach.py component/test_acl_listsnapshot.py component/test_netscaler_nw_off.py component/test_escalations_snapshots.py component/test_volumes.py component/test_regions.py component/test_ss_project_limits.py component/test_routers.py component/test_vpn_users.py component/test_host.py component/test_dhcp_dns_offload.py component/test_escalations_instances.py component/test_redundant_router_cleanups.py component/test_cpu_domain_limits.py component/test_persistent_networks.py component/test_usage.py component/test_ss_max_limits.py component/test_netscaler_lb_algo.py component/test_accounts.py component/test_projects.py component/test_vpc_vm_life_cycle.py component/test_ss_domain_limits.py component/test_haproxy.py component/test_vpc.py component/test_blocker_bugs.py component/test_rootvolume_resize.py component/test_netscaler_lb.py component/test_asa1000v_fw.py component/test_netscaler_lb_sticky.py component/test_organization_states.py component/test_project_usage.py component/test_regions_accounts.py component/test_ncc_integration_shared.py component/test_memory_limits.py component/test_base_image_updation.py component/test_deploy_vm_userdata_reg.py component/test_project_limits.py component/test_baremetal.py component/test_acl_isolatednetwork.py component/test_brocade_vcs.py component/test_bigswitch_bcf.py component/test_concurrent_create_volume_from_snapshot.py component/test_escalations_networks.py component/test_custom_hostname.py component/test_network_offering.py component/test_browse_templates.py component/test_project_configs.py component/test_VirtualRouter_alerts.py component/test_vpc_vms_deployment.py component/test_vpc_offerings.py component/test_acl_sharednetwork_deployVM-impersonation.py component/test_vpn_service.py component/test_implicit_planner.py component/test_deploy_vm_userdata_multi_nic.py component/test_affinity_groups.py component/test_redundant_router_upgrades.py component/test_advancedsg_networks.py component/test_vpc_network_pfrules.py component/test_ldap.py component/test_netscaler_configs.py component/test_update_vm.py component/test_egress_fw_rules.py component/test_multiple_ip_ranges.py component/test_ps_limits.py component/test_ip_reservation.py component/test_ps_domain_limits.py component/test_region_vpc.py component/test_dynamic_compute_offering.py component/test_ss_limits.py component/test_ps_project_limits.py component/test_escalation_listTemplateDomainAdmin.py component/test_multiple_public_interfaces.py component/test_escalations_securitygroups.py component/test_vpc_distributed_routing_offering.py component/test_non_contiguous_vlan.py component/test_shared_networks.py component/test_portable_ip.py component/test_escalations_isos.py component/test_list_nics.py component/test_snapshots_improvement.py component/test_vpc_network_lbrules.py component/test_egress_rules.py component/test_vpc_routers.py component/test_vmware_drs.py component/test_acl_sharednetwork.py component/test_concurrent_snapshots_limit.py component/test_vpc_network_staticnatrule.py component/test_list_pod.py component/test_migrate_vol_to_maintained_pool.py component/test_snapshot_limits.py component/test_redundant_router_services.py

@blueorangutan

blueorangutan commented Dec 21, 2017

Copy link
Copy Markdown

@borisstoyanov a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan

blueorangutan commented Dec 24, 2017

Copy link
Copy Markdown

Trillian test result (tid-1858)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 229463 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr2344-t1858-kvm-centos7.zip
Smoke tests completed. 64 look OK, 3 have error(s)
Only failed tests results shown below:

TestResultTime (s)Test File
test_01_vpc_privategw_aclFailure61.92test_privategw_acl.py
test_02_vpc_privategw_static_routesFailure223.93test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanupFailure319.24test_privategw_acl.py
test_04_rvpc_privategw_static_routesFailure394.87test_privategw_acl.py
test_02_create_template_with_checksum_sha1Error5.24test_templates.py
test_03_create_template_with_checksum_sha256Error5.23test_templates.py
test_04_create_template_with_checksum_md5Error5.24test_templates.py
test_01_vpc_remote_access_vpnError71.06test_vpc_vpn.py

Additional tests completed. 87 look ok, 45 have error(s)

TestResultTime (s)Test File
test_01_createVM_snapshotTemplateError217.34test_snapshots.py
test_04_delete_snapshotFailure108.25test_snapshots.py
test_07_template_from_snapshotError318.66test_snapshots.py
test_05_volume_snapshotError147.81test_escalations_volumes.py
test_11_volume_extractError157.76test_escalations_volumes.py
ContextSuite context=TestBrowseUploadVolume>:setupError0.00test_browse_volumes.py
test_02_deploy_ha_vm_from_isoError1514.16test_stopped_vm.py
test_07_deploy_startvm_attach_isoFailure1519.34test_stopped_vm.py
test_deploy_vm_password_enabledError5.75test_stopped_vm.py
test_02_accountSnapshotCleanFailure82.30test_snapshot_gc.py
test_06_template_tagError156.64test_tags.py
test_05_templates_per_accountError454.69test_resource_limits.py
test_05_templates_per_domainError378.63test_resource_limits.py
ContextSuite context=TestResourceLimitsDomain>:teardownError388.87test_resource_limits.py
test_05_create_delete_lbrule_forvpcError46.39test_escalations_ipaddresses.py
test_10_create_delete_portforwarding_forvpcError46.33test_escalations_ipaddresses.py
test_15_enable_disable_staticnat_forvpcError46.34test_escalations_ipaddresses.py
ContextSuite context=TestIpAddresses>:teardownError0.86test_escalations_ipaddresses.py
test_02_internallb_rules_trafficFailure604.04test_vpc_network_internal_lbrules.py
test_03_internallb_rules_vpc_network_restarts_trafficFailure376.63test_vpc_network_internal_lbrules.py
test_04_internallb_appliance_operations_trafficError1015.43test_vpc_network_internal_lbrules.py
ContextSuite context=TestTemplates>:setupError0.00test_escalations_templates.py
ContextSuite context=TestVMPasswordEnabled>:teardownError244.72test_vm_passwdenabled.py
test_browser_upload_template_incompleteFailure0.08test_browse_templates2.py
test_01_list_vpncustomergateways_paginationError5.14test_escalations_vpncustomergateways.py
test_02_update_vpncustomergatewaysError5.12test_escalations_vpncustomergateways.py
test_04_public_private_template_use_in_projectError267.59test_project_resources.py
test_05_use_private_template_in_projectError348.15test_project_resources.py
ContextSuite context=TestTemplates>:teardownError383.67test_project_resources.py
test_add_ip_to_nic_1_SHAREDFailure0.74test_multiple_ips_per_nic.py
test_add_static_nat_rule_2_SHAREDFailure0.81test_multiple_ips_per_nic.py
test_disassociate_ip_mapped_to_secondary_ip_through_PF_rule_2_SHAREDFailure0.73test_multiple_ips_per_nic.py
test_01_create_template_snampshotError5.14test_template_from_snapshot_with_template_details.py
test_02_add_nw_stopped_vm_2_sharedError131.14test_add_remove_network.py
test_03_add_nw_multiple_times_2_sharedError30.77test_add_remove_network.py
test_06_add_nw_ipaddress_running_vmError86.14test_add_remove_network.py
test_14_add_nw_different_account_1_isolatedFailure66.20test_add_remove_network.py
test_14_add_nw_different_account_2_sharedError0.78test_add_remove_network.py
ContextSuite context=TestAddNetworkToVirtualMachine>:teardownError198.97test_add_remove_network.py
test_01_create_templateError5.18test_templates.py
test_03_delete_templateError5.15test_templates.py
test_04_template_from_snapshotError106.85test_templates.py
test_01_reset_keypair_normal_userFailure909.81test_reset_ssh_keypair.py
test_02_reset_keypair_domain_adminFailure843.20test_reset_ssh_keypair.py
test_03_reset_keypair_root_adminFailure893.72test_reset_ssh_keypair.py
ContextSuite context=TestResetSSHKeyUserRights>:teardownError919.14test_reset_ssh_keypair.py
test_01_reset_ssh_keysFailure901.37test_reset_ssh_keypair.py
test_02_reset_ssh_key_password_enabled_templateFailure780.47test_reset_ssh_keypair.py
test_03_reset_ssh_with_no_keyFailure785.56test_reset_ssh_keypair.py
test_04_reset_key_passwd_enabled_no_keyFailure861.40test_reset_ssh_keypair.py
ContextSuite context=TestResetSSHKeypair>:teardownError81.65test_reset_ssh_keypair.py
test_attach_volume_exceeding_primary_limitsError126.94test_ps_resource_limits_volume.py
test_attach_volume_exceeding_primary_limitsError152.25test_ps_resource_limits_volume.py
test_01_volume_iso_attachFailure1758.77test_volumes.py
test_01_register_template_with_projectError11.09test_ss_project_limits.py
test_02_register_isoError672.59test_ss_project_limits.py
test_01_host_ha_with_nfs_storagepool_with_vmError63.25test_host.py
ContextSuite context=TestVMLifeCycleSharedNwVPC>:setupError395.06test_vpc_vm_life_cycle.py
test_04_reboot_instance_in_networkFailure820.97test_vpc_vm_life_cycle.py
test_05_destroy_instance_in_networkFailure742.73test_vpc_vm_life_cycle.py
test_04_create_template_delete_accountFailure7.27test_ss_domain_limits.py
test_04_create_template_delete_accountError17.48test_ss_domain_limits.py
test_01_multiple_domains_secondary_storage_limitsFailure7.24test_ss_domain_limits.py
test_02_multiple_domains_secondary_storage_countsFailure7.18test_ss_domain_limits.py
ContextSuite context=TestDataPersistency>:teardownError398.96test_blocker_bugs.py
test_01_create_templateError5.14test_blocker_bugs.py
test_02_check_size_snapshotTemplateError85.87test_blocker_bugs.py
test_03_reuse_template_nameError70.73test_blocker_bugs.py
test_02_create__template_new_resized_rootvolume_sizeError372.40test_rootvolume_resize.py
test_03_vmsnapshot__on_resized_rootvolume_vmError206.40test_rootvolume_resize.py
test_04_vmreset_after_migrate_vm__rootvolume_resizedError210.86test_rootvolume_resize.py
test_22_disablePod_admin_deployVMError5.24test_organization_states.py
test_43_disableHost_admin_deployVMFailure5.19test_organization_states.py
test_44_disableHost_admin_stop_startVMFailure131.03test_organization_states.py
test_46_disableHost_user_stop_startVMFailure40.50test_organization_states.py
ContextSuite context=TestISOUsage>:setupError0.00test_project_usage.py
test_01_template_usageError5.13test_project_usage.py
test_03_restore_vm_with_new_templateError1514.45test_base_image_updation.py
test_07_templates_per_projectError5.21test_project_limits.py
test_06_create_network_in_vpcError45.72test_escalations_networks.py
test_10_list_networks_in_vpcFailure0.06test_escalations_networks.py
test_11_update_vpcFailure0.04test_escalations_networks.py
test_12_list_create_delete_networkACLFailure0.04test_escalations_networks.py
test_19_create_list_reset_delete_vpnconnectionsError55.81test_escalations_networks.py
test_01_Browser_template_Life_cycle_tpathError0.09test_browse_templates.py
test_browser_upload_template_incompleteFailure195.59test_browse_templates.py
test_08_ip_reallocation_CS5986Error661.34test_vpc_vms_deployment.py
ContextSuite context=TestVMDeployVPC>:teardownError1406.32test_vpc_vms_deployment.py
test_01_VPN_serviceError76.61test_vpn_service.py
test_04_update_aff_grp_remove_allError5.22test_affinity_groups.py
test_06_update_aff_grp_invalid_argsError221.98test_affinity_groups.py
test_05_network_services_VPC_StopDeletePFFailure217.26test_vpc_network_pfrules.py
test_06_network_services_VPC_DeletePFFailure207.49test_vpc_network_pfrules.py
test_07_network_services_VPC_StopDeleteAllPFFailure242.96test_vpc_network_pfrules.py
test_08_network_services_VPC_DeleteAllPFFailure157.98test_vpc_network_pfrules.py
test_09_network_services_VPC_StopDeleteAllMultiplePFFailure253.03test_vpc_network_pfrules.py
test_10_network_services_VPC_DeleteAllMultiplePFFailure297.77test_vpc_network_pfrules.py
test_01_2_egress_fr1Failure186.53test_egress_fw_rules.py
test_create_template_snapshot_1_root_domain_adminFailure343.66test_ps_limits.py
test_listtemplateFailure226.69test_escalation_listTemplateDomainAdmin.py
test_iptable_rulesError0.04test_multiple_public_interfaces.py
test_port_forwarding_on_ip_from_non_src_nat_ip_rangeError0.03test_multiple_public_interfaces.py
test_routing_tablesError0.03test_multiple_public_interfaces.py
test_static_nat_on_ip_from_non_src_nat_ip_rangeError0.03test_multiple_public_interfaces.py
test_network_services_VPC_CreatePFError132.10test_multiple_public_interfaces.py
test_network_services_VPC_CreatePFError142.13test_multiple_public_interfaces.py
test_05_remove_used_rangeFailure147.24test_non_contiguous_vlan.py
test_acquire_ipError0.76test_shared_networks.py
test_createSharedNetwork_usedVlan2Error0.85test_shared_networks.py
test_deployVM_isolatedAndSharedError0.95test_shared_networks.py
test_deployVM_multipleSharedNetworkError0.87test_shared_networks.py
test_associate_ip_address_services_enable_disableFailure1423.40test_portable_ip.py
test_list_portable_ip_range_non_root_adminFailure1264.15test_portable_ip.py
test_01_VPC_StaticNatRuleCreateStoppedStateFailure786.24test_vpc_network_staticnatrule.py
test_05_network_services_VPC_DeleteAllPFFailure144.72test_vpc_network_staticnatrule.py
test_06_network_services_VPC_DeleteAllMultiplePFFailure254.56test_vpc_network_staticnatrule.py

borisstoyanovand others added 4 commits December 24, 2017 12:47
@borisstoyanov@yadvr
Fixing test_template_from_snapshot_with_template_details.py, it was l…
4963bee
…ooking for a VM that was never defined in test
@borisstoyanov@yadvr
Adding fixes for test_volumes
29e31c7
@borisstoyanov@yadvr
Add fix for test_ss_limits.py, it was lacking a timeout for the secon…
4be5864
…dary storage count to sync
@yadvr
travis.yml: rearrange/sort by name/type and remove duplicates
a927d4f
Also fixes regression from rebase
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
@yadvr
yadvrforce-pushed the component-tests-sanity branch from d49d6d1 to a927d4fCompareDecember 24, 2017 07:36
@yadvr

yadvr commented Dec 24, 2017

Copy link
Copy Markdown
Member

Rebased and fixed conflicts @borisstoyanov
@blueorangutan package

@blueorangutan

blueorangutan commented Dec 24, 2017

Copy link
Copy Markdown

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan

blueorangutan commented Dec 24, 2017

Copy link
Copy Markdown

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-1475

@borisstoyanov

borisstoyanov commented Dec 24, 2017

Copy link
Copy Markdown
ContributorAuthor

@blueorangutan test centos7 kvm-centos7 component/test_lb_secondary_ip.py component/test_acl_listvm.py component/test_snapshots.py component/test_ldap_auto_import.py component/test_host_maintenance.py component/test_assign_vm.py component/test_invalid_gw_nm.py component/test_cpu_limits.py component/test_storage_motion.py component/test_host_ha.py component/test_escalations_routers.py component/test_secsr_mount.py component/test_escalations_volumes.py component/test_recurring_snapshots.py component/test_browse_volumes.py component/test_stopped_vm.py component/test_allocation_states.py component/test_snapshot_gc.py component/test_mm_max_limits.py component/test_interop_xd_ccp.py component/test_acl_listvolume.py component/test_tags.py component/test_affinity_groups_projects.py component/test_resource_limits.py component/test_security_groups.py component/test_escalations_ipaddresses.py component/test_cpu_project_limits.py component/test_mm_domain_limits.py component/test_cpu_max_limits.py component/test_ps_max_limits.py component/test_vpc_network_internal_lbrules.py component/test_ps_resize_volume.py component/test_escalations_templates.py component/test_vpc_network.py component/test_eip_elb.py component/test_deploy_vgpu_vm.py component/test_vm_passwdenabled.py component/test_browse_templates2.py component/test_separate_backup_from_snapshot.py component/test_escalations_vpncustomergateways.py component/test_project_resources.py component/test_multiple_ips_per_nic.py component/test_template_from_snapshot_with_template_details.py component/test_add_remove_network.py component/test_ncc_integration_dedicated.py component/test_acl_isolatednetwork_delete.py component/test_templates.py component/test_overcommit.py component/test_reset_ssh_keypair.py component/test_ps_resource_limits_volume.py component/test_escalations_vmware.py component/test_mm_project_limits.py component/test_simultaneous_volume_attach.py component/test_acl_listsnapshot.py component/test_netscaler_nw_off.py component/test_escalations_snapshots.py component/test_volumes.py component/test_regions.py component/test_ss_project_limits.py component/test_routers.py component/test_vpn_users.py component/test_host.py component/test_dhcp_dns_offload.py component/test_escalations_instances.py component/test_redundant_router_cleanups.py component/test_cpu_domain_limits.py component/test_persistent_networks.py component/test_usage.py component/test_ss_max_limits.py component/test_netscaler_lb_algo.py component/test_accounts.py component/test_projects.py component/test_vpc_vm_life_cycle.py component/test_ss_domain_limits.py component/test_haproxy.py component/test_vpc.py component/test_blocker_bugs.py component/test_rootvolume_resize.py component/test_netscaler_lb.py component/test_asa1000v_fw.py component/test_netscaler_lb_sticky.py component/test_organization_states.py component/test_project_usage.py component/test_regions_accounts.py component/test_ncc_integration_shared.py component/test_memory_limits.py component/test_base_image_updation.py component/test_deploy_vm_userdata_reg.py component/test_project_limits.py component/test_baremetal.py component/test_acl_isolatednetwork.py component/test_brocade_vcs.py component/test_bigswitch_bcf.py component/test_concurrent_create_volume_from_snapshot.py component/test_escalations_networks.py component/test_custom_hostname.py component/test_network_offering.py component/test_browse_templates.py component/test_project_configs.py component/test_VirtualRouter_alerts.py component/test_vpc_vms_deployment.py component/test_vpc_offerings.py component/test_acl_sharednetwork_deployVM-impersonation.py component/test_vpn_service.py component/test_implicit_planner.py component/test_deploy_vm_userdata_multi_nic.py component/test_affinity_groups.py component/test_redundant_router_upgrades.py component/test_advancedsg_networks.py component/test_vpc_network_pfrules.py component/test_ldap.py component/test_netscaler_configs.py component/test_update_vm.py component/test_egress_fw_rules.py component/test_multiple_ip_ranges.py component/test_ps_limits.py component/test_ip_reservation.py component/test_ps_domain_limits.py component/test_region_vpc.py component/test_dynamic_compute_offering.py component/test_ss_limits.py component/test_ps_project_limits.py component/test_escalation_listTemplateDomainAdmin.py component/test_multiple_public_interfaces.py component/test_escalations_securitygroups.py component/test_vpc_distributed_routing_offering.py component/test_non_contiguous_vlan.py component/test_shared_networks.py component/test_portable_ip.py component/test_escalations_isos.py component/test_list_nics.py component/test_snapshots_improvement.py component/test_vpc_network_lbrules.py component/test_egress_rules.py component/test_vpc_routers.py component/test_vmware_drs.py component/test_acl_sharednetwork.py component/test_concurrent_snapshots_limit.py component/test_vpc_network_staticnatrule.py component/test_list_pod.py component/test_migrate_vol_to_maintained_pool.py component/test_snapshot_limits.py component/test_redundant_router_services.py

@blueorangutan

blueorangutan commented Dec 24, 2017

Copy link
Copy Markdown

@borisstoyanov a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

yadvr
yadvr approved these changes Dec 26, 2017
View reviewed changes

@yadvryadvr left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, nice work @borisstoyanov ! (I saw no test failures till now, check on the marvin host, hopefully we should see less failure in the next result)

@yadvr

yadvr commented Dec 26, 2017

Copy link
Copy Markdown
Member

Pinging for additional review - @nvazquez@DaanHoogland@wido@marcaurele@rafaelweingartner and others, thanks.

@blueorangutan

blueorangutan commented Dec 28, 2017

Copy link
Copy Markdown

Trillian test result (tid-1912)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 249025 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr2344-t1912-kvm-centos7.zip
Intermitten failure detected: /marvin/tests/smoke/test_deploy_virtio_scsi_vm.py
Intermitten failure detected: /marvin/tests/smoke/test_password_server.py
Intermitten failure detected: /marvin/tests/smoke/test_ssvm.py
Smoke tests completed. 66 look OK, 0 have error(s)
Only failed tests results shown below:

TestResultTime (s)Test File

Additional tests completed. 88 look ok, 41 have error(s)

TestResultTime (s)Test File
ContextSuite context=TestBrowseUploadVolume>:setupError0.00test_browse_volumes.py
test_05_create_delete_lbrule_forvpcError51.98test_escalations_ipaddresses.py
test_10_create_delete_portforwarding_forvpcError77.88test_escalations_ipaddresses.py
test_15_enable_disable_staticnat_forvpcError51.92test_escalations_ipaddresses.py
ContextSuite context=TestIpAddresses>:teardownError1.08test_escalations_ipaddresses.py
test_02_internallb_rules_trafficFailure655.07test_vpc_network_internal_lbrules.py
test_03_internallb_rules_vpc_network_restarts_trafficFailure484.25test_vpc_network_internal_lbrules.py
test_04_internallb_appliance_operations_trafficError2084.74test_vpc_network_internal_lbrules.py
test_01_list_templates_paginationError376.88test_escalations_templates.py
test_02_download_templateError516.10test_escalations_templates.py
test_stop_start_vpc_routerFailure650.35test_vpc_network.py
test_03_restart_vpcvrFailure956.91test_vpc_network.py
test_01_list_vpncustomergateways_paginationError0.13test_escalations_vpncustomergateways.py
test_02_update_vpncustomergatewaysError5.14test_escalations_vpncustomergateways.py
test_03_network_createError212.84test_project_resources.py
test_operations_non_root_admin_api_client_2_SHAREDFailure1.18test_multiple_ips_per_nic.py
test_disable_static_nat_2_SHAREDFailure0.93test_multiple_ips_per_nic.py
test_network_restart_cleanup_true_2_SHAREDFailure0.87test_multiple_ips_per_nic.py
test_reboot_router_VM_3_VPCError735.03test_multiple_ips_per_nic.py
test_recover_vm_2_SHAREDFailure0.89test_multiple_ips_per_nic.py
test_02_add_nw_stopped_vm_2_sharedError131.11test_add_remove_network.py
test_03_add_nw_multiple_times_2_sharedError30.95test_add_remove_network.py
test_06_add_nw_ipaddress_running_vmError35.88test_add_remove_network.py
test_14_add_nw_different_account_1_isolatedFailure56.39test_add_remove_network.py
test_14_add_nw_different_account_2_sharedFailure202.55test_add_remove_network.py
test_14_add_nw_different_account_2_sharedError212.79test_add_remove_network.py
ContextSuite context=TestAddNetworkToVirtualMachine>:teardownError184.41test_add_remove_network.py
test_01_reset_keypair_normal_userFailure892.78test_reset_ssh_keypair.py
test_02_reset_keypair_domain_adminFailure827.18test_reset_ssh_keypair.py
test_03_reset_keypair_root_adminFailure877.57test_reset_ssh_keypair.py
test_01_reset_ssh_keysFailure874.09test_reset_ssh_keypair.py
test_02_reset_ssh_key_password_enabled_templateFailure781.89test_reset_ssh_keypair.py
test_03_reset_ssh_with_no_keyFailure786.55test_reset_ssh_keypair.py
test_04_reset_key_passwd_enabled_no_keyFailure781.06test_reset_ssh_keypair.py
test_01_host_ha_with_nfs_storagepool_with_vmError63.58test_host.py
test_06_release_ipFailure729.63test_haproxy.py
test_07_restart_network_vm_runningFailure850.07test_vpc.py
test_08_delete_vpcFailure771.46test_vpc.py
test_03_vmsnapshot__on_resized_rootvolume_vmError172.98test_rootvolume_resize.py
test_04_vmreset_after_migrate_vm__rootvolume_resizedError86.77test_rootvolume_resize.py
test_22_disablePod_admin_deployVMError5.24test_organization_states.py
test_42_disableHost_admin_deployVMError10.24test_organization_states.py
test_43_disableHost_admin_deployVMFailure5.21test_organization_states.py
test_44_disableHost_admin_stop_startVMFailure40.50test_organization_states.py
test_46_disableHost_user_stop_startVMFailure131.37test_organization_states.py
test_01_template_usageError666.17test_project_usage.py
test_03_restore_vm_with_new_templateError1632.12test_base_image_updation.py
test_14_deployvm_domaindminError5.37test_acl_isolatednetwork.py
test_15_deployvm_domaindmin_foruserinsamedomainError5.40test_acl_isolatednetwork.py
test_16_deployvm_domaindmin_foruserinsubdomainError5.36test_acl_isolatednetwork.py
test_18_deployvm_userError5.31test_acl_isolatednetwork.py
test_06_create_network_in_vpcError35.90test_escalations_networks.py
test_10_list_networks_in_vpcFailure0.06test_escalations_networks.py
test_11_update_vpcFailure0.06test_escalations_networks.py
test_12_list_create_delete_networkACLFailure0.05test_escalations_networks.py
test_19_create_list_reset_delete_vpnconnectionsError35.71test_escalations_networks.py
test_02_SSVM_Life_Cycle_With_Browser_Template_TPathFailure5.26test_browse_templates.py
test_browser_upload_template_incompleteFailure5.27test_browse_templates.py
test_01_VRServiceFailureAlertingFailure361.62test_VirtualRouter_alerts.py
test_02_deploy_vms_delete_networkError984.02test_vpc_vms_deployment.py
test_04_deploy_vms_delete_add_network_noLbError1008.62test_vpc_vms_deployment.py
test_08_ip_reallocation_CS5986Failure804.70test_vpc_vms_deployment.py
test_02_deploy_vms_in_vpc_nwFailure682.36test_vpc_offerings.py
test_01_VPN_serviceError61.92test_vpn_service.py
test_01_deploy_vm_with_implicit_plannerError5.41test_implicit_planner.py
test_04_deploy_vm_anti_affinity_groupError66.26test_affinity_groups.py
test_05_deploy_vm_by_idError111.66test_affinity_groups.py
test_09_deploy_vm_multiple_aff_grpsError15.93test_affinity_groups.py
test_01_update_aff_grp_by_idsError162.31test_affinity_groups.py
test_02_update_aff_grp_by_namesError111.75test_affinity_groups.py
test_03_update_aff_grp_for_vm_with_no_aff_grpError157.29test_affinity_groups.py
test_04_update_aff_grp_remove_allError0.24test_affinity_groups.py
test_06_update_aff_grp_invalid_argsError136.85test_affinity_groups.py
test_01_network_services_VPC_StopCreatePFError840.02test_vpc_network_pfrules.py
test_03_network_services_VPC_StopCreateMultiplePFError970.19test_vpc_network_pfrules.py
test_04_network_services_VPC_CreateMultiplePFFailure748.85test_vpc_network_pfrules.py
test_05_network_services_VPC_StopDeletePFFailure143.76test_vpc_network_pfrules.py
test_06_network_services_VPC_DeletePFFailure233.69test_vpc_network_pfrules.py
test_07_network_services_VPC_StopDeleteAllPFFailure163.24test_vpc_network_pfrules.py
test_08_network_services_VPC_DeleteAllPFFailure285.52test_vpc_network_pfrules.py
test_09_network_services_VPC_StopDeleteAllMultiplePFFailure306.84test_vpc_network_pfrules.py
test_10_network_services_VPC_DeleteAllMultiplePFFailure222.31test_vpc_network_pfrules.py
test_01_2_egress_fr1Failure190.14test_egress_fw_rules.py
test_09_1_egress_fr9Failure151.91test_egress_fw_rules.py
test_09_egress_fr9Failure243.22test_egress_fw_rules.py
test_nat_rules_1_nat_ruleError758.10test_ip_reservation.py
test_nat_rules_2_static_nat_ruleError821.27test_ip_reservation.py
test_deploy_VM_with_affinity_group_1_ADMIN_ACCOUNTFailure52.01test_dynamic_compute_offering.py
test_deploy_VM_with_affinity_group_2_USER_ACCOUNTFailure102.33test_dynamic_compute_offering.py
test_02_create_template_snapshot_1_root_domain_adminFailure521.32test_ss_limits.py
test_02_create_template_snapshot_2_child_domain_adminFailure588.09test_ss_limits.py
test_02_migrate_vmFailure179.29test_ps_project_limits.py
test_listtemplateFailure425.87test_escalation_listTemplateDomainAdmin.py
test_iptable_rulesError0.05test_multiple_public_interfaces.py
test_port_forwarding_on_ip_from_non_src_nat_ip_rangeError0.04test_multiple_public_interfaces.py
test_routing_tablesError0.04test_multiple_public_interfaces.py
test_static_nat_on_ip_from_non_src_nat_ip_rangeError0.04test_multiple_public_interfaces.py
test_network_services_VPC_CreatePFError148.01test_multiple_public_interfaces.py
test_network_services_VPC_CreatePFError47.21test_multiple_public_interfaces.py
test_05_remove_used_rangeFailure189.50test_non_contiguous_vlan.py
test_acquire_ipError0.97test_shared_networks.py
test_escalation_ES1621Error1.20test_shared_networks.py
test_associate_ip_address_services_enable_disableFailure1449.54test_portable_ip.py
test_list_portable_ip_range_non_root_adminFailure1265.30test_portable_ip.py
test_03_VPC_CreateLBRuleInMultipleNetworksVRStoppedStateError858.55test_vpc_network_lbrules.py
test_06_VPC_CreateAndDeleteLBRuleVRStopppedStateError959.89test_vpc_network_lbrules.py
test_01_start_stop_router_after_addition_of_one_guest_networkError665.38test_vpc_routers.py
test_02_reboot_router_after_addition_of_one_guest_networkError5.22test_vpc_routers.py
test_03_migrate_router_after_addition_of_one_guest_networkFailure240.36test_vpc_routers.py
test_01_stop_start_router_after_creating_vpcError650.84test_vpc_routers.py
test_02_reboot_router_after_creating_vpcError5.27test_vpc_routers.py
test_03_migrate_router_after_creating_vpcFailure240.26test_vpc_routers.py
test_01_VPC_StaticNatRuleCreateStoppedStateError849.70test_vpc_network_staticnatrule.py
test_03_VPC_StopCreateMultipleStaticNatRuleStopppedStateError954.33test_vpc_network_staticnatrule.py
test_05_network_services_VPC_DeleteAllPFFailure152.81test_vpc_network_staticnatrule.py
test_06_network_services_VPC_DeleteAllMultiplePFFailure869.88test_vpc_network_staticnatrule.py
test_02_migrate_volume_to_maintenance_poolError131.35test_migrate_vol_to_maintained_pool.py

@yadvryadvr added this to the 4.11 milestone Dec 28, 2017
@borisstoyanov

borisstoyanov commented Dec 28, 2017

Copy link
Copy Markdown
ContributorAuthor

Many of these are issues that are not fixed yet, others may be regressions, but the failure number is down to 41 from ~100
ping @PaulAngus@DaanHoogland@nvazquez for review and lgtm.

nvazquez
nvazquez reviewed Dec 28, 2017
View reviewed changes
Comment threadtest/integration/component/test_VirtualRouter_alerts.py
cls).getClsTestClient()
cls.api_client = cls.testClient.getApiClient()
cls.services = cls.testClient.getParsedTestDataConfig()
cls.hostConfig = cls.config.__dict__["zones"][0].__dict__["pods"][0].__dict__["clusters"][0].__dict__["hosts"][0].__dict__

@nvazqueznvazquezDec 28, 2017•
edited
Loading

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is cls.config set here or should it be cls.services? Can we add basic check for each dictionary key?

@borisstoyanovborisstoyanovDec 28, 2017

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a configuration, not a test data which we consider as 'services'.

@nvazqueznvazquezDec 28, 2017

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok, sorry, copy that. Please ignore similar comments, thanks

nvazquez
nvazquez reviewed Dec 28, 2017
View reviewed changes
Comment threadtest/integration/component/test_escalations_routers.py
cls).getClsTestClient()
cls.api_client = cls.testClient.getApiClient()
cls.services = cls.testClient.getParsedTestDataConfig()
cls.hostConfig = cls.config.__dict__["zones"][0].__dict__["pods"][0].__dict__["clusters"][0].__dict__["hosts"][0].__dict__

@nvazqueznvazquezDec 28, 2017

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same question here

nvazquez
nvazquez reviewed Dec 28, 2017
View reviewed changes
Comment threadtest/integration/component/test_host_ha.py
self.services = self.testClient.getParsedTestDataConfig()
self.zone = get_zone(self.apiclient, self.testClient.getZoneForTests())
self.pod = get_pod(self.apiclient, self.zone.id)
self.hostConfig = self.config.__dict__["zones"][0].__dict__["pods"][0].__dict__["clusters"][0].__dict__["hosts"][0].__dict__

@nvazqueznvazquezDec 28, 2017

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same here

nvazquez
nvazquez reviewed Dec 28, 2017
View reviewed changes
Comment threadtest/integration/component/test_overcommit.py
cls.testdata["configurableData"]["password"] = "xenroot"
#cls.testdata["configurableData"]["password"] = "xenroot"
cls.hypervisor = testClient.getHypervisorInfo()
cls.hostConfig = cls.config.__dict__["zones"][0].__dict__["pods"][0].__dict__["clusters"][0].__dict__["hosts"][0].__dict__

@nvazqueznvazquezDec 28, 2017

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same here

nvazquez
nvazquez reviewed Dec 28, 2017
View reviewed changes
Comment threadtest/integration/component/test_overcommit.py Outdated
cls.zone = get_zone(cls.apiclient)
cls.testdata["mode"] = cls.zone.networktype
cls.testdata["configurableData"]["password"] = "xenroot"
#cls.testdata["configurableData"]["password"] = "xenroot"

@nvazqueznvazquezDec 28, 2017

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we remove this commented line?

nvazquez
nvazquez reviewed Dec 28, 2017
View reviewed changes
Comment threadtest/integration/component/test_volumes.py Outdated
cls.services["zoneid"] = cls.zone.id
cls.services["virtual_machine"]["zoneid"] = cls.zone.id
cls.services["virtual_machine"]["template"] = template.id
#cls.testdata["zoneid"] = cls.zone.id

@nvazqueznvazquezDec 28, 2017

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Multiple commented lines

nvazquez
nvazquez approved these changes Dec 28, 2017
View reviewed changes

@nvazqueznvazquez left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks for the hard work @borisstoyanov. I just left some minor comments/questions

@borisstoyanov

borisstoyanov commented Dec 28, 2017•
edited
Loading

Copy link
Copy Markdown
ContributorAuthor

Thanks @nvazquez I've addressed your comments, @rhtyd I think we're in a good position to merge now, lets address the new failures in separate PRs.

@yadvr

yadvr commented Jan 1, 2018•
edited
Loading

Copy link
Copy Markdown
Member

Thanks @borisstoyanov I'll merge this, as we'll deal with fixing rest of the failures in other PRs.

Will merge this based on improved component test results and 2lgtms code reviews, and as soon as Travis is green.

@yadvr
yadvr merged commit 67f509d into apache:masterJan 1, 2018
@sureshanapartisureshanaparti mentioned this pull request Dec 22, 2023
Merged
13 tasks
winterhazel pushed a commit that referenced this pull request Jan 28, 2026
Fabrício Duarte
Merge branch 'change-config-scope-for-svm-default-offerings' into '4.…
f1a5023
…20.0.0-scclouds'
Alteração no escopo de configurações de oferta padrão para _system_ VMs
Closes#2344
See merge request scclouds/scclouds!1211
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@nvazqueznvazqueznvazquez approved these changes
@yadvryadvryadvr approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

4.11.0.0

Development

Successfully merging this pull request may close these issues.

4 participants

@borisstoyanov@blueorangutan@yadvr@nvazquez