Skip to content

Fwd merge 4.8->4.9 marvintestfixes to master - #1708

Closed
yadvr wants to merge 18 commits into
apache:masterfrom
shapeblue:master-marvinfixes
Closed

Fwd merge 4.8->4.9 marvintestfixes to master#1708
yadvr wants to merge 18 commits into
apache:masterfrom
shapeblue:master-marvinfixes

Conversation

@yadvr

@yadvryadvr commented Oct 13, 2016

Copy link
Copy Markdown
Member

murali-reddyand others added 18 commits October 5, 2016 15:11
…l networks
modified script to handle case where there can be multple physical networks
in the zone
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
…rom the
Use config file, instead of hardcoded crendentials
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
- Fix macchnina template url
- Fix a variable scope issue
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
The quota integration test requires special setup and is moved to plugins
directory as in 4.9 and master branch.
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
…json,
resulting in internal LB vm not come up
parsing cmd_line to create 'ips' data bag, never handled internal lb vm, but still
worked due to another bug. support for internal lb vm is added with this fix
…ded username and password
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
- Handle case where physical network instance does not have vlan attribute
- Handle case where listIso response may not have status attribute
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
SSH to VR for vmware, goes via the mgmt server and uses ssh keys at
/var/cloudstack path. Add suitable checks to tests failing on vmware.
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
- test_01_test_vm_volume_snapshot not supported for Xen, tests keep failing
- Skip snapshot tests for centos6/kvm as snapshot is not supported by older
qemu-img versions
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
As per previous discussions and ticket, a template deletion may result in failure
(exception thrown) for templates that are not properly downloaded. The tearDown
method, a template may be tried for deletion but on failure we may ignore it
as account deletion/tearDown would retry to cleanup resource owned by the account.
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
… again
- test_01_test_vm_volume_snapshot not supported for Xen, tests keep failing
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
- Switches to macchinina as template for VM in the tests
- Modifies the ostype of the macchinina template to 'Other Linux (64-bit)'
- Check template download status, fixes Nonetype iterable issue
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
…arsing the
cmd_line.json to create ips.json databag
using 'gateway' in cmd_line for the public ip gateway while creating ips.json databag
- Cleans up volumes, snapshots and VM after running test_snapshots
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
@yadvryadvr changed the title Fwd merge 4.9+marvintestfixes on masterFwd merge 4.8->4.9 marvintestfixes to masterOct 13, 2016
@blueorangutan

Copy link
Copy Markdown

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan

Copy link
Copy Markdown

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-61

@blueorangutan

Copy link
Copy Markdown

Trillian test result (tid-146)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 23920 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1708-t146-kvm-centos7.zip
Test completed. 48 look ok, 0 have error(s)

TestResultTime (s)Test File
test_oobm_zchange_passwordFailure20.48test_outofbandmanagement.py
test_01_vpc_site2site_vpnSuccess140.06test_vpc_vpn.py
test_01_vpc_remote_access_vpnSuccess56.08test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpnSuccess220.33test_vpc_vpn.py
test_02_VPC_default_routesSuccess275.97test_vpc_router_nics.py
test_01_VPC_nics_after_destroySuccess479.35test_vpc_router_nics.py
test_05_rvpc_multi_tiersSuccess507.03test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nicsSuccess1399.30test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routersSuccess550.31test_vpc_redundant.py
test_02_redundant_VPC_default_routesSuccess756.51test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACLSuccess1256.82test_vpc_redundant.py
test_09_delete_detached_volumeSuccess15.48test_volumes.py
test_08_resize_volumeSuccess15.39test_volumes.py
test_07_resize_failSuccess20.46test_volumes.py
test_06_download_detached_volumeSuccess15.29test_volumes.py
test_05_detach_volumeSuccess100.20test_volumes.py
test_04_delete_attached_volumeSuccess10.22test_volumes.py
test_03_download_attached_volumeSuccess15.31test_volumes.py
test_02_attach_volumeSuccess43.70test_volumes.py
test_01_create_volumeSuccess621.36test_volumes.py
test_deploy_vm_multipleSuccess253.54test_vm_life_cycle.py
test_deploy_vmSuccess0.03test_vm_life_cycle.py
test_advZoneVirtualRouterSuccess0.02test_vm_life_cycle.py
test_10_attachAndDetach_isoSuccess26.89test_vm_life_cycle.py
test_09_expunge_vmSuccess125.27test_vm_life_cycle.py
test_08_migrate_vmSuccess45.99test_vm_life_cycle.py
test_07_restore_vmSuccess0.14test_vm_life_cycle.py
test_06_destroy_vmSuccess125.87test_vm_life_cycle.py
test_03_reboot_vmSuccess125.89test_vm_life_cycle.py
test_02_start_vmSuccess10.18test_vm_life_cycle.py
test_01_stop_vmSuccess35.31test_vm_life_cycle.py
test_CreateTemplateWithDuplicateNameSuccess45.51test_templates.py
test_08_list_system_templatesSuccess0.03test_templates.py
test_07_list_public_templatesSuccess0.04test_templates.py
test_05_template_permissionsSuccess0.08test_templates.py
test_04_extract_templateSuccess5.22test_templates.py
test_03_delete_templateSuccess5.12test_templates.py
test_02_edit_templateSuccess90.20test_templates.py
test_01_create_templateSuccess50.48test_templates.py
test_10_destroy_cpvmSuccess131.66test_ssvm.py
test_09_destroy_ssvmSuccess163.28test_ssvm.py
test_08_reboot_cpvmSuccess101.43test_ssvm.py
test_07_reboot_ssvmSuccess133.21test_ssvm.py
test_06_stop_cpvmSuccess131.56test_ssvm.py
test_05_stop_ssvmSuccess133.34test_ssvm.py
test_04_cpvm_internalsSuccess1.04test_ssvm.py
test_03_ssvm_internalsSuccess2.95test_ssvm.py
test_02_list_cpvm_vmSuccess0.15test_ssvm.py
test_01_list_sec_storage_vmSuccess0.13test_ssvm.py
test_01_snapshot_root_diskSuccess11.24test_snapshots.py
test_04_change_offering_smallSuccess239.66test_service_offerings.py
test_03_delete_service_offeringSuccess0.04test_service_offerings.py
test_02_edit_service_offeringSuccess0.05test_service_offerings.py
test_01_create_service_offeringSuccess0.23test_service_offerings.py
test_02_sys_template_readySuccess0.15test_secondary_storage.py
test_01_sys_vm_startSuccess0.18test_secondary_storage.py
test_09_reboot_routerSuccess35.31test_routers.py
test_08_start_routerSuccess25.25test_routers.py
test_07_stop_routerSuccess10.18test_routers.py
test_06_router_advancedSuccess0.06test_routers.py
test_05_router_basicSuccess0.04test_routers.py
test_04_restart_network_wo_cleanupSuccess5.61test_routers.py
test_03_restart_network_cleanupSuccess50.46test_routers.py
test_02_router_internal_advSuccess0.98test_routers.py
test_01_router_internal_basicSuccess0.58test_routers.py
test_router_dns_guestipquerySuccess76.73test_router_dns.py
test_router_dns_externalipquerySuccess0.09test_router_dns.py
test_router_dhcphostsSuccess271.89test_router_dhcphosts.py
test_01_updatevolumedetailSuccess5.15test_resource_detail.py
test_01_reset_vm_on_rebootSuccess130.93test_reset_vm_on_reboot.py
test_createRegionSuccess0.04test_regions.py
test_create_pvlan_networkSuccess5.21test_pvlan.py
test_dedicatePublicIpRangeSuccess0.43test_public_ip_range.py
test_04_rvpc_privategw_static_routesSuccess456.59test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanupSuccess476.11test_privategw_acl.py
test_02_vpc_privategw_static_routesSuccess346.88test_privategw_acl.py
test_01_vpc_privategw_aclSuccess78.02test_privategw_acl.py
test_01_primary_storage_nfsSuccess35.75test_primary_storage.py
test_createPortablePublicIPRangeSuccess15.19test_portable_publicip.py
test_createPortablePublicIPAcquireSuccess15.42test_portable_publicip.py
test_isolate_network_password_serverSuccess86.31test_password_server.py
test_UpdateStorageOverProvisioningFactorSuccess0.15test_over_provisioning.py
test_oobm_multiple_mgmt_server_ownershipSuccess12.56test_outofbandmanagement.py
test_oobm_issue_power_statusSuccess10.56test_outofbandmanagement.py
test_oobm_issue_power_softSuccess15.59test_outofbandmanagement.py
test_oobm_issue_power_resetSuccess15.59test_outofbandmanagement.py
test_oobm_issue_power_onSuccess15.62test_outofbandmanagement.py
test_oobm_issue_power_offSuccess15.60test_outofbandmanagement.py
test_oobm_issue_power_cycleSuccess15.66test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzonesSuccess58.34test_outofbandmanagement.py
test_oobm_enable_feature_validSuccess5.19test_outofbandmanagement.py
test_oobm_enable_feature_invalidSuccess0.11test_outofbandmanagement.py
test_oobm_disable_feature_validSuccess0.19test_outofbandmanagement.py
test_oobm_disable_feature_invalidSuccess0.14test_outofbandmanagement.py
test_oobm_configure_invalid_driverSuccess0.11test_outofbandmanagement.py
test_oobm_configure_default_driverSuccess0.10test_outofbandmanagement.py
test_oobm_background_powerstate_syncSuccess20.06test_outofbandmanagement.py
test_extendPhysicalNetworkVlanSuccess15.31test_non_contigiousvlan.py
test_01_nicSuccess606.26test_nic.py
test_releaseIPSuccess253.77test_network.py
test_reboot_routerSuccess384.25test_network.py
test_public_ip_user_accountSuccess10.24test_network.py
test_public_ip_admin_accountSuccess40.27test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_RuleSuccess66.82test_network.py
test_network_rules_acquired_public_ip_2_nat_ruleSuccess61.70test_network.py
test_network_rules_acquired_public_ip_1_static_nat_ruleSuccess121.14test_network.py
test_delete_accountSuccess258.55test_network.py
test_02_port_fwd_on_non_src_natSuccess55.66test_network.py
test_01_port_fwd_on_src_natSuccess109.22test_network.py
test_nic_secondaryip_add_removeSuccess203.71test_multipleips_per_nic.py
login_test_saml_userSuccess24.59test_login.py
test_assign_and_removal_lbSuccess133.59test_loadbalance.py
test_02_create_lb_rule_non_natSuccess187.37test_loadbalance.py
test_01_create_lb_rule_src_natSuccess207.88test_loadbalance.py
test_03_list_snapshotsSuccess0.06test_list_ids_parameter.py
test_02_list_templatesSuccess0.04test_list_ids_parameter.py
test_01_list_volumesSuccess0.03test_list_ids_parameter.py
test_07_list_default_isoSuccess0.06test_iso.py
test_05_iso_permissionsSuccess0.06test_iso.py
test_04_extract_IsoSuccess5.17test_iso.py
test_03_delete_isoSuccess95.18test_iso.py
test_02_edit_isoSuccess0.06test_iso.py
test_01_create_isoSuccess21.88test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfacesSuccess224.13test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfacesSuccess168.00test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80Success499.79test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80Success439.85test_internal_lb.py
test_dedicateGuestVlanRangeSuccess10.32test_guest_vlan_range.py
test_UpdateConfigParamWithScopeSuccess0.14test_global_settings.py
test_rolepermission_lifecycle_updateSuccess7.07test_dynamicroles.py
test_rolepermission_lifecycle_listSuccess6.88test_dynamicroles.py
test_rolepermission_lifecycle_deleteSuccess6.75test_dynamicroles.py
test_rolepermission_lifecycle_createSuccess6.79test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updatesSuccess6.91test_dynamicroles.py
test_role_lifecycle_update_role_inuseSuccess6.79test_dynamicroles.py
test_role_lifecycle_updateSuccess12.01test_dynamicroles.py
test_role_lifecycle_listSuccess6.81test_dynamicroles.py
test_role_lifecycle_deleteSuccess6.83test_dynamicroles.py
test_role_lifecycle_createSuccess6.83test_dynamicroles.py
test_role_inuse_deletionSuccess6.75test_dynamicroles.py
test_role_account_acls_multiple_mgmt_serversSuccess9.03test_dynamicroles.py
test_role_account_aclsSuccess9.20test_dynamicroles.py
test_default_role_deletionSuccess6.88test_dynamicroles.py
test_04_create_fat_type_disk_offeringSuccess0.07test_disk_offerings.py
test_03_delete_disk_offeringSuccess0.04test_disk_offerings.py
test_02_edit_disk_offeringSuccess0.05test_disk_offerings.py
test_02_create_sparse_type_disk_offeringSuccess0.07test_disk_offerings.py
test_01_create_disk_offeringSuccess0.11test_disk_offerings.py
test_deployvm_userdispersingSuccess20.58test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentratedSuccess20.59test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfitSuccess75.80test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_postSuccess10.47test_deploy_vm_with_userdata.py
test_deployvm_userdataSuccess55.84test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resizeSuccess7.03test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resizeSuccess6.87test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resizeSuccess208.40test_deploy_vm_root_resize.py
test_deploy_vm_from_isoSuccess203.49test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroupSuccess55.90test_affinity_groups.py
test_03_delete_vm_snapshotsSkipped0.00test_vm_snapshots.py
test_02_revert_vm_snapshotsSkipped0.00test_vm_snapshots.py
test_01_test_vm_volume_snapshotSkipped0.00test_vm_snapshots.py
test_01_create_vm_snapshotsSkipped0.00test_vm_snapshots.py
test_06_copy_templateSkipped0.00test_templates.py
test_static_role_account_aclsSkipped0.02test_staticroles.py
test_01_scale_vmSkipped0.00test_scale_vm.py
test_01_primary_storage_iscsiSkipped0.04test_primary_storage.py
test_06_copy_isoSkipped0.00test_iso.py
test_deploy_vgpu_enabled_vmSkipped0.04test_deploy_vgpu_enabled_vm.py
test_3d_gpu_supportSkipped0.04test_deploy_vgpu_enabled_vm.py

@blueorangutan

Copy link
Copy Markdown

Trillian test result (tid-147)
Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 7
Total time taken: 31543 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1708-t147-xenserver-65sp1.zip
Test completed. 44 look ok, 4 have error(s)

TestResultTime (s)Test File
test_05_rvpc_multi_tiersFailure555.28test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nicsFailure1366.73test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACLFailure582.66test_vpc_redundant.py
test_04_rvpc_privategw_static_routesFailure748.57test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanupFailure446.90test_privategw_acl.py
test_oobm_zchange_passwordFailure20.47test_outofbandmanagement.py
test_04_extract_templateError5.09test_templates.py
test_03_delete_templateError5.08test_templates.py
test_01_create_templateError50.43test_templates.py
ContextSuite context=TestSnapshotRootDisk>:teardownError62.09test_snapshots.py
test_01_vpc_site2site_vpnSuccess305.64test_vpc_vpn.py
test_01_vpc_remote_access_vpnSuccess151.48test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpnSuccess536.87test_vpc_vpn.py
test_02_VPC_default_routesSuccess345.18test_vpc_router_nics.py
test_01_VPC_nics_after_destroySuccess671.93test_vpc_router_nics.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routersSuccess818.80test_vpc_redundant.py
test_02_redundant_VPC_default_routesSuccess1077.14test_vpc_redundant.py
test_09_delete_detached_volumeSuccess20.68test_volumes.py
test_08_resize_volumeSuccess105.85test_volumes.py
test_07_resize_failSuccess120.99test_volumes.py
test_06_download_detached_volumeSuccess25.40test_volumes.py
test_05_detach_volumeSuccess100.27test_volumes.py
test_04_delete_attached_volumeSuccess10.19test_volumes.py
test_03_download_attached_volumeSuccess15.24test_volumes.py
test_02_attach_volumeSuccess10.69test_volumes.py
test_01_create_volumeSuccess392.51test_volumes.py
test_03_delete_vm_snapshotsSuccess280.20test_vm_snapshots.py
test_02_revert_vm_snapshotsSuccess211.33test_vm_snapshots.py
test_01_create_vm_snapshotsSuccess100.83test_vm_snapshots.py
test_deploy_vm_multipleSuccess198.07test_vm_life_cycle.py
test_deploy_vmSuccess0.03test_vm_life_cycle.py
test_advZoneVirtualRouterSuccess0.02test_vm_life_cycle.py
test_10_attachAndDetach_isoSuccess26.64test_vm_life_cycle.py
test_09_expunge_vmSuccess125.23test_vm_life_cycle.py
test_08_migrate_vmSuccess86.19test_vm_life_cycle.py
test_07_restore_vmSuccess0.09test_vm_life_cycle.py
test_06_destroy_vmSuccess10.15test_vm_life_cycle.py
test_03_reboot_vmSuccess10.19test_vm_life_cycle.py
test_02_start_vmSuccess20.21test_vm_life_cycle.py
test_01_stop_vmSuccess30.24test_vm_life_cycle.py
test_CreateTemplateWithDuplicateNameSuccess100.75test_templates.py
test_08_list_system_templatesSuccess0.03test_templates.py
test_07_list_public_templatesSuccess0.04test_templates.py
test_05_template_permissionsSuccess0.05test_templates.py
test_02_edit_templateSuccess90.12test_templates.py
test_10_destroy_cpvmSuccess196.55test_ssvm.py
test_09_destroy_ssvmSuccess229.18test_ssvm.py
test_08_reboot_cpvmSuccess111.42test_ssvm.py
test_07_reboot_ssvmSuccess354.14test_ssvm.py
test_06_stop_cpvmSuccess166.59test_ssvm.py
test_05_stop_ssvmSuccess254.22test_ssvm.py
test_04_cpvm_internalsSuccess1.02test_ssvm.py
test_03_ssvm_internalsSuccess3.55test_ssvm.py
test_02_list_cpvm_vmSuccess0.11test_ssvm.py
test_01_list_sec_storage_vmSuccess0.12test_ssvm.py
test_01_snapshot_root_diskSuccess26.73test_snapshots.py
test_04_change_offering_smallSuccess118.98test_service_offerings.py
test_03_delete_service_offeringSuccess0.04test_service_offerings.py
test_02_edit_service_offeringSuccess0.05test_service_offerings.py
test_01_create_service_offeringSuccess0.07test_service_offerings.py
test_02_sys_template_readySuccess0.12test_secondary_storage.py
test_01_sys_vm_startSuccess0.16test_secondary_storage.py
test_01_scale_vmSuccess5.21test_scale_vm.py
test_09_reboot_routerSuccess80.69test_routers.py
test_08_start_routerSuccess55.39test_routers.py
test_07_stop_routerSuccess20.19test_routers.py
test_06_router_advancedSuccess0.05test_routers.py
test_05_router_basicSuccess0.04test_routers.py
test_04_restart_network_wo_cleanupSuccess5.55test_routers.py
test_03_restart_network_cleanupSuccess130.87test_routers.py
test_02_router_internal_advSuccess0.79test_routers.py
test_01_router_internal_basicSuccess0.42test_routers.py
test_router_dns_guestipquerySuccess48.78test_router_dns.py
test_router_dns_externalipquerySuccess0.08test_router_dns.py
test_router_dhcphostsSuccess107.43test_router_dhcphosts.py
test_01_updatevolumedetailSuccess5.13test_resource_detail.py
test_01_reset_vm_on_rebootSuccess45.43test_reset_vm_on_reboot.py
test_createRegionSuccess0.04test_regions.py
test_create_pvlan_networkSuccess5.20test_pvlan.py
test_dedicatePublicIpRangeSuccess0.41test_public_ip_range.py
test_02_vpc_privategw_static_routesSuccess607.44test_privategw_acl.py
test_01_vpc_privategw_aclSuccess163.48test_privategw_acl.py
test_01_primary_storage_nfsSuccess38.85test_primary_storage.py
test_01_primary_storage_iscsiSuccess77.96test_primary_storage.py
test_createPortablePublicIPRangeSuccess15.17test_portable_publicip.py
test_createPortablePublicIPAcquireSuccess15.38test_portable_publicip.py
test_isolate_network_password_serverSuccess36.21test_password_server.py
test_UpdateStorageOverProvisioningFactorSuccess0.17test_over_provisioning.py
test_oobm_multiple_mgmt_server_ownershipSuccess14.57test_outofbandmanagement.py
test_oobm_issue_power_statusSuccess10.56test_outofbandmanagement.py
test_oobm_issue_power_softSuccess15.59test_outofbandmanagement.py
test_oobm_issue_power_resetSuccess15.58test_outofbandmanagement.py
test_oobm_issue_power_onSuccess15.59test_outofbandmanagement.py
test_oobm_issue_power_offSuccess15.63test_outofbandmanagement.py
test_oobm_issue_power_cycleSuccess15.68test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzonesSuccess53.52test_outofbandmanagement.py
test_oobm_enable_feature_validSuccess5.19test_outofbandmanagement.py
test_oobm_enable_feature_invalidSuccess0.10test_outofbandmanagement.py
test_oobm_disable_feature_validSuccess5.21test_outofbandmanagement.py
test_oobm_disable_feature_invalidSuccess0.11test_outofbandmanagement.py
test_oobm_configure_invalid_driverSuccess0.14test_outofbandmanagement.py
test_oobm_configure_default_driverSuccess0.09test_outofbandmanagement.py
test_oobm_background_powerstate_syncSuccess18.16test_outofbandmanagement.py
test_extendPhysicalNetworkVlanSuccess15.29test_non_contigiousvlan.py
test_01_nicSuccess762.80test_nic.py
test_releaseIPSuccess278.91test_network.py
test_reboot_routerSuccess560.34test_network.py
test_public_ip_user_accountSuccess10.24test_network.py
test_public_ip_admin_accountSuccess40.27test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_RuleSuccess86.58test_network.py
test_network_rules_acquired_public_ip_2_nat_ruleSuccess76.88test_network.py
test_network_rules_acquired_public_ip_1_static_nat_ruleSuccess103.02test_network.py
test_delete_accountSuccess308.67test_network.py
test_02_port_fwd_on_non_src_natSuccess70.71test_network.py
test_01_port_fwd_on_src_natSuccess83.76test_network.py
test_nic_secondaryip_add_removeSuccess223.59test_multipleips_per_nic.py
login_test_saml_userSuccess24.73test_login.py
test_assign_and_removal_lbSuccess148.92test_loadbalance.py
test_02_create_lb_rule_non_natSuccess207.53test_loadbalance.py
test_01_create_lb_rule_src_natSuccess208.01test_loadbalance.py
test_03_list_snapshotsSuccess0.05test_list_ids_parameter.py
test_02_list_templatesSuccess0.04test_list_ids_parameter.py
test_01_list_volumesSuccess0.03test_list_ids_parameter.py
test_07_list_default_isoSuccess0.06test_iso.py
test_05_iso_permissionsSuccess0.12test_iso.py
test_04_extract_IsoSuccess5.10test_iso.py
test_03_delete_isoSuccess95.19test_iso.py
test_02_edit_isoSuccess0.05test_iso.py
test_01_create_isoSuccess21.86test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfacesSuccess494.73test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfacesSuccess354.21test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80Success1010.83test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80Success686.62test_internal_lb.py
test_dedicateGuestVlanRangeSuccess10.26test_guest_vlan_range.py
test_UpdateConfigParamWithScopeSuccess0.13test_global_settings.py
test_rolepermission_lifecycle_updateSuccess7.09test_dynamicroles.py
test_rolepermission_lifecycle_listSuccess6.94test_dynamicroles.py
test_rolepermission_lifecycle_deleteSuccess6.78test_dynamicroles.py
test_rolepermission_lifecycle_createSuccess6.80test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updatesSuccess7.03test_dynamicroles.py
test_role_lifecycle_update_role_inuseSuccess6.76test_dynamicroles.py
test_role_lifecycle_updateSuccess11.86test_dynamicroles.py
test_role_lifecycle_listSuccess6.79test_dynamicroles.py
test_role_lifecycle_deleteSuccess12.04test_dynamicroles.py
test_role_lifecycle_createSuccess6.78test_dynamicroles.py
test_role_inuse_deletionSuccess6.75test_dynamicroles.py
test_role_account_acls_multiple_mgmt_serversSuccess9.08test_dynamicroles.py
test_role_account_aclsSuccess9.06test_dynamicroles.py
test_default_role_deletionSuccess6.88test_dynamicroles.py
test_04_create_fat_type_disk_offeringSuccess0.06test_disk_offerings.py
test_03_delete_disk_offeringSuccess0.04test_disk_offerings.py
test_02_edit_disk_offeringSuccess0.05test_disk_offerings.py
test_02_create_sparse_type_disk_offeringSuccess0.06test_disk_offerings.py
test_01_create_disk_offeringSuccess0.07test_disk_offerings.py
test_deployvm_userdispersingSuccess40.65test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentratedSuccess91.05test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfitSuccess161.20test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_postSuccess20.44test_deploy_vm_with_userdata.py
test_deployvm_userdataSuccess131.10test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resizeSuccess6.71test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resizeSuccess6.78test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resizeSuccess6.91test_deploy_vm_root_resize.py
test_deploy_vm_from_isoSuccess223.38test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroupSuccess136.34test_affinity_groups.py
test_01_test_vm_volume_snapshotSkipped0.00test_vm_snapshots.py
test_06_copy_templateSkipped0.00test_templates.py
test_static_role_account_aclsSkipped0.02test_staticroles.py
test_06_copy_isoSkipped0.00test_iso.py
test_deploy_vgpu_enabled_vmSkipped0.03test_deploy_vgpu_enabled_vm.py
test_3d_gpu_supportSkipped0.03test_deploy_vgpu_enabled_vm.py

@yadvr

Copy link
Copy Markdown
MemberAuthor

Note: the test_oobm_zchange_password is failing consistently on master, though the same passes with Travis. It could be environment related, or a regression introduced from any recent change. I'll try to verify this today.

@blueorangutan

Copy link
Copy Markdown

Trillian test result (tid-148)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 34940 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1708-t148-vmware-55u3.zip
Test completed. 47 look ok, 1 have error(s)

TestResultTime (s)Test File
test_oobm_zchange_passwordFailure20.35test_outofbandmanagement.py
test_01_vpc_site2site_vpnError496.07test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpnError721.98test_vpc_vpn.py
test_01_vpc_remote_access_vpnSuccess161.27test_vpc_vpn.py
test_02_VPC_default_routesSuccess353.71test_vpc_router_nics.py
test_01_VPC_nics_after_destroySuccess745.22test_vpc_router_nics.py
test_05_rvpc_multi_tiersSuccess652.93test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nicsSuccess1533.00test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routersSuccess682.24test_vpc_redundant.py
test_02_redundant_VPC_default_routesSuccess737.33test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACLSuccess1378.16test_vpc_redundant.py
test_09_delete_detached_volumeSuccess25.61test_volumes.py
test_06_download_detached_volumeSuccess65.45test_volumes.py
test_05_detach_volumeSuccess110.28test_volumes.py
test_04_delete_attached_volumeSuccess10.15test_volumes.py
test_03_download_attached_volumeSuccess25.26test_volumes.py
test_02_attach_volumeSuccess64.00test_volumes.py
test_01_create_volumeSuccess526.56test_volumes.py
test_03_delete_vm_snapshotsSuccess275.20test_vm_snapshots.py
test_02_revert_vm_snapshotsSuccess227.12test_vm_snapshots.py
test_01_test_vm_volume_snapshotSuccess221.27test_vm_snapshots.py
test_01_create_vm_snapshotsSuccess161.68test_vm_snapshots.py
test_deploy_vm_multipleSuccess282.74test_vm_life_cycle.py
test_deploy_vmSuccess0.02test_vm_life_cycle.py
test_advZoneVirtualRouterSuccess0.02test_vm_life_cycle.py
test_10_attachAndDetach_isoSuccess26.73test_vm_life_cycle.py
test_09_expunge_vmSuccess185.17test_vm_life_cycle.py
test_08_migrate_vmSuccess75.83test_vm_life_cycle.py
test_07_restore_vmSuccess0.07test_vm_life_cycle.py
test_06_destroy_vmSuccess10.12test_vm_life_cycle.py
test_03_reboot_vmSuccess5.13test_vm_life_cycle.py
test_02_start_vmSuccess15.14test_vm_life_cycle.py
test_01_stop_vmSuccess10.63test_vm_life_cycle.py
test_CreateTemplateWithDuplicateNameSuccess236.62test_templates.py
test_08_list_system_templatesSuccess0.02test_templates.py
test_07_list_public_templatesSuccess0.03test_templates.py
test_05_template_permissionsSuccess0.04test_templates.py
test_04_extract_templateSuccess10.14test_templates.py
test_03_delete_templateSuccess5.08test_templates.py
test_02_edit_templateSuccess90.07test_templates.py
test_01_create_templateSuccess115.73test_templates.py
test_10_destroy_cpvmSuccess266.73test_ssvm.py
test_09_destroy_ssvmSuccess258.54test_ssvm.py
test_08_reboot_cpvmSuccess156.41test_ssvm.py
test_07_reboot_ssvmSuccess158.35test_ssvm.py
test_06_stop_cpvmSuccess176.61test_ssvm.py
test_05_stop_ssvmSuccess208.64test_ssvm.py
test_04_cpvm_internalsSuccess1.09test_ssvm.py
test_03_ssvm_internalsSuccess4.60test_ssvm.py
test_02_list_cpvm_vmSuccess0.09test_ssvm.py
test_01_list_sec_storage_vmSuccess0.10test_ssvm.py
test_01_snapshot_root_diskSuccess26.03test_snapshots.py
test_04_change_offering_smallSuccess98.40test_service_offerings.py
test_03_delete_service_offeringSuccess0.03test_service_offerings.py
test_02_edit_service_offeringSuccess0.06test_service_offerings.py
test_01_create_service_offeringSuccess0.08test_service_offerings.py
test_02_sys_template_readySuccess0.09test_secondary_storage.py
test_01_sys_vm_startSuccess0.13test_secondary_storage.py
test_09_reboot_routerSuccess135.68test_routers.py
test_08_start_routerSuccess155.81test_routers.py
test_07_stop_routerSuccess20.17test_routers.py
test_06_router_advancedSuccess0.04test_routers.py
test_05_router_basicSuccess0.03test_routers.py
test_04_restart_network_wo_cleanupSuccess5.58test_routers.py
test_03_restart_network_cleanupSuccess145.83test_routers.py
test_02_router_internal_advSuccess0.94test_routers.py
test_01_router_internal_basicSuccess0.49test_routers.py
test_router_dns_guestipquerySuccess76.69test_router_dns.py
test_router_dns_externalipquerySuccess0.07test_router_dns.py
test_router_dhcphostsSuccess185.55test_router_dhcphosts.py
test_01_updatevolumedetailSuccess0.06test_resource_detail.py
test_01_reset_vm_on_rebootSuccess60.46test_reset_vm_on_reboot.py
test_createRegionSuccess0.03test_regions.py
test_create_pvlan_networkSuccess5.17test_pvlan.py
test_dedicatePublicIpRangeSuccess0.30test_public_ip_range.py
test_04_rvpc_privategw_static_routesSuccess1123.34test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanupSuccess1006.23test_privategw_acl.py
test_02_vpc_privategw_static_routesSuccess665.89test_privategw_acl.py
test_01_vpc_privategw_aclSuccess177.66test_privategw_acl.py
test_01_primary_storage_nfsSuccess38.42test_primary_storage.py
test_createPortablePublicIPRangeSuccess15.26test_portable_publicip.py
test_createPortablePublicIPAcquireSuccess15.32test_portable_publicip.py
test_isolate_network_password_serverSuccess94.55test_password_server.py
test_UpdateStorageOverProvisioningFactorSuccess0.11test_over_provisioning.py
test_oobm_multiple_mgmt_server_ownershipSuccess14.55test_outofbandmanagement.py
test_oobm_issue_power_statusSuccess10.54test_outofbandmanagement.py
test_oobm_issue_power_softSuccess15.57test_outofbandmanagement.py
test_oobm_issue_power_resetSuccess15.57test_outofbandmanagement.py
test_oobm_issue_power_onSuccess10.58test_outofbandmanagement.py
test_oobm_issue_power_offSuccess15.60test_outofbandmanagement.py
test_oobm_issue_power_cycleSuccess15.61test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzonesSuccess58.11test_outofbandmanagement.py
test_oobm_enable_feature_validSuccess5.13test_outofbandmanagement.py
test_oobm_enable_feature_invalidSuccess0.08test_outofbandmanagement.py
test_oobm_disable_feature_validSuccess5.14test_outofbandmanagement.py
test_oobm_disable_feature_invalidSuccess0.11test_outofbandmanagement.py
test_oobm_configure_invalid_driverSuccess0.07test_outofbandmanagement.py
test_oobm_configure_default_driverSuccess0.08test_outofbandmanagement.py
test_oobm_background_powerstate_syncSuccess19.54test_outofbandmanagement.py
test_extendPhysicalNetworkVlanSuccess15.26test_non_contigiousvlan.py
test_01_nicSuccess675.28test_nic.py
test_releaseIPSuccess313.09test_network.py
test_reboot_routerSuccess649.42test_network.py
test_public_ip_user_accountSuccess10.18test_network.py
test_public_ip_admin_accountSuccess40.22test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_RuleSuccess76.74test_network.py
test_network_rules_acquired_public_ip_2_nat_ruleSuccess61.37test_network.py
test_network_rules_acquired_public_ip_1_static_nat_ruleSuccess124.88test_network.py
test_delete_accountSuccess307.80test_network.py
test_02_port_fwd_on_non_src_natSuccess55.48test_network.py
test_01_port_fwd_on_src_natSuccess111.65test_network.py
test_nic_secondaryip_add_removeSuccess272.89test_multipleips_per_nic.py
login_test_saml_userSuccess21.39test_login.py
test_assign_and_removal_lbSuccess149.16test_loadbalance.py
test_02_create_lb_rule_non_natSuccess207.33test_loadbalance.py
test_01_create_lb_rule_src_natSuccess209.96test_loadbalance.py
test_03_list_snapshotsSuccess0.05test_list_ids_parameter.py
test_02_list_templatesSuccess0.03test_list_ids_parameter.py
test_01_list_volumesSuccess0.02test_list_ids_parameter.py
test_07_list_default_isoSuccess0.04test_iso.py
test_05_iso_permissionsSuccess0.04test_iso.py
test_04_extract_IsoSuccess5.24test_iso.py
test_03_delete_isoSuccess95.17test_iso.py
test_02_edit_isoSuccess0.06test_iso.py
test_01_create_isoSuccess21.30test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfacesSuccess659.58test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfacesSuccess449.20test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80Success1017.42test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80Success810.89test_internal_lb.py
test_dedicateGuestVlanRangeSuccess10.20test_guest_vlan_range.py
test_UpdateConfigParamWithScopeSuccess0.11test_global_settings.py
test_rolepermission_lifecycle_updateSuccess6.37test_dynamicroles.py
test_rolepermission_lifecycle_listSuccess6.25test_dynamicroles.py
test_rolepermission_lifecycle_deleteSuccess6.17test_dynamicroles.py
test_rolepermission_lifecycle_createSuccess6.18test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updatesSuccess6.31test_dynamicroles.py
test_role_lifecycle_update_role_inuseSuccess6.20test_dynamicroles.py
test_role_lifecycle_updateSuccess11.26test_dynamicroles.py
test_role_lifecycle_listSuccess6.21test_dynamicroles.py
test_role_lifecycle_deleteSuccess6.22test_dynamicroles.py
test_role_lifecycle_createSuccess6.25test_dynamicroles.py
test_role_inuse_deletionSuccess6.22test_dynamicroles.py
test_role_account_acls_multiple_mgmt_serversSuccess7.59test_dynamicroles.py
test_role_account_aclsSuccess7.73test_dynamicroles.py
test_default_role_deletionSuccess6.36test_dynamicroles.py
test_04_create_fat_type_disk_offeringSuccess0.05test_disk_offerings.py
test_03_delete_disk_offeringSuccess0.03test_disk_offerings.py
test_02_edit_disk_offeringSuccess0.04test_disk_offerings.py
test_02_create_sparse_type_disk_offeringSuccess0.05test_disk_offerings.py
test_01_create_disk_offeringSuccess0.08test_disk_offerings.py
test_deployvm_userdispersingSuccess65.61test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentratedSuccess90.72test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfitSuccess186.10test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_postSuccess25.34test_deploy_vm_with_userdata.py
test_deployvm_userdataSuccess150.97test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resizeSuccess6.15test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resizeSuccess6.19test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resizeSuccess6.94test_deploy_vm_root_resize.py
test_deploy_vm_from_isoSuccess232.46test_deploy_vm_iso.py
test_3d_gpu_supportSuccess444.93test_deploy_vgpu_enabled_vm.py
test_DeployVmAntiAffinityGroupSuccess246.69test_affinity_groups.py
test_08_resize_volumeSkipped10.10test_volumes.py
test_07_resize_failSkipped10.19test_volumes.py
test_06_copy_templateSkipped0.00test_templates.py
test_static_role_account_aclsSkipped0.02test_staticroles.py
test_01_scale_vmSkipped64.43test_scale_vm.py
test_01_primary_storage_iscsiSkipped0.03test_primary_storage.py
test_06_copy_isoSkipped0.00test_iso.py
test_deploy_vgpu_enabled_vmSkipped1.32test_deploy_vgpu_enabled_vm.py

@yadvr

Copy link
Copy Markdown
MemberAuthor

On manual run, all oobm related tests passed. It was a false positive. The issue was environment related with an alert related count where the test test_oobm_zchange_password failed in the env, I've added some cleanup tasks b/w test runs.

Tests out-of-band management ownership expiry across multi-mgmt server ... === TestName: test_oobm_multiple_mgmt_server_ownership | Status : SUCCESS ===
ok
Tests out-of-band management change password feature ... === TestName: test_oobm_zchange_password | Status : SUCCESS ===
ok


Ran 16 tests in 202.462s

OK

@yadvr

Copy link
Copy Markdown
MemberAuthor

@karuturi can you help run BVT tests on this PR?

@yadvryadvr mentioned this pull request Oct 18, 2016
@mlsorensen

Copy link
Copy Markdown
Contributor

If we can confirm that these were false positives, we're good to merge, no?

@pdion891pdion891 mentioned this pull request Oct 20, 2016
@yadvr

Copy link
Copy Markdown
MemberAuthor

Thanks all for your review, tests. Fwd merge did not automatically close this PR, so closing this manually.

@yadvryadvr closed this Oct 21, 2016
@blueorangutan

Copy link
Copy Markdown

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@yadvr@blueorangutan@mlsorensen@murali-reddy@borisstoyanov