CloudStack Backup & Recovery Framework by yadvr · Pull Request #3553 · apache/cloudstack

yadvr · 2019-08-13T17:34:10Z

This framework provides CloudStack users the ability to backup their guest VMs for recovery purposes, in case they suffer a hardware or software issue with their instances or the underlying infrastructure. This framework allows CloudStack to be integrated with Backup and Recovery providers, as pluggable solutions. Each provider should implement the backup and recovery methods provided by the framework in their own way.

FS: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Backup+and+Recovery+Framework
Doc: apache/cloudstack-documentation#85
Primate/UI: apache/cloudstack-primate#64

Types of changes

Breaking change (fix or feature that would cause existing functionality to change)
New feature (non-breaking change which adds functionality)
Bug fix (non-breaking change which fixes an issue)
Enhancement (improves an existing feature and functionality)
Cleanup (Code refactoring and cleanup, that may add test cases)

svenvogel · 2019-09-11T20:26:29Z

@rhtyd small questions. which provider does this mean? Veeam?

yadvr · 2019-09-11T20:53:12Z

@svenvogel yes Veeam is a supported provider plugin

This introduces a new framework that provides CloudStack users the ability to backup their guest VMs for recovery purposes, in case they suffer a hardware or software issue with their instances or the underlying infrastructure. This framework allows CloudStack to be integrated with Backup and Recovery providers, as pluggable solutions. Each provider must implement the backup and recovery methods provided by the framework in their own way. Two B&R plugins ship with this change: - Veeam B&R: for VMware - Dummy: for testing purposes FS: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Backup+and+Recovery+Framework Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

yadvr · 2020-02-26T09:42:35Z

@blueorangutan package

blueorangutan · 2020-02-26T09:43:18Z

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2020-02-26T10:15:50Z

Packaging result: ✖centos6 ✔centos7 ✔debian. JID-950

yadvr · 2020-02-26T10:27:54Z

@blueorangutan test

blueorangutan · 2020-02-26T10:28:18Z

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

yadvr · 2020-02-26T14:51:11Z

@blueorangutan package

blueorangutan · 2020-02-26T14:51:19Z

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2020-02-26T15:18:44Z

Packaging result: ✖centos6 ✔centos7 ✔debian. JID-956

yadvr · 2020-02-26T15:27:37Z

@blueorangutan test centos7 vmware-65u3

blueorangutan · 2020-02-26T15:28:19Z

@rhtyd unsupported parameters provided. Supported mgmt server os are: centos6, centos7, ubuntu. Supported hypervisors are: kvm-centos6, kvm-centos7, kvm-ubuntu, xenserver-71, xenserver-65sp1, xenserver-62sp1, vmware-67u3, vmware-65u2, vmware-60u2, vmware-55u3, vmware-51u1, vmware-50u1

yadvr · 2020-02-26T15:30:17Z

@blueorangutan test centos7 vmware-67u3

blueorangutan · 2020-02-26T15:31:19Z

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + vmware-67u3) has been kicked to run smoke tests

blueorangutan · 2020-02-26T18:54:56Z

Trillian test result (tid-1129)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 28934 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3553-t1129-kvm-centos7.zip
Smoke tests completed. 81 look OK, 0 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File

blueorangutan · 2020-02-27T01:59:40Z

Trillian test result (tid-1135)
Environment: vmware-67u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36067 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3553-t1135-vmware-67u3.zip
Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Smoke tests completed. 76 look OK, 0 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File

DaanHoogland · 2020-02-27T09:22:17Z

@blueorangutan test centos7 xenserver-71

blueorangutan · 2020-02-27T09:22:22Z

@DaanHoogland a Trillian-Jenkins test job (centos7 mgmt + xenserver-71) has been kicked to run smoke tests

blueorangutan · 2020-02-27T18:01:33Z

Trillian test result (tid-1141)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 29948 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3553-t1141-xenserver-71.zip
Intermittent failure detected: /marvin/tests/smoke/test_nic.py
Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
Smoke tests completed. 79 look OK, 2 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_01_nic	`Error`	69.54	test_nic.py
test_01_scale_vm	`Failure`	19.63	test_scale_vm.py

yadvr · 2020-02-28T08:32:08Z

I see a new nic related error but I'm not sure it's due to B&R changes cc @DaanHoogland I'll kick test again
@blueorangutan package

blueorangutan · 2020-02-28T08:32:27Z

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2020-02-28T08:56:36Z

Packaging result: ✖centos6 ✔centos7 ✔debian. JID-968

yadvr · 2020-02-28T09:02:31Z

@blueorangutan test centos7 xenserver-71

blueorangutan · 2020-02-28T09:03:26Z

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + xenserver-71) has been kicked to run smoke tests

blueorangutan · 2020-02-28T18:18:13Z

Trillian test result (tid-1145)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 31922 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3553-t1145-xenserver-71.zip
Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
Smoke tests completed. 80 look OK, 1 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_01_scale_vm	`Failure`	18.52	test_scale_vm.py

DaanHoogland · 2020-02-28T18:27:24Z

i saw the nic error in #3847 (comment) as well, and it passed just now. I think we are good to merge, @PaulAngus ?

DaanHoogland

code lgtm (even when this big)
Tested extensively as admin and normal user from UI and with API.
caveat: basic zones not tested because of #3031

yadvr added component:vmware component:primary-storage status:work-in-progress type:new-feature labels Aug 13, 2019

yadvr added this to the 4.14.0.0 milestone Aug 13, 2019

DaanHoogland closed this Nov 7, 2019

DaanHoogland reopened this Nov 7, 2019

yadvr self-assigned this Nov 19, 2019

yadvr force-pushed the bckuprecframework branch 2 times, most recently from 50d084f to 0c1969aCompare November 19, 2019 09:41

yadvr added 3 commits November 20, 2019 13:28

remove id req.
6e8778b
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

apidoc: fix section name
b75f35e
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

yadvr force-pushed the bckuprecframework branch from 68ac065 to b75f35eCompare November 20, 2019 08:00

yadvr added 14 commits November 20, 2019 13:50

don't allow duplicates by name in the same zone
21509bd
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

implement the asyncjob based scheduler design in db
3edec49
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

Merge remote-tracking branch 'origin/master' into bckuprecframework
6646353

fix missing methods
f1b957b
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

schedule apis
cff613d
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

more apis, backend support and refactorings
9f6a2e6
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

add assignment/removal APIs
4e1cf0d
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

Merge remote-tracking branch 'origin/master' into bckuprecframework
5a0bdb1

Merge remote-tracking branch 'origin/master' into bckuprecframework
97b7b69

Merge remote-tracking branch 'origin/master' into bckuprecframework
e536282
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

list api pagination and searching etc.
a2e6452
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

api layer changes and refactorings
50c44a6
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

minor fixes
33d580d
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

fix deletion corner cases
73f3d58
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

yadvr added 3 commits February 26, 2020 20:03

make pipe explicit, guard within parenthesis
9b0afed
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

Merge remote-tracking branch 'origin/master' into bckuprecframework
a461606

escape powershell pipe character
b850ba7
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

DaanHoogland mentioned this pull request Feb 29, 2020
VR: Fix Redundant VRouter guest network on wrong interface #3847
Merged
7 tasks

DaanHoogland approved these changes Mar 3, 2020
View reviewed changes

abh1sar mentioned this pull request Jul 25, 2025
Create new Instance from VM backup #10140
Merged
14 tasks

Uh oh!

Conversation

yadvr commented Aug 13, 2019• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Types of changes

Uh oh!

svenvogel commented Sep 11, 2019

Uh oh!

yadvr commented Sep 11, 2019

Uh oh!

yadvr commented Feb 26, 2020

Uh oh!

blueorangutan commented Feb 26, 2020

Uh oh!

blueorangutan commented Feb 26, 2020

Uh oh!

yadvr commented Feb 26, 2020

Uh oh!

blueorangutan commented Feb 26, 2020

Uh oh!

yadvr commented Feb 26, 2020

Uh oh!

blueorangutan commented Feb 26, 2020

Uh oh!

blueorangutan commented Feb 26, 2020

Uh oh!

yadvr commented Feb 26, 2020

Uh oh!

blueorangutan commented Feb 26, 2020

Uh oh!

yadvr commented Feb 26, 2020

Uh oh!

blueorangutan commented Feb 26, 2020

Uh oh!

blueorangutan commented Feb 26, 2020

Uh oh!

blueorangutan commented Feb 27, 2020

Uh oh!

DaanHoogland commented Feb 27, 2020

Uh oh!

blueorangutan commented Feb 27, 2020

Uh oh!

blueorangutan commented Feb 27, 2020

Uh oh!

yadvr commented Feb 28, 2020

Uh oh!

blueorangutan commented Feb 28, 2020

Uh oh!

blueorangutan commented Feb 28, 2020

Uh oh!

yadvr commented Feb 28, 2020

Uh oh!

blueorangutan commented Feb 28, 2020

Uh oh!

blueorangutan commented Feb 28, 2020

Uh oh!

DaanHoogland commented Feb 28, 2020

Uh oh!

DaanHoogland left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

yadvr commented Aug 13, 2019•
edited
Loading