Skip to content

ci: deploy batcher with ansible - #1384

Merged
JuArce merged 37 commits into
stagingfrom
1344-ci-improve-servers-setup
Nov 13, 2024
Merged

ci: deploy batcher with ansible#1384
JuArce merged 37 commits into
stagingfrom
1344-ci-improve-servers-setup

Conversation

@JuArce

@JuArceJuArce commented Nov 5, 2024•
edited
Loading

Copy link
Copy Markdown
Collaborator

Ansible setup for Batcher

Note

This PR also adds common files for all components, like setup.yaml, webserver.yaml, etc.

Description

This PR adds the setup for the Batcher

The current inventory is set to deploy the Batcher to aligned-holesky-stage-1 server.

How to Test

Follow the README instructions

  1. First create the env files:
make ansible_batcher_create_env

  1. Then complete the env files.

  2. Deploy the Batcher

make ansible_batcher_deploy INVENTORY=./infra/ansible/stage_inventory.yaml KEYSTORE=<>

Type of change

  • CI

JuArceand others added 30 commits October 21, 2024 15:35
@JuArce
infra: add ansible scripts and services
4172aa6
@JuArce
fix: stage ansible
d45921f
@JuArce
chore: update ansible scripts
f0777fb
@klaus993
WIP: Inventory with groups
f98ccac
@klaus993
Adapt rust playbook to new way of passing user
3ebf895
@klaus993
Adapt eigenlayer-cli playbook to new way of passing user
01ea554
@klaus993
Merge remote-tracking branch 'origin/staging' into 1344-ci-improve-se…
dbdf94a
…rvers-setup
@klaus993
Adapt go playbook to new way of passing user
d17162d
@klaus993
Adapt rust playbook to new way of passing user
d44ac44
@klaus993
Adapt setup playbook to new way of passing user
f640339
@JuArce
chore: update ansible and batcher service
497cf0f
@klaus993
Add enable linger
405b611
@klaus993
Adapt aggregator playbook to new way of passing user
a12924f
@klaus993
WIP: add compile all FFIs task
b1ac303
@JuArce
Merge branch 'refs/heads/1344-ci-improve-servers-setup' into batcher_…
0fb1117
…ansible
# Conflicts:
#	infra/ansible/eigenlayer-cli.yaml
#	infra/ansible/rust.yaml
#	infra/ansible/setup.yaml
@JuArce
chore: move playbooks to playbooks directory
ba159ce
fix: run playbooks as ansible_user
@JuArce
chore: add config files to ansible scripts
23e3741
@JuArce
ci: add caddy and wallet
9816bef
@JuArce
ci: add make targets
64242f3
@JuArce
ci: add README.md
590bd7e
@JuArce
nit
1697986
@JuArce
nit
cdbd2d4
@JuArce
ci: improve imported playbooks run
e1b4b04
@JuArce
fix: undo aggregator.yaml changes
ab51d4f
@JuArce
fix: undo aggregator.yaml changes
077cccc
@JuArce
fix: remove service variables
a4ea64a
@JuArce
fix: pr comments
e399e17
@JuArce
fix: use become: true instead of sudo
56f3377
@JuArce
fix: do not override ini files if already exists
3ada0e3
@JuArce
Merge branch 'refs/heads/staging' into 1344-ci-improve-servers-setup
879cb70
@JuArce
JuArce changed the base branch from testnet to stagingNovember 5, 2024 21:04
@JuArceJuArce changed the title ci: improve servers setupci: improve servers setup for batcher aggregator and operatorNov 5, 2024
@JuArceJuArce mentioned this pull request Nov 7, 2024
Closed
@JuArceJuArce changed the title ci: improve servers setup for batcher aggregator and operatorci: deploy batcher with ansibleNov 12, 2024
@JuArce
JuArce marked this pull request as ready for review November 12, 2024 18:05
@JuArceJuArce self-assigned this Nov 12, 2024
Oppen
Oppen reviewed Nov 12, 2024
View reviewed changes
Comment threadinfra/ansible/aggregator.yaml
Comment on lines +50 to +54
- name: Compile all FFIs
become: true
shell:
chdir: /home/{{ app_user }}/repos/aggregator/aligned_layer
cmd: sudo -u {{ app_user }} . /home/{{ app_user }}/.profile && sudo -u {{ app_user }} make build_all_ffi_linux

@OppenOppenNov 12, 2024

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Instead of using sudo -u, why not use become: {{ app_user }}?

@JuArceJuArceNov 13, 2024

Copy link
Copy Markdown
CollaboratorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This file will be refactored in #1387

Oppen
Oppen reviewed Nov 12, 2024
View reviewed changes
Comment threadinfra/ansible/playbooks/batcher.yaml
recursive: false

# Build the batcher
- name: Install deps

@OppenOppenNov 12, 2024

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Might be missing a become: {{ ansible_user }} here?

@JuArceJuArceNov 13, 2024

Copy link
Copy Markdown
CollaboratorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is not needed I think

uri-99
uri-99 suggested changes Nov 12, 2024
View reviewed changes

@uri-99uri-99 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

there are 2 values missing in batcher config yaml
it is not good i need to specify directory of keystore in the server, it shouldnt change

@JuArceJuArce mentioned this pull request Nov 13, 2024
Merged
1 task
MarcosNicolau
MarcosNicolau reviewed Nov 13, 2024
View reviewed changes
Comment threadinfra/ansible/playbooks/docker.yaml Outdated
MarcosNicolau
MarcosNicolau reviewed Nov 13, 2024
View reviewed changes
Comment threadinfra/ansible/playbooks/operator.yaml
MarcosNicolau
MarcosNicolau reviewed Nov 13, 2024
View reviewed changes
Comment threadinfra/services/avs-sync.service Outdated
MarcosNicolau
MarcosNicolau reviewed Nov 13, 2024
View reviewed changes
Comment threadinfra/services/explorer.service Outdated
MarcosNicolau
MarcosNicolau reviewed Nov 13, 2024
View reviewed changes
Comment threadinfra/services/operator-1.service Outdated
MarcosNicolau
MarcosNicolau reviewed Nov 13, 2024
View reviewed changes
Comment threadinfra/services/prometheus.service Outdated
MarcosNicolau
MarcosNicolau reviewed Nov 13, 2024
View reviewed changes
Comment threadinfra/services/telemetry.service Outdated
MarcosNicolau
MarcosNicolau reviewed Nov 13, 2024
View reviewed changes
Comment threadinfra/services/tracker.service Outdated
MarcosNicolau
MarcosNicolau reviewed Nov 13, 2024
View reviewed changes
Comment threadinfra/ansible/playbooks/batcher.yaml Outdated
MarcosNicolau
MarcosNicolau approved these changes Nov 13, 2024
View reviewed changes

@MarcosNicolauMarcosNicolau left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Everything worked fine, only I had to change the batcher git version.

@JuArce
fix: add missing new line
4ef8b76
fix: set batcher version to v0.10.2
@JuArce
JuArce added this pull request to the merge queueNov 13, 2024
Merged via the queue into staging with commit ba24ebaNov 13, 2024
@JuArce
JuArce deleted the 1344-ci-improve-servers-setup branch November 13, 2024 17:40
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@MarcosNicolauMarcosNicolauMarcosNicolau approved these changes
+2 more reviewers
@OppenOppenOppen left review comments
@uri-99uri-99uri-99 approved these changes
Reviewers whose approvals may not affect merge requirements

Assignees

@JuArceJuArce

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

ci: improve servers setup

5 participants

@JuArce@Oppen@uri-99@MarcosNicolau@klaus993