Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Configure a cluster network with Cephadm?

Tags:

ceph

cephadm

I configured a simple Ceph cluster with cephadm, like this:

cephadm bootstrap --mon-ip 192.168.0.4
ssh-copy-id -f -i /etc/ceph/ceph.pub root@host2
ssh-copy-id -f -i /etc/ceph/ceph.pub root@host3
ceph orch host add host2
ceph orch host add host3
ceph orch apply osd --all-available-devices

And it works fine. Now I would like to set up a cluster network on 192.168.1.0/24.

I tried ceph config set global cluster_network 192.168.1.0/24 but it doesn't have any effect. I am not seeing any traffic on the secondary NICs.

How can I troubleshoot this? What is the recommended way to make cephadm notice the change?

like image 815
Ian Levesque Avatar asked May 12 '20 22:05

Ian Levesque


People also ask

What is Cephadm?

Cephadm deploys and manages a Ceph cluster by connection to hosts from the manager daemon via SSH to add, remove, or update Ceph daemon containers. It does not rely on external configuration or orchestration tools like Ansible, Rook, or Salt. Cephadm manages the full lifecycle of a Ceph cluster.


1 Answers

It turns out this is easy. You set the new configs:

ceph config set global cluster_network 192.168.1.0/24

Then have the orchestrator reconfigure the daemons:

ceph orch daemon reconfig mon.host1
ceph orch daemon reconfig mon.host2
ceph orch daemon reconfig mon.host3
ceph orch daemon reconfig osd.1
ceph orch daemon reconfig osd.2
ceph orch daemon reconfig osd.3
...

like image 137
Ian Levesque Avatar answered Jan 03 '23 01:01

Ian Levesque