[ceph_deploy.cli][INFO ] ceph_conf : None
[ceph_deploy.cli][INFO ] default_release : False
[ceph_deploy.cli][INFO ] disk : [('osd-node2', None, None)]
[osd-node2][DEBUG ] connection detected need for sudo
[osd-node2][DEBUG ] connected to host: osd-node2
[osd-node2][DEBUG ] detect platform information from remote host
[osd-node2][DEBUG ] detect machine type
[osd-node2][DEBUG ] find the location of an executable
[ceph_deploy.osd][INFO ] Distro info: CentOS Linux 7.4.1708 Core
[ceph_deploy.osd][DEBUG ] Listing disks on osd-node2...
[osd-node2][DEBUG ] find the location of an executable
[osd-node2][INFO ] Running command: sudo /usr/sbin/ceph-disk list
[osd-node2][DEBUG ] /dev/dm-0 other, ext4, mounted on /
[osd-node2][DEBUG ] /dev/sda :
[osd-node2][DEBUG ] /dev/sda3 other, LVM2_member
[osd-node2][DEBUG ] /dev/sda2 swap, swap
[osd-node2][DEBUG ] /dev/sda1 other, ext4, mounted on /boot
[osd-node2][DEBUG ] /dev/sdb :
[osd-node2][DEBUG ] /dev/sdb1 other, xfs
[osd-node2][DEBUG ] /dev/sdc :
[osd-node2][DEBUG ] /dev/sdc1 other, xfs
[osd-node2][DEBUG ] /dev/sdd other, unknown
[osd-node2][DEBUG ] /dev/sr0 other, unknown
[sysadmin@admin-node my-cluster]$
下面操作必须在admin的/etc/ceph下执行（请务必注意，格式为： ip地址：osd磁盘：日志盘）
ceph-deploy osd prepare osd-node1:sdc1:sdb1
ceph-deploy osd prepare osd-node2:sdc1:sdb1
如果报下面错误表示配置文件在各个节点上没有同步，需要手动推送一下：ceph-deploy --overwrite-conf config push admin-node osd-node1 osd-node2
[ceph_deploy.osd][ERROR ] RuntimeError: config file /etc/ceph/ceph.conf exists with different content; use --overwrite-conf to overwrite
[ceph_deploy][ERROR ] GenericError: Failed to create 1 OSDs
7、激活OSD磁盘
ceph-deploy osd activate osd-node1:sdc1:sdb1
ceph-deploy osd activate osd-node2:sdc1:sdb1
如果遇到下面错误，提示权限问题，需要修改磁盘的属主和属组为ceph（不是部署ceph创建的账号，而是ceph自己创建的‘ceph’账户）
[osd-node1][WARNIN] ceph_disk.main.Error: Error: ['ceph-osd', '--cluster', 'ceph', '--mkfs', '--mkkey', '-i', u'0', '--monmap', '/var/lib/ceph/tmp/mnt.wMliCA/activate.monmap', '--osd-data', '/var/lib/ceph/tmp/mnt.wMliCA', '--osd-journal', '/var/lib/ceph/tmp/mnt.wMliCA/journal', '--osd-uuid', u'14a500fd-a030-427a-b007-f16f6f4bbd4d', '--keyring', '/var/lib/ceph/tmp/mnt.wMliCA/keyring', '--setuser', 'ceph', '--setgroup', 'ceph'] failed : 2018-05-23 10:47:41.254049 7fece10c8800 -1 filestore(/var/lib/ceph/tmp/mnt.wMliCA) mkjournal error creating journal on /var/lib/ceph/tmp/mnt.wMliCA/journal: (13) Permission denied
[osd-node1][WARNIN] 2018-05-23 10:47:41.254068 7fece10c8800 -1 OSD::mkfs: ObjectStore::mkfs failed with error -13
[osd-node1][WARNIN] 2018-05-23 10:47:41.254123 7fece10c8800 -1 ** ERROR: error creating empty object store in /var/lib/ceph/tmp/mnt.wMliCA: (13) Permission denied
[osd-node1][WARNIN]
[osd-node1][ERROR ] RuntimeError: command returned non-zero exit status: 1
[ceph_deploy][ERROR ] RuntimeError: Failed to execute command: /usr/sbin/ceph-disk -v activate --mark-init systemd --mount /dev/sdc1
需要修改磁盘的属主和属组为ceph
[root@osd-node1 yum.repos.d]# cat /etc/passwd
root:x:0:0:root:/root:/bin/bash
bin:x:1:1:bin:/bin:/sbin/nologin
......
sysadmin:x:1000:1000:sysadmin:/home/sysadmin:/bin/bash
ceph:x:167:167:Ceph daemons:/var/lib/ceph:/sbin/nologin
[root@osd-node1 yum.repos.d]# chown ceph:ceph /dev/sdb1
[root@osd-node1 yum.repos.d]# chown ceph:ceph /dev/sdc1
[root@osd-node1 yum.repos.d]# ll /dev/sdb1
brw-rw---- 1 ceph ceph 8, 17 May 23 10:29 /dev/sdb1
[root@osd-node1 yum.repos.d]# ll /dev/sdc1
brw-rw---- 1 ceph ceph 8, 33 May 23 10:33 /dev/sdc1
[root@osd-node1 yum.repos.d]#
8、一次性完成磁盘的准备和激活
ceph-deploy osd create osd-node1:sdc1:sdb1
ceph-deploy osd create osd-node2:sdc1:sdb1
9、查看osd视图
[sysadmin@admin-node ceph]$ ceph osd tree
ID WEIGHT TYPE NAME UP/DOWN REWEIGHT PRIMARY-AFFINITY
-1 0.03897 root default
-2 0.01949 host osd-node1
0 0.01949 osd.0 up 1.00000 1.00000
-3 0.01949 host osd-node2
1 0.01949 osd.1 up 1.00000 1.00000
[sysadmin@admin-node ceph]$
如果报下面错误，因为我的key都是放到/home/sysadmin/my-cluster/下面，所以直接将下面文件全部拷贝到/etc/ceph/下面，并将权限改为755 。
[sysadmin@admin-node my-cluster]$ ceph osd tree
2018-05-23 11:08:38.913940 7fbd0e84d700 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory
推荐阅读
![罗非冷冻饵料配方,钓罗非冷冻饵料制作配方细谈[图]-](http://img.jiangsulong.com/220627/23412I111-0-lp.jpg)
- 史上最通俗分布式锁解读
- 分布式系统之Redis主从架构
- 分布式通讯中三大框架protobuf,thrift,fast比较
- 什么是分布式消息中间件？
- 分布式寻址算法
- Jmeter分布式部署测试做压力性能测试
- 常见的分布式Id生成器剖析
- 什么是Dubbo框架？
- 存储型XSS的危害
- 你不知道的SQL Server 日期和时间的内部存储过程