CEPH bluestore using ceph-ansible

Just to test the ceph bluestore i have created 2 virtual machine in virtualbox with hostname: admin & osd1.

Attached the 2 10G hdd for the OSD's in both the nodes.

Below are the commands that i used to deploy it using the ceph-ansible:

git clone https://github.com/ceph/ceph-ansible
cd ceph-ansible
cp group_vars/osds.yml.sample group_vars/osds.yml
cp group_vars/all.yml.sample group_vars/all.yml
cp group_vars/mons.yml.sample group_vars/mons.yml
cp site.yml.sample site.yml

vi group_vars/osds.yml
    devices:
   - /dev/sdb
    - /dev/sdc
bluestore : true

vi group_vars/all.yml
ceph_stable: true
ceph_mirror: http://download.ceph.com/
ceph_stable_key: https://download.ceph.com/keys/release.asc
ceph_stable_release: kraken
ceph_stable_repo: "{{ ceph_mirror }}/rpm-{{ ceph_stable_release }}"

monitor_interface: enp0s3
monitor_address: 192.xx.xx.xx
osd_objectstore: bluestore

ceph_conf_overrides:
   global:
   enable experimental unrecoverable data corrupting features: 'bluestore rocksdb'
bluestore fsck on mount: true
bluestore block db size: 67108864
bluestore block wal size: 134217728
bluestore block size: 5368709120

ansible-playbook site.yml

If you don't get any error during installation , you will see the below output when your cepph cluster is UP:


[root@admin ~]# ceph osd tree
2017-04-21 13:11:00.775650 7f01ea92c700 -1 WARNING: the following dangerous and experimental features are enabled: bluestore,rocksdb
2017-04-21 13:11:00.851519 7f01ea92c700 -1 WARNING: the following dangerous and experimental features are enabled: bluestore,rocksdb
ID WEIGHT  TYPE NAME      UP/DOWN REWEIGHT PRIMARY-AFFINITY
-1 0.01959 root default                                    
-2 0.00980     host osd1                                  
 1 0.00490         osd.1       up  1.00000          1.00000
 2 0.00490         osd.2       up  1.00000          1.00000
-3 0.00980     host admin                                  
 0 0.00490         osd.0       up  1.00000          1.00000
 3 0.00490         osd.3       up  1.00000          1.00000
[root@admin ~]# ceph -s
2017-04-21 13:11:09.506583 7fef54404700 -1 WARNING: the following dangerous and experimental features are enabled: bluestore,rocksdb
2017-04-21 13:11:09.531409 7fef54404700 -1 WARNING: the following dangerous and experimental features are enabled: bluestore,rocksdb
    cluster 4925dc3b-b43a-4766-81d4-584ba5755366
     health HEALTH_OK
     monmap e2: 1 mons at {admin=192.168.104.141:6789/0}
            election epoch 12, quorum 0 admin
        mgr no daemons active
     osdmap e67: 4 osds: 4 up, 4 in
            flags sortbitwise,require_jewel_osds,require_kraken_osds
      pgmap v158: 0 pgs, 0 pools, 0 bytes data, 0 objects
            99072 kB used, 20383 MB / 20480 MB avail

[root@admin ~]# lsblk
NAME            MAJ:MIN RM  SIZE RO TYPE MOUNTPOINT
sda               8:0    0 21.7G  0 disk
├─sda1            8:1    0  500M  0 part /boot
└─sda2            8:2    0 21.2G  0 part
  ├─centos-root 253:0    0 19.2G  0 lvm  /
  └─centos-swap 253:1    0    2G  0 lvm  [SWAP]
sdb               8:16   0   10G  0 disk
├─sdb1            8:17   0  100M  0 part /var/lib/ceph/osd/ceph-0
└─sdb2            8:18   0    5G  0 part
sdc               8:32   0   10G  0 disk
├─sdc1            8:33   0  100M  0 part /var/lib/ceph/osd/ceph-3
└─sdc2            8:34   0    5G  0 part