Category Archives: ceph

Running node-rados from sources

The nodejs rados module comes with an example that requires a Ceph cluster. If Ceph was compiled from source, a cluster can be run from the source tree with rm -fr dev out ; mkdir -p dev CEPH_NUM_MON=1 CEPH_NUM_OSD=3 \ … Continue reading

Posted in ceph | Leave a comment

HOWTO test a Ceph crush rule

The crushtool utility can be used to test Ceph crush rules before applying them to a cluster. $ crushtool –outfn crushmap –build –num_osds 10 \ host straw 2 rack straw 2 default straw 0 # id weight type name reweight … Continue reading

Posted in ceph | Leave a comment

HOWTO test teuthology tasks

The Ceph integration tests run by teuthology are described with YAML files in the ceph-qa-suite repository. The actual work is carried out on machines provisioned by teuthology via tasks. For instance, the workunit task runs a script found in the … Continue reading

Posted in ceph | Leave a comment

What cinder volume is missing an RBD object ?

Although it is extremely unlikely to loose an object stored in Ceph, it is not impossible. When it happens to a Cinder volume based on RBD, knowing which has an object missing will help with disaster recovery.

Posted in Havana, ceph, openstack | Leave a comment

Tell teuthology to use a local ceph-qa-suite directory

By default teuthology will clone the ceph-qa-suite repository and use the tasks it contains. If tasks have been modified localy, teuthology can be instructed to use a local directory by inserting something like: suite_path: /home/loic/software/ceph/ceph-qa-suite in the teuthology job yaml … Continue reading

Posted in ceph | Leave a comment

Temporarily disable Ceph scrubbing to resolve high IO load

In a Ceph cluster with low bandwidth, the root disk of an OpenStack instance became extremely slow during days. When an OSD is scrubbing a placement group, it has a significant impact on performances and this is expected, for a … Continue reading

Posted in ceph | Leave a comment

Ceph disaster recovery scenario

A datacenter containing three hosts of a non profit Ceph and OpenStack cluster suddenly lost connectivity and it could not be restored within 24h. The corresponding OSDs were marked out manually. The Ceph pool dedicated to this datacenter became unavailable … Continue reading

Posted in ceph | 2 Comments

puppet-ceph update

End of last year, a new puppet-ceph module was bootstrapped with the ambitious goal to re-unite the dozens of individual efforts. I’m very happy with what we’ve accomplished. We are making progress although our community is mixed, but more importantly, … Continue reading

Posted in ceph, puppet | Leave a comment

Ceph erasure code jerasure plugin benchmarks (Highbank ARMv7)

The benchmark described for Intel Xeon is run with a Highbank ARMv7 Processor rev 0 (v7l) processor (the maker of the processor was Calxeda ), using the same codebase: The encoding speed is ~450MB/s for K=2,M=1 (i.e. a RAID5 equivalent) … Continue reading

Posted in ceph | 3 Comments

workaround DNSError when running teuthology-suite

Note: this is only useful for people with access to the Ceph lab. When running a Ceph integration tests using teuthology, it may fail because of a DNS resolution problem with: $ ./virtualenv/bin/teuthology-suite –base ~/software/ceph/ceph-qa-suite \ –suite upgrade/firefly-x \ –ceph … Continue reading

Posted in ceph | Leave a comment