Building Ceph Debian GNU/Linux packages

The following script explains how to create Debian GNU/Linux packages for Ceph from a clone of the sources.

releasedir=/tmp/release
rm -fr releasedir
mkdir -p $releasedir
#
# remove all files not under git so they are not
# included in the distribution.
#
git clean -dxf
#
# git describe provides a version that is
# a) human readable
# b) is unique for each commit
# c) compares higher than any previous commit
# d) contains the short hash of the commit
#
vers=`git describe --match "v*" | sed s/^v//`
#
# creating the distribution tarbal requires some configure
# options (otherwise parts of the source tree will be left out).
#
./autogen.sh
./configure --with-rocksdb --with-ocf --with-rest-bench \
    --with-nss --with-debug --enable-cephfs-java \
    --with-lttng --with-babeltrace
#
# use distdir= to set the name of the top level directory of the
# tarbal to match the desired version
#
make distdir=ceph-$vers dist
#
# rename the tarbal to match debian conventions and extract it
#
mv ceph-$vers.tar.gz $releasedir/ceph_$vers.orig.tar.gz
tar -C $releasedir zxf ceph_$vers.orig.tar.gz
#
# copy the debian directory over and remove -dbg packages
# because they are large and take time to build
#
cp -a debian $releasedir/ceph-$vers/debian
cd $releasedir
perl -ni -e 'print if(!(/^Package: .*-dbg$/../^$/))' ceph-$vers/debian/control
perl -pi -e 's/--dbg-package.*//' ceph-$vers/debian/rules
#
# always set the debian version to 1 which is ok because the debian
# directory is included in the sources and the upstream version will
# change each time it is modified.
#
dvers="$vers-1"
#
# update the changelog to match the desired version
#
cd ceph-$vers
chvers=`head -1 debian/changelog | perl -ne 's/.*\(//; s/\).*//; print'`
if [ "$chvers" != "$dvers" ]; then
   DEBEMAIL="contact@ceph.com" dch -b -v "$dvers" "new version"
fi
#
# create the packages
# a) with ccache to speed things up when building repeatedly
# b) do not sign the packages
# c) use half of the available processors
#
PATH=/usr/lib/ccache:$PATH dpkg-buildpackage -j$(($(nproc) / 2)) -uc -us


The release directory contains the source and binary packages.

ceph_0.90-670-g4712b2b-1_amd64.changes
ceph_0.90-670-g4712b2b-1_amd64.deb
ceph_0.90-670-g4712b2b-1.diff.gz
ceph_0.90-670-g4712b2b-1.dsc
ceph_0.90-670-g4712b2b.orig.tar.gz
ceph-common_0.90-670-g4712b2b-1_amd64.deb
ceph-fs-common_0.90-670-g4712b2b-1_amd64.deb
ceph-fuse_0.90-670-g4712b2b-1_amd64.deb
ceph-mds_0.90-670-g4712b2b-1_amd64.deb
ceph-resource-agents_0.90-670-g4712b2b-1_amd64.deb
ceph-test_0.90-670-g4712b2b-1_amd64.deb
libcephfs1_0.90-670-g4712b2b-1_amd64.deb
libcephfs-dev_0.90-670-g4712b2b-1_amd64.deb
libcephfs-java_0.90-670-g4712b2b-1_all.deb
libcephfs-jni_0.90-670-g4712b2b-1_amd64.deb
librados2_0.90-670-g4712b2b-1_amd64.deb
librados-dev_0.90-670-g4712b2b-1_amd64.deb
libradosstriper1_0.90-670-g4712b2b-1_amd64.deb
libradosstriper-dev_0.90-670-g4712b2b-1_amd64.deb
librbd1_0.90-670-g4712b2b-1_amd64.deb
librbd-dev_0.90-670-g4712b2b-1_amd64.deb
python-ceph_0.90-670-g4712b2b-1_amd64.deb
radosgw_0.90-670-g4712b2b-1_amd64.deb
rbd-fuse_0.90-670-g4712b2b-1_amd64.deb
rest-bench_0.90-670-g4712b2b-1_amd64.deb

The first time around, using 12 2.1Ghz processors:

  • disk space: ~200MB
  • time: ~20 minutes

The second time around (i.e. ccache retrieves the results of the previous compilation)

  • disk space: ~200MB
  • time: ~10 minutes

Building after ccache -C and with the -dbg packages:

  • disk space: ~840MB
  • time: ~25 minutes

About 5 minutes is spent on compressing the 2GB of he ceph-test-dbg package.

This entry was posted in ceph, debian. Bookmark the permalink.

3 Responses to Building Ceph Debian GNU/Linux packages

  1. rektide says:

    Oh geeze, I didn’t realize Debian is only supplying 0.80 packages. That’s frightful. Thanks for these instructions which I hope to soon need.

  2. khyati says:

    can anyone please tel me what are the main steps to follow for changing source code of ceph.

  3. Bourne says:

    Thanks for sharing this great script ! It can be found in the ceph 9.0.3′s git.
    two cents:
    If tailor the configuration on Ubuntu ceph 9.0.3, update the configure in the debian/rules instead of update in the above script[make-debs.sh].

    And the script calls two times autoconf , one in the script itself, second in the Debian/rules.

Leave a Reply to Bourne Cancel reply

Your email address will not be published. Required fields are marked *

*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>