Teuthology docker targets hack (5/5)

The teuthology container hack is improved to run teuthology-suite. For instance:

./virtualenv/bin/teuthology-suite \
  --distro ubuntu \
  --suite-dir $HOME/software/ceph/ceph-qa-suite \
  --config-file docker-integration/teuthology.yaml \
  --machine-type container \
  --owner loic@dachary.org \
  --filter 'rados:basic/{clusters/fixed-2.yaml fs/btrfs.yaml \
     msgr-failures/few.yaml tasks/rados_cls_all.yaml}' \
  --suite rados/basic --ceph ANY \
  $(pwd)/docker-integration/ubuntu.yaml

schedules a single job out of the rados suite and the results can be collected in the teuthology-worker archive directory:

$ tail -5 /tmp/a/loic-2015-06-06_16:06:57-rados:\
    basic-ANY---basic-container/22/teuthology.log
06:57-rados:basic-ANY---basic-container/22/teuthology.log
    tasks/rados_cls_all.yaml}', duration: 1017.5819008350372, \
  flavor: basic, owner: loic@dachary.org,
  success: true}
2015-06-06T16:24:38.634 WARNING:teuthology.report:No result_server \
  in config; not reporting results
2015-06-06T16:24:38.634 INFO:teuthology.run:pass

tox integration tests

The docker-delegate tox environment can be used to setup a teuthology cluster to run integration tests such as lock –list –all.
A container is created with tox -e docker-delegate, a cluster setup and tox run again in the container to take advantage of it with tox -e docker-integration.

$ tox -e docker-delegate
GLOB sdist-make: /home/loic/software/ceph/teuthology/setup.py
docker-delegate runtests: PYTHONHASHSEED='1772658356'
...
docker run --rm --privileged --name teuthology-ubuntu-14.04 \
   --hostname teuthology-ubuntu-14.04 \
   -v /tmp:/tmp -v /packages \
   -v /var/run/docker.sock:/run/docker.sock \
   -v /usr/bin/docker:/bin/docker \
   -v /home/loic:/home/loic \
   -w /home/loic/software/ceph/teuthology \
   --user 1000 teuthology-ubuntu-14.04 \
   env HOME=/home/loic tox -e docker-integration
...
GLOB sdist-make: /home/loic/software/ceph/teuthology/setup.py
docker-integration recreate: /home/loic/software/ceph/teuthology/.tox/docker-integration
...
docker-integration/test.py::TestLock::test_list PASSED

=========================== 1 passed in 0.12 seconds ===========================
___________________________________ summary ____________________________________
  docker-integration: commands succeeded
  congratulations :)
___________________________________ summary ____________________________________
  docker-delegate: commands succeeded
  congratulations :)

container based teuthology-suite

The container created for tox integration tests can be re-used to manually run jobs.

docker run \
  --privileged \
  --rm --name teuthology-ubuntu-14.04 \
  -v /srv/hosts \
  -v /tmp:/tmp/tmp \
  -v /home/tmp:/packages \
  -v /var/run/docker.sock:/run/docker.sock \
  -v $(which docker):/bin/docker \
  -v $HOME:$HOME -w $(pwd) \
  --user $(id -u) -t -i \
  teuthology-ubuntu-14.04 bash

The /home/tmp directory must first be populated with make-debs.sh

$ make-debs.sh /home/tmp

Once in the container, the teuthology cluster is created with

loic@85fdacf1c0e3:~/software/ceph/teuthology$ docker-integration/setup.sh
docker-integration/setup.sh
Current branch master is up to date.
New python executable in ./virtualenv/bin/python
...
loic@85fdacf1c0e3:~/software/ceph/teuthology$ ps
  PID TTY          TIME CMD
    1 ?        00:00:01 bash
  215 ?        00:00:04 pecan
  221 ?        00:00:00 beanstalkd
12126 ?        00:00:00 teuthology-worker

The beanstalkd bus is used by teuthology-schedule to communicate with the teuthology-worker which will teuthology-lock machines from paddles (the pecan daemon). When the machines are locked, it calls teuthology to run the job and stores the results in the archive directory for forensic analysis (/tmp/a in the example above).