Skip to content

kvm 用の ONIE をビルドしてみる

ツチノコブログで ONIE を Build する手順が公開されています。こちらでは Docker イメージ自体をビルドしていますが、これを DockerHub でビルドしました。また、このイメージを利用して実際に kvm 用の ONIE をビルドしてみました。

ツチノコブログで公開されている Dockerfile では RUN を多用されていたので、こちらをひとつのレイヤーにまとめたのが以下の Dockerfile です。DockerHub には sig9/onie-builder として登録してあります。

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
FROM debian:jessie

MAINTAINER example@example.com

RUN apt-get clean && apt-get update \
 && apt-get install -y git-core sudo make wget pkg-config cpio \
 && useradd -m builduser \
 && echo 'builduser ALL=(ALL:ALL) ALL' >> /etc/sudoers \
 && su builduser -c "cd /home/builduser/; git clone https://github.com/opencomputeproject/onie" \
 && cd /home/builduser/onie/build-config && make debian-prepare-build-host \
 && su builduser -c "git config --global user.email example@example.com; git config --global user.name example" \
 && chsh -s /bin/bash builduser \
 && echo 'export PATH=$PATH:/sbin/:/usr/sbin/' >> /home/builduser/.bashrc

実際にこのイメージを利用し、CentOS7 上の Docker で ONIE をビルドしてみます。まず、Docker 自体をインストール＆開始しておきます。

1
2
3
yum -y install docker
systemctl start docker.service
systemctl enable docker.service

これで Docker イメージを実行する準備が整いました。sig9/onie-builder を実行します。

1
docker run --name onie-builder -i -t sig9/onie-builder /bin/bash

コンテナが起動したら builduser へ su し、ONIE を make します。今回は kvm 用のイメージをビルドしてみました。テストに使った環境ではビルドに 40 分程かかりました。

1
2
3
su builduser
cd ~/onie/build-config
make -j4 MACHINE=kvm_x86_64 all recovery-iso

ビルドしたイメージは /home/builduser/onie/build/images/ に生成されます。

1
2
3
4
5
6
$ ls -l /home/builduser/onie/build/images/
total 53436
-rw-r--r-- 1 builduser builduser  8633780 Feb  2 13:06 kvm_x86_64-r0.initrd
-rw-r--r-- 1 builduser builduser  3621840 Feb  2 13:04 kvm_x86_64-r0.vmlinuz
-rw-r--r-- 1 builduser builduser 30146560 Feb  2 13:07 onie-recovery-x86_64-kvm_x86_64-r0.iso
-rw-r--r-- 1 builduser builduser 12310391 Feb  2 13:06 onie-updater-x86_64-kvm_x86_64-r0

kvm_x86_64 の INSTALL

/home/builduser/onie/machine/kvm_x86_64/INSTALL の内容を引用しておきます。

  1
  2
  3
  4
  5
  6
  7
  8
  9
 10
 11
 12
 13
 14
 15
 16
 17
 18
 19
 20
 21
 22
 23
 24
 25
 26
 27
 28
 29
 30
 31
 32
 33
 34
 35
 36
 37
 38
 39
 40
 41
 42
 43
 44
 45
 46
 47
 48
 49
 50
 51
 52
 53
 54
 55
 56
 57
 58
 59
 60
 61
 62
 63
 64
 65
 66
 67
 68
 69
 70
 71
 72
 73
 74
 75
 76
 77
 78
 79
 80
 81
 82
 83
 84
 85
 86
 87
 88
 89
 90
 91
 92
 93
 94
 95
 96
 97
 98
 99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
=============================================
Installing ONIE on KVM x86_64 Virtual Machine
=============================================

Cross-Compiling ONIE
====================

Change directories to ``build-config`` to compile ONIE.

To compile ONIE first change directories to ``build-config`` and then
type ``"make MACHINE=kvm_x86_64 all"``.  For example::

  $ cd build-config
  $ make -j4 MACHINE=kvm_x86_64 all recovery-iso

When complete, the ONIE binaries are located in
``build/images``::

-rw-r--r-- 1 3963992 Jan 30 16:38 kvm_x86_64-r0.initrd
-rw-r--r-- 1 3091328 Jan 30 10:58 kvm_x86_64-r0.vmlinuz
-rw-r--r-- 1 7067253 Jan 30 16:38 onie-updater-x86_64-kvm_x86_64-r0
-rw-r--r-- 1 17825792 Apr 25 09:56 onie-recovery-x86_64-kvm_x86_64-r0.iso

kvm_x86_64-r0.vmlinuz -- This is the ONIE kernel image

kvm_x86_64-r0.initrd  -- This is the ONIE initramfs (filesystem)

onie-updater-x86_64-kvm_x86_64-r0 -- This is the ONIE self-update
image.  This image is a self-extracting archive used for installing
ONIE.

onie-recovery-x86_64-kvm_x86_64-r0.iso -- This is a recovery ISO image
that can be install as a CDROM image.

Creating a New x86_64 Virtual Machine Using the ISO Image
=========================================================

The ISO image can be used with both legacy BIOS and UEFI firmware
machines.

In order to boot qemu with UEFI firmware you need to download the OVMF
firmware from http://www.tianocore.org/ovmf/ .

To create the VM:

1. Create a 1 GB blank disk image to use as the "hard drive" for your VM.
   Name the file onie-x86-demo.img, putting it somewhere in your home
   directory::

     $ qemu-img create -f qcow2 onie-x86-demo.img 1G

2. edit mk-vm.sh and:

   - set the "DISK" variable to point at the path you used in step 1.

   - set the "CDROM" variable to point at the
     onie-recovery-x86_64-kvm_x86_64-r0.iso ISO image.

   - set the "mode" variable to "cdrom".  This will boot off the ISO
     image.

   [ For Booting with UEFI Firmware ]

   - set the "OVMF" variable to point at the path of the OVMF.fd
     firmware file.

   - set the "firmware" variable to "uefi".

3. run mk-vm.sh

4. From the boot menu select the "embed" option to install ONIE to the
   blank VM disk.

5. After the install is complete kill the virtual machine and edit
   mk-vm.sh, setting "mode" to "disk".  This will boot the VM from the
   disk image.

  This will create and launch a VM called "onie-x86-test".

Creating a New x86_64 Virtual Machine Using iPXE
================================================

This example assumes you have configured a DHCP server and a HTTP
server.  The DHCP server is nice to have, but not required.  The HTTP
server is required.

First copy the above build products to the root of your web server.
Here we assume the root of the web server is /var/www::

  $ cp kvm_x86_64-r0.vmlinuz kvm_x86_64-r0.initrd onie-updater-x86_64-kvm_x86_64-r0 /var/www

Next copy the provided ipxe installer script to the same directory::

  $ cp install.ipxe /var/www

.. note:: You will need to edit install.ipxe and change the
          onie-updater URL for your environment.  In the setting of
          the ``onie_url`` variable replace the string "<image-base>" with
          the IP address of your webserver.

When running under QEMU the virtual machine initially boots into
SeaBIOS, which has ipxe installed.  See http://www.ipxe.org/ for
complete details about ipxe.

1. Create a 256MB blank disk image to use as the "hard drive" for your VM.
   Name the file onie-x86-demo.img, putting it somewhere in your home
   directory::

     $ dd if=/dev/zero of=$HOME/kvm/onie-x86-demo.img bs=1M count=256

2. edit mk-vm.sh and:

   - set the "DISK" variable to point at the path you used in step 1.

   - set the "mode" variable to "disk".  This will try to boot off the
     unitialized hard disk.

3. run mk-vm.sh -- NOTE: After starting this script you need to be
   *fast* (5 seconds) to complete steps 4 and 5.

4. connect to the vnc output of the VM::

   vncviewer :0  (you can change the VNC_PORT in mk-vm.sh)

5.  On the vnc console you wil see the SeaBIOS splash screen, followed
    by the ipxe splash screen.  Type <ctrl>-B now.

6.  That should drop you to iPXE prompt

7.  Configure the network interface.  This example assumes you have a
    DHCP server configured.  If not, use the ipxe ``config`` command
    to set up the network parameters.  At the ipxe prompt type::

    iPXE> dhcp

7.  Download and run the install.ipxe script.  The URL of the
    install.ipxe depends on your environment.  Use the IP address of
    your HTTP server::

    iPXE> chain http://<web-server-IP-address>/install.ipxe

The install.ipxe should now download and commence running.  The ipxe
script will do the following:

1.  Download kvm_x86_64-r0.vmlinuz

2.  Download kvm_x86_64-r0.initrd

3.  Boot into ONIE using the "ONIE update" mode, passing the URL of
    the ONIE self-update image in the ``install_url`` kernel command
    line arguemt.

Once ONIE has booted it will:

1.  Detect that it is running in "ONIE update" mode

2.  Find the ``install_url`` command line argument

3.  Proceed to perform the update using the
    onie-updater-x86_64-kvm_x86_64-r0 image.  This update procedure
    will install ONIE on the virtual hard drive.

Once the ONIE update is complete the machine reboots.  This time you
will see the GRUB menu and the machine will boot of the hard drive.
The default GRUB entry boots the machine into "ONIE install" mode.

kvm_x86_64 の mk-vm.sh

/home/builduser/onie/machine/kvm_x86_64/mk-vm.sh の内容を引用しておきます。

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
builduser@a8190824569d:~/onie/machine/kvm_x86_64$ cat mk-vm.sh
#!/bin/sh

#  Copyright (C) 2014 Curt Brune <curt@cumulusnetworks.com>
#
#  SPDX-License-Identifier:     GPL-2.0

MEM=1024
DISK="$HOME/kvm/onie-x86-demo.img"

# Path to ONIE installer .iso image
CDROM="$HOME/kvm/onie-recovery-x86_64-kvm_x86_64-r0.iso"

# Path to OVMF firmware for qemu
# Download OVMF from http://www.tianocore.org/ovmf/
OVMF="$HOME/kvm/OVMF.fd"

# VM will listen on telnet port $KVM_PORT
KVM_PORT=9000

# VNC display to use
VNC_PORT=0

# set mode=disk to boot from hard disk
# mode=disk

# set mode=cdrom to boot from the CDROM
mode=cdrom

# set mode=net to boot from network adapters
# mode=net

# set firmware=uefi to boot with UEFI firmware, otherwise the system
# will boot into legacy mode.
firmware=uefi

on_exit()
{
    rm -f $kvm_log
}

kvm_log=$(mktemp)
trap on_exit EXIT

boot=c
if [ "$mode" = "cdrom" ] ; then
    boot="order=cd,once=d"
    cdrom="-cdrom $CDROM"
elif [ "$mode" = "net" ] ; then
    boot="order=cd,once=n,menu=on"
fi

if [ "$firmware" = "uefi" ] ; then
    [ -r "$OVMF" ] || {
        echo "ERROR:  Cannot find the OVMF firmware for UEFI: $OVMF"
        echo "Please make sure to install the OVMF.fd in the expected directory"
        exit 1
    }
    bios="-bios $OVMF"
fi

sudo /usr/bin/kvm -m $MEM \
    -name "onie" \
    $bios \
    -boot $boot $cdrom \
    -net nic,model=e1000 \
    -net tap,ifname=onie0 \
    -vnc 0.0.0.0:$VNC_PORT \
    -vga std \
    -drive file=$DISK,media=disk,if=virtio,index=0 \
    -serial telnet:localhost:$KVM_PORT,server > $kvm_log 2>&1 &

kvm_pid=$!

sleep 1.0

[ -d "/proc/$kvm_pid" ] || {
        echo "ERROR: kvm died."
        cat $kvm_log
        exit 1
}

telnet localhost $KVM_PORT

echo "to kill kvm:  sudo kill $kvm_pid"

exit 0