Welcome to 'building the WirelessLeiden NanoBSD image'

​FreeBSD default method for installing ​FreeBSD on embedded devices, like ​Soekris, ​Alix and others. The manual described below is (loosely) based on the Very basic concept plan of Tim Baas, but also consists of many hints by ​official 'Introduction to NanoBSD' manual and other stuff found on the net ;-). The advantages of using Nanobsd have been nicely summarized recently on the ​pfsense website.

Have to remember links

• ​http://people.freebsd.org/~phk/nanobsd/soekris_4x26/make.soekris_4x26.conf
• Active work in progress node images at ​http://webfolder.wirelessleiden.nl/rick/nodefactory/
• ​Getting Xircom pcmcia network adapter to work
• ​How to add a USB vendor
• ​LIACS wiki

Procedure

Please note that you can find the supporting files in the subdirectory nanobsd. Also keep a close look at the INFO WARNING ERR directives as they guide you through some common pitfalls. This guide was originally written for FreeBSD 7.2, this page is still available FreeBSD7.2_Guide. As there are a lot of (positive) changes in the wireless stack, we now prefer the use of FreeBSD 8.0.

A. Setup a FreeBSD 8.0 host

---

WARN: Make sure /usr is at least 5GB in size building as building images require quite some space
WARN: Make sure you install the i386 release of FreeBSD also when your system does support amd64, as cross compiling can give some nasty surprises

---

Get yourself a fresh i386 freebsd host with ports and subversion installed as follows:

A.1. Run the basic CD installer of 8.0.

The procedure below has been tested with 8.0-RELEASE (standard developer install - no ports - will fit our needs). Installing FreeBSD is outside the scope of this document, take a look into ​the FreeBSD handbook Chapter 2 Installing FreeBSD if you do not know the details.

Please do mind that all commands below need to be executed as root, because of the many mounts and unmounts done in various phases.

Internet connection is required.

Set correct date/time, e.g.

$ ntpdate -s pool.ntp.org

A.2. get latest sources

$ csup  -h cvsup.nl.freebsd.org /usr/share/examples/cvsup/standard-supfile

A.3 fetch ports

$ portsnap fetch extract

A.4 set some usefull variables

Edit the shell configuration file .cshrc:

$ cat <<EOF >> $HOME/.cshrc
# check whether ftp is set to passive mode, to avoid potential firewall issues:
setenv FTP_PASSIVE_MODE YES

# set a default password for the images that you will produce
setenv CFG_ROOT_PASSWORD [default password]

# define the svn download directory:
setenv R /root/nanobsd
EOF

Next load your file (or login again): $ source $HOME/.cshrc

A.5. install subversion . NOTE: Install all packages via ports to prevent issues later on!

$ cd /usr/ports/devel/subversion; make install clean BATCH=yes

A.6. OPTIONAL, every developer has his own preferences, these are mine ;-)

$ (cd /usr/ports/editors/vim-lite; make install clean BATCH=yes)
$ (cd /usr/ports/security/sudo; make install clean BATCH=yes)
$ (cd /usr/ports/sysutils/screen; make install clean BATCH=yes)

B. Build environment

B.1 Download the environment from the Wireless Leiden svn repository

$ 
$ svn checkout http://svn.wirelessleiden.nl/svn/code/iris/trunk/nanobsd $R
$ cd $R

Note: if svn is not found: svn is in /usr/local/bin, alternatively log out and in, or use rehash in a csh shell to make it available.

B.2. Compile all required packages using

$ /root/nanobsd/tools/package-build.sh

B.3. Set your favorite root password to be used in the image

Note: you can skip this step if you are satisfied with the default password set in step A.4 above.

$ setenv CFG_ROOT_PASSWORD `dd if=/dev/random bs=10k count=10 | & tr -cd '[a-zA-Z0-9]' | cut -c -15`
$ echo $CFG_ROOT_PASSWORD

If you like a simple password, substitute the `dd if=/dev/random bs=10k count=10 | & tr -cd '[a-zA-Z0-9]' | cut -c -15` with your password.

B.4 Apply kernel patch for Davicom USB-LAN adapter

For use of a Davicom DM9601 USB network controler you have to patch usbdevs and the if_udav driver:

$ patch -d /usr/src/sys/dev/usb -i /root/nanobsd/misc/patches/usbdevs.patch
$ patch -d /usr/src/sys/dev/usb/net -i /root/nanobsd/misc/patches/if_udav.c.patch

B.5. Build nanobsd (make sure to prepare some coffee;-) )

$ sh /usr/src/tools/tools/nanobsd/nanobsd.sh -c /root/nanobsd/cfg/nanobsd.wleiden 

Note 1: Take a coffee of go for a hike, this normally takes 2 - 8 hours depending on the machine configuration

Note 2: even this little script got flags, check the output of sh /usr/src/tools/tools/nanobsd/nanobsd.sh -h

-b suppress builds (both kernel and world)
-k suppress buildkernel
-w suppress buildworld
-c specify config file
...

Note 3: The geometry of the cf card is defined in the nanobsd configuration file /root/nanobsd/cfg/nanobsd.wleiden The 'default' values are for a Peak 1 GB card. They also work on an Alix board (but NOT ON Soekris! ) for a 1 GB PCEngines 'blanc' cf card although its geometry is slightly different.

C. Fetch node configuration onto image, write to CF disk or remotely update

C.1. Fetch configuration

$ /root/nanobsd/tools/config-image.sh 

The script is connecting to the ​Wireless Leiden 'genesis' database. First make sure that the configuration file is up to date by clicking the 'update' button on ​http://wlconfig.wirelessleiden.nl/freebsd/iris-8.0/ Pick your situation!

You can inspect the image bij mounting as memory disk:

mdconfig -a -t vnode -f /usr/obj/nanobsd.wleiden/_.disk.full
mount /dev/md0s1a /mnt
ls /mnt
umount /mnt
mount /dev/md0s3 /mnt
ls /mnt
umount /mnt
mdconfig -d -u 0

C.2. Write the correct image to CF (media based on SLC and not MLC flash seem to perform much better).

---

NOTE: _.disk.full is required for new CF cards as it contains two base systems and one configuration.

_.disk.image on the other hand can be used to update an existing CF card

---

1. New image: Put full image on compact flash disk (attach a card reader/writer with a CF disk of minimum 1 GB)

   $ dd bs=64k if=/usr/obj/nanobsd.wleiden/_.disk.full of=/dev/da0
   

   (assuming /dev/da0 is your compact flash entry; this takes about 15 minutes; you may wish to check afterwards with fdisk whether there are three partitions on the disk, you can also mount /dev/da0s1a and /dev/da0s3 and check the configuration)

1. Existing image: Put partial image on slice (slice 2) (attach a card reader/writer with the CF disk containing the existing image)

   $ dd bs=64k if=/usr/obj/nanobsd.wleiden/_.disk.image of=/dev/da0s2
   

1. Existing image remote update (slice 2) (network connection to machine 172.x.y.z required)

For remotely updating an existing configuration use:

dd if=/usr/obj/nanobsd.wleiden/_.disk.image bs=10k | ssh root@172.x.y.z /tools/updatep2

You may adjust the block size to make the transfer more efficient (additionally ssh -C is possible) and you can use Ctrl-T to check progress.

WARNING: in case of a remote update from 7.2 to 8.0 you must scp the new rc.conf.local to the node before reboot because the interface configuration statements are quite different. If you do not adjust the configuration before reboot the interfaces will not be configured after reboot and you will not be able to reach the node!(see F.4 below)

D. Check the cf card and apply last minute changes

D.1. Check cf card

While the cf card is still in your flash card reader you can check whether the image has been written correctly. Check whether you can mount the partitions, e.g.

mount /dev/da0s1a /mnt
ls /mnt
umount /mnt

and the configuration partition:

mount /dev/da0s3 /mnt
ls /mnt

If you cannot mount the partitions, take a fresh cf card and start again with writing the image.

D.2 adjust lvrouted conf

If the node has a /28 subnet that should be routable modify the /conf/base/etc/rc.conf file:

lvrouted_flags="-u -m 28 -s s00p3rs3kr3t"

(for a /24 subnet use -m 24)

E. All done! Load the machine

Place the new CF disk in the machine and boot it up (existing nodes: just reboot), you should be good to go! Especially first time booting can take a long time, depending also on hardware. In a Soekris4521 this takes about ten minutes. You can follow the boot process using e.g. minicom or tip, via a serial connection (communication parameters: 9600 8N1).

Note 1. For subsequent nodes you can skip the build and go directly for step C, or take a look at development if you have to rebuild the image (after small changes).

Note 2. Check your bios version in case of booting problems (note: default communication setting for alix is 38400 8N1, bios should be 0.99h)

F. Applying Updates

For small changes there is a shortcut in the build (to save you some coffee ;-)). Pick the situation applicable

1. First lets pump it's source to the latest version

   $ svn up /root/nanobsd
   

2. Set your favorite root password to be used in the image - if different from the password defined in your setup file (see A.4 above):

   $ setenv CFG_ROOT_PASSWORD `dd if=/dev/random bs=10k count=10 | & tr -cd '[a-zA-Z0-9]' | cut -c -15`; echo $CFG_ROOT_PASSWORD
   

   If you like a simple password, substitute the `dd if=/dev/random bs=10k count=10 | & tr -cd '[a-zA-Z0-9]' | cut -c -15` with your password.
3. Next step depends on the kind of changes:
   1. Only changes in kernel options - kernel.wleiden altered - ETA 0:45

      $ sh /usr/src/tools/tools/nanobsd/nanobsd.sh -w -c /root/nanobsd/cfg/nanobsd.wleiden
      

   2. Only changes in world options - CONF_{BUILD,COMMON,INSTALL} in nanobsd.wleiden altered - ETA 2:00 - 6:00

      $ sh /usr/src/tools/tools/nanobsd/nanobsd.sh -k -c /root/nanobsd/cfg/nanobsd.wleiden
      

   3. _NO_ changes in build options - any other file altered - ETA 0:10

      $ sh /usr/src/tools/tools/nanobsd/nanobsd.sh -b -c /root/nanobsd/cfg/nanobsd.wleiden
      

   4. ONLY different configuration

      $ /root/nanobsd/tools/config-image.sh 
      

4. Upgrading from 7.2 to 8.0 is tricky because the interface configuration statements have changed. You have to update the config file on slice 3 as well in this case. Mount the image as memory disk:

   mdconfig -a -t vnode -f /usr/obj/nanobsd.wleiden/_.disk.full
   mount /dev/md0s1a /mnt
   

   and apply changes to lvrouted flags in rc.conf if needed, see D.2 above

   umount /mnt
   

   Mount the configuration slice:

   mount /dev/md0s3 /mnt
   

   scp the rc.conf.local file to the /cfg directory on the node running the old 7.2 configuration

   umount /mnt
   mdconfig -d -u 0
   

5. Partition switch bug in FreeBSD8.0

There appears to be a bug in FreeBSD8.0 upgrade procedure. A work around for the partition switch problem in the upgrade procedure that works for Wireless Leiden:

• reboot ( unclear why this is needed, but otherwise it doesnot work, i.e. no switch of the active partition)
• updatep2 (of p1)
• log in, check whether fdisk has activated p2 (or p1).
• If positive go to runlevel 6 (init 6), log out.
• After a couple of minutes you can log in, welcome on the new slice!

G, Development

Handy tools

Some handy tools are available in the /tools directory, such as

• /tools/wl-version : to get information on the configuration that is running
• /tools/image-build.sh for building images (replaces long command lines and prevents unintentional, time-consuming rebuilds; do not forget to setenv the root password!)

Light based packages suggestions

• dnsmasq has been implemented instead of isc-dhcp30-server and bind
• thttpd instead of apache

Further research

• stumber /usr/src/tools/tools/net80211/stumber

Background

• Packages needed are to be found in the nanobsd/tools/package-build.sh script i.e.

   $PORTSDIR/dns/dnsmasq
   $PORTSDIR/www/py-cherrypy
   $PORTSDIR/www/tinyproxy
   $PORTSDIR/editors/vim-lite
   $PORTSDIR/net-mgmt/net-snmp
   $PORTSDIR/net-mgmt/nrpe2
   $PORTSDIR/benchmarks/iperf
   $PORTSDIR/net/pen
   $PORTSDIR/net/rsync
   # Wireless Leiden ports at $WL_PORTSDIR
   $WL_PORTSDIR/net/lvrouted
   $WL_PORTSDIR/net/transproxy
  

Testing Images

• KnownErrorMessages
• TestingViaNFS
• TestMatrix

Hardware

• Soekris 4521, 4801, 5501, bios version 1.23, 1.31b, 1.32, 1.33
• Alix 2D3, only use latest bios: 0.99h

Note on updating Soekris bios (CTRL+P to enter): no luck with minicom, used cu on linux (Ubuntu: sudo apt-get install lrzsz cu):

chown uucp /dev/ttyS0
cu -l /dev/ttyS0 -s 9600
> download -
Start sending file using XMODEM/CRC protocol.
~+sx -X b4501_133.bin
Sending b4501_133.bin, 608 blocks: Give your local XMODEM receive command now.
Bytes Sent:  77824   BPS:892
Transfer complete
File downloaded succesfully, size 608 Blocks.

flashupdate reboot

What changed for FreeBSD 8.0 ?

All modifications required for 8.0 are incorporated in the nodefactory version that can be found in svn: ​http://svn.wirelessleiden.nl/svn/code/iris/trunk/nanobsd/

Some modifications for freebsd-8.0 RELEASE going from 7.2 to 8.0:

• use of rc.conf.local in stead of rc.node.local to be more in-line with standard FreeBSD config
• apply only patch for usbdevs and if_udav.c to make Davicom usb-lan adapter work;
• no cardbus patch
• modify kernel.wleiden configuration file, see ​http://svn.wirelessleiden.nl/svn/projects/proxy/2.0/nanobsd/nanobsd/cfg/kernel.wleiden

   # options     CLK_USE_I8254_CALIBRATION
   # options     ADAPTIVE_GIANT  # Giant mutex is adaptive.
   # device      wlan_scan_ap    # 802.11 AP mode scanning.
   # device      wlan_scan_sta   # 802.11 STA mode scanning.
   # device      ppp             # Kernel PPP
   # device      ugen            # Generic
   # device      sio
  

• modify ttys-nanobsd.patch file
• wireless interface configuration is quite different (configuration script was changed) modify rc.conf.local somewhat like this:

   wlans_ath0="wlan0"
   create_args_wlan0="wlanmode hostap mode 11b ssid ap-omni.huub.wleiden.net channel 7"
   ifconfig_wlan0="inet 172.17.16.1/26"
  

  note that interface has to be 'down' to create_args_wlan0!
• usb-lan convertor interface for Digitus adapter is now ue (not aue)
• known issues (see freebsd-embedded mailinglist): geometry mismatch between cf-card and disklable; boot-sector/upgrade-procedure.

H. Hints

• You could always decide to install your FreeBSD base instance into a ​virtual environment
• cvsup.nl.freebsd.org is the local dutch cvsup mirror, replace nl with your proper country code
• It seems tempting to follow /usr/share/examples/cvsup/stable-supfile instead of /usr/share/examples/cvsup/standard-supfile please DO NOT unless your like big trouble as stable-supfile is the stable DEVELOPMENT branch e.g. upcoming stable.
• Default username/password = root/<blank>, so please do mind, _when no password is set ssh login is disabled_.
• Always use cu or putty for serial communication minicom, screen, putty all issues of some kind.
• After writing an image to cf-card using a usb-card-reader/writer you may encounter a problem dd-ing another image. Rebooting will help. Alternatively you can apply a power-cycle tot het usb device:

  usbconfig -u 1 -a 2 power_off
  usbconfig -u 1 -a 2 power_on
  

  (unit and address may vary, see usbconfig list).

J. Comments, questions or remarks?

Feel free to edit this page or send an email to our ​techniek mailinglist

• Handy .cshrc hints

  alias quicknano sh /usr/src/tools/tools/nanobsd/nanobsd.sh -b -c /root/nanobsd/cfg/nanobsd.wleiden
  alias slownano  sh /usr/src/tools/tools/nanobsd/nanobsd.sh -c /root/nanobsd/cfg/nanobsd.wleiden
  alias slownewkernelnano sh /usr/src/tools/tools/nanobsd/nanobsd.sh -w -c /root/nanobsd/cfg/nanobsd.wleiden
  alias slownewworldnano sh /usr/src/tools/tools/nanobsd/nanobsd.sh -k -c /root/nanobsd/cfg/nanobsd.wleiden
  alias prepare-nfs  /root/nanobsd/tools/prepare-nfs.sh -f -n