Installation of SmartOS
SmartOS is a unique operating system provided by Joyent Inc.. Based on IllumOS its primary goals is to provide a bare metal VM manager coupled with speed, scaling & redundancy.
First things first, we need to obtain the latest USB image (I tried to use the DVD/CD disk option and a USB key was easier to work with due to space constraints within /).
Now we need to create a bootable USB key from the image we just downloaded. Joyent is kind enough to provide very useful documentation on how to accomplish this.
Installation will ask a couple of questions about networking & which disk to use a within your zpool configuration. My recommendation (if you have more than one disk) is to only use the first disk as we will be providing a more robust and optimal zpool configuration after our installation.
ZFS Configuration
At this point you should have a working SmartOS installation with one disk configured as a zpool. This example of configuring the zfs zpool is to allow for the following options:
- Primary raidz3-0 (zone)
- Hot swappable drives
- Dedicated mirrored caching drives (SSD disk types for performance)
- Dedicated mirror disks of ZIL block reads/writes
This example does involve a system that utilizes quite a few physical drives, both mechanical & SSD types. SSD is used for the caching drive only as it is to assist in performance of commonly accessed data.
Fig. 1 shows the command used to assemble the zpool as exampled in Fig. 2.
Fig. 1
$ zpool create zones raidz3 c0t0d0 c0t1d0 c0t2d0 c0t3d0 spare c1t0d0 c1t1d0 cache mirror c2t0d0 c2t1d0 log mirror c3t0d0 c3t1d0
Fig. 2
$ zpool status
pool: zones
state: ONLINE
scan: none requested
config:
NAME STATE READ WRITE CKSUM
zones ONLINE 0 0 0
raidz3-0 ONLINE 0 0 0
c0t0d0 ONLINE 0 0 0
c0t1d0 ONLINE 0 0 0
c0t2d0 ONLINE 0 0 0
c0t3d0 ONLINE 0 0 0
spares
c1t0d0 AVAIL 0 0 0
c1t1d0 AVAIL 0 0 0
cache
mirror-0
c2t0d0 ONLINE 0 0 0
c2t1d0 ONLINE 0 0 0
logs
mirror-1
c3t0d0 ONLINE 0 0 0
c3t1d0 ONLINE 0 0 0
errors: No known data errors
For more information on managing zpool's I recommend the documentation as it gives you the necessary information on various topics such as swapping out bad primary disks for disks that were designated as hot swappable spares, etc.
SMF Configuration
Next up is to tune the startup services and get the SmartOS ready for our Fedora/Hydra/Blacklight VM instances.
Because SmartOS runs entirely in memory any configuration options are to be placed in the default /opt/custom/smf which is mounted within the OS from the zpool configuration. SmartOS provides some documentation on this here.
I disabled quite a few services that are enabled by default as for the host OS they will not be necessary. See Fig 3. for contents of /opt/custom/smf and Fig 4. for a sample configuration file used to execute the svcadm command to shutdown services.
Fig. 3
$ ls -lah total 58 drwxr-xr-x 2 root root 11 Feb 11 14:27 . drwxr-xr-x 6 root root 7 Feb 11 18:40 .. -rw-r--r-- 1 root root 1.3K Feb 7 15:30 bash-history-link.xml -rw-r--r-- 1 root root 1.1K Feb 7 15:46 disable-bind.xml -rw-r--r-- 1 root root 1.1K Feb 7 15:46 disable-inetd.xml -rw-r--r-- 1 root root 1.1K Feb 7 15:46 disable-multicast.xml -rw-r--r-- 1 root root 1.1K Feb 7 15:46 disable-ntp.xml -rw-r--r-- 1 root root 1.1K Feb 11 13:18 disable-sendmail-client.xml -rw-r--r-- 1 root root 1.1K Feb 11 13:19 disable-sendmail.xml -rw-r--r-- 1 root root 1.1K Feb 11 14:29 enable-ipf.xml -rw-r--r-- 1 root root 1.3K Feb 7 15:29 inputrc-link.xml
Fig 4.
$ cat disable-sendmail.xml
<?xml version='1.0'?>
<!DOCTYPE service_bundle SYSTEM '/usr/share/lib/xml/dtd/service_bundle.dtd.1'>
<service_bundle type='manifest' name='export'>
<service name='global/disable-sendmail' type='service' version='0'>
<create_default_instance enabled='true'/>
<single_instance/>
<dependency name='network' grouping='require_all' restart_on='error' type='service'>
<service_fmri value='svc:/milestone/network:default'/>
</dependency>
<method_context/>
<exec_method name='start' type='method' exec='svcadm disable sendmail' timeout_seconds='60'/>
<exec_method name='stop' type='method' exec='svcadm enable sendmail' timeout_seconds='60'/>
<property_group name='startd' type='framework'>
<propval name='duration' type='astring' value='transient'/>
<propval name='ignore_error' type='astring' value='core,signal'/>
</property_group>
<property_group name='application' type='application'/>
<stability value='Evolving'/>
<template>
<common_name>
<loctext xml:lang='C'>Disable sendmail services</loctext>
</common_name>
</template>
</service>
</service_bundle>
Next we will create the necessary networking environment for our VM's and begin to setup our Fedora/Hydra/Blacklight stack
