Difference between revisions of "Genkernel"
|(One intermediate revision by one other user not shown)|
Revision as of 02:17, 20 June 2014
- configuring the kernel sources
- building the bzImage compressed kernel and copying it to /boot
- creating an initramfs and copying it to /boot
- creating symlinks in /boot
- adding custom content to the initramfs such as encryption related files, splash images, extra modules and more.
- compressing the initramfs
- configuring the bootloader
- 1 Installation
- 2 Genkernel Invocation
- 3 Using Genkernel
- 3.1 Genkernel First Invocation
- 3.2 Using Genkernel to change your kernel
- 3.2.1 File Management by genkernel
- 3.2.2 Configuring the bootloader
- 3.2.3 Preserving your working files
- 3.3 Using previous kernel configuration while changing the sources
- 4 Network Booting with Genkernel
- 4.1 Network Booting with Genkernel from an Installation CD
- 4.2 Building Kernel and Initrd Images with Support for Netbooting
- 4.3 NFS setup
- 4.4 DHCP setup
- 4.5 Netbooting Instructions
- 4.6 Booting a genkernel initramfs
- 5 Acknowledgements
To install sys-kernel/genkernel, first select the proper USE flags.
|crypt||No||No||Obsolete USE flag. Use cryptsetup for LUKS support. (bug ##414523)|
|cryptsetup||No||No||Enable support for Luks disk encryption using sys-fs/cryptsetup|
|ibm||No||No||Add support for IBM ppc64 specific systems|
|selinux||No||No||!!internal use only!! Security Enhanced Linux support, this must be set by the selinux profile or breakage will occur|
Then the installation of the genkernel software can be executed.
The general form of genkernel invocation is as follows:
The actual behavior of genkernel depends on a large variety of options, the majority of which can be set/unset in the /etc/genkernel.conf file or passed via the
genkernel command. Options passed over the command line take precedence over options defined into /etc/genkernel.conf. This file is very well documented but let's examine some of the most commonly used ones here. For a more complete explanation, please refer to the comments in /etc/genkernel.conf itself or to the output of the
man genkernel command.
Options acting on user interactivity
The configuration options listed below help decide how to interact with the configuration process. Users can even choose whether or not the configuration file created in the process should be saved. The following are the primary configuration options:
- Activates [ or deactivates] the
make menuconfigcommand (which invokes an interactive configuration menu) before building the kernel.
- Provides a kernel configuration utility which depends on the GTK+ libraries. The advantage of this option is that most users find it easier and clearer to configure the kernel using this tool, since it relies on the X-windowing system. The disadvantage of this option is that you need the X-windowing system to use it, so it will not work on the command line.
- Provides a kernel configuration utility which depends on the QT libraries. The advantage of this option is that most users find it easier and clearer to configure the kernel using this tool, since it relies on the X-windowing system. The disadvantage of this option is that you need the X-windowing system to use it, so it will not work on the command line.
- Saves [or does not save] the kernel configuration to a file in the /etc/kernels directory for later use.
- Allows the modification of the name of the kernel and initrd images in the /boot directory, so that the images produced are kernel-<NickName>-version and initramfs-<NickName>-version.
Options acting on the resulting system
The configuration options listed here defines which features will, or won't be enabled in the resulting kernel and initrd.
- Activates [or deactivates] support for Fbsplash framebuffer splash in the genkernel-built initrd image. To override the default theme used by fbsplash, use --splash=<PreferredTheme> (where <PreferredTheme> is the title of one of the directories inside the /etc/splash directory.
- This option allows to select which splash screen resolutions will be supported in the initrd during the start-up of the system. This is useful for two reasons. First, to be able to select only the splash screen resolution(s) relevant to the system. Second, to avoid the unnecessary increase in the disk space required by initrd (since the initrd does not have to support resolutions that are irrelevant for your system configuration.) However, the option is best omitted if the kernel is being compiled for an Installation CD; this allows splash support for all possible resolutions.
- Force keymap selection during the boot sequence.
- Includes support for storage using via Logical Volume Management (LVM2) from static binaries, if available to the system. Relevant (static) LVM2 binaries are compiled if they are unavailable. Be sure to install the lvm2 package on your system with emerge lvm2 before enabling this option, and review the LVM article on the Gentoo wiki.
- Includes support for DMRAID; the utility which creates RAID mappings using the kernel device-mapper subsystem. DMRAID discovers, activates, deactivates and displays properties of software RAID sets (ATARAID, for example) and contained DOS partitions.
- Includes support for Linux Unified Key Setup or LUKS. This will allow to use a device encrypted by LUKS which contains the root filesystem. On the bootloader, set that encrypted device as the value of
real_rootshall be the unencrypted device LUKS creates).
- Adds support for disk label and UUID support to the initrd.
- Adds support for iSCSI to the initrd.
- Adds support for Multipath to the initrd.
- Specifies a user-created linuxrc — a script that is initialized during the start-up stage of the kernel, prior to the actual boot process. (A default linuxrc script should be in the /usr/share/genkernel/ directory.) This script allows to boot into a small, modularized kernel and load the drivers that are needed (as modules) by the system.
- Overrides the default cache location used while compiling the kernel.
- Specifies the location of the temporary directory used by genkernel while compiling the kernel.
- Includes support for the Unification File System in the initrd image.
- Detects whether or not the /boot directory needs to be mounted on a separate partition. It will check /etc/fstab script for instructions on how to mount the boot partition on a file system (if needed).
Options acting on the choice of the tools used for building
The following options are supported by genkernel, and are passed to the relevant applications while the kernel is being assembled. These options affect the compiling tools used for the kernel compilation process, albeit at a much lower level.
- Specifies the compiler employed during the kernel compilation process.
- Specifies the linker employed during the kernel compilation process.
- Specifies the assembler employed during the kernel compilation process.
- Specifies an alternative to the GNU make utility employed during the kernel compilation process.
- Specifies the compiler employed during the compilation of support utilities.
- Specifies the linker employed during the compilation of support utilities.
- Specifies the assembler employed during the compilation of support utilities.
- Specifies an alternative to the GNU make utility employed during the compilation of support utilities.
- Specifies the number of concurrent threads that the make utility can implement while the kernel (and utilities) are being compiled. The variable
Xis a number to be freely chosen, although the most common values are obtained by adding one (1) to the number of cores used by the system, or just use the number of cores on the system. So, for a system with one core, most common option values are
-j1; a system with two cores most likely uses the
-j2options, and so on. (A system with one processor that supports Hyper-Threading™ (HT) Technology can be assumed to have 2 cores, provided Symmetric Multi-Processing (SMP) support is enabled in the kernel.)
Options acting on the compilation process
The following options usually take effect during the actual compilation:
- Specifies an alternative kernel source location, rather than the default /usr/src/linux/ location.
- Specifies what alternative kernel configuration will be used, rather than the default /path/to/sources/.config file.
- Specifies a prefix to the directory where kernel modules will be installed (default path is the /lib/modules directory.)
- Activates [or deactivates] the
make cleancommand before compiling your kernel. The
make cleancommand removes all object files and dependencies from the kernel's source tree.
- Activates [or deactivates] the
make mrpropercommand before kernel compilation. Like the
make mrproperremoves all object files and dependencies from the kernel's source tree. However, any previous configuration files (in /path/to/sources/.config or /path/to/sources/.config.old) will also be purged from the kernel's source tree.
- Issues the
make oldconfigcommand, which attempts to collect configuration information for the system's architecture from a generic script in /usr/share/genkernel. This is a non-interactive process; no user input is entertained. Also, if --oldconfig is used in conjunction with --clean, the latter option is negated, resulting in the activation of the --no-clean option.
- --callback="echo hello"
- Calls the specified arguments (
echo hello, in this case) after the kernel and the relevant modules have been built, but before building the initrd image. This may be useful if you want to install external modules in the initrd image by emerging the relevant item(s) with the callback feature, and then redefining a genkernel module group.
- Activates [or deactivates] the make install command, which installs your new kernel image, configuration file, initrd image and system map onto your mounted boot partition. Any compiled modules will be installed as well.
- Refrains from copying any modules to the genkernel-created initrd image. This option is an exception to the rule about the no- prefix; omission of this prefix creates an invalid genkernel option.
- Copies all available modules to the genkernel-created initrd image.
- Creates the initrd image, prior to the kernel image. (This hack currently applies only to PPC Pegasos systems.)
The use of debugging options during the kernel compilation process controls the amount of information reported, as well as the presentation of said data.
- Controls the level of verbosity for information provided by genkernel. The variable
<verblevel>is an integer between 0 and 5. The level '0' represents minimal output, while '5' provides as much information as possible about genkernel's activities during the kernel compilation process.
- Ignores the value set by the --loglevel argument, and sends all debugging data produced by genkernel to the specified output file, which is located at /var/log/genkernel.log by default.
- Activates (or deactivates) colored output of debugging information (reported by genkernel) using escape sequences.
The action passed on the command line with the
genkernel [options …] action command, tells
genkernel what to do - the following actions are supported:
- Builds all stages — the initrd, kernel image and modules.
- Only builds the kernel image
- Only builds the kernel image and modules
- Only builds the initramfs/ramdisk image
- Only builds the initramfs/ramdisk image
Genkernel First Invocation
Although there are several ways to run genkernel, the least-intrusive approach recommended for most users is provided by
genkernel all. Here, a generic configuration which works well for most systems is used. As was mentioned earlier, this approach is not without drawbacks; most of the modules created are useless to the average user and may increase compile time. Below is an illustration of a more efficient approach, achieved by passing certain options to genkernel as root:
The above operation causes genkernel to create a framebuffer splash-enabled kernel (--splash) that will have to be manually installed (--no-install). While preparing the kernel source tree, genkernel will refrain from cleaning out any preexisting object files present in the source tree (--no-clean). A menu-driven kernel configuration utility will be displayed that allows the user to select which modules will be built for the system (--menuconfig).
Replacing --no-install with the --install option allows genkernel to automatically install the new kernel in the /boot directory, and will create symlinks for you if --symlink is specified. Using the --mountboot option allows genkernel to mount the /boot partition automatically, if necessary.
Using Genkernel to change your kernel
The first thing that should be done is to allow the triggering of
make menuconfig in the /etc/genkernel.conf file:
File Management by genkernel
While using genkernel, the user has to be aware of some aspects relating to kernel configuration and kernel image files management and the way the kernel sources are handled by the system.
Source Files used by genkernel
emerge -u gentoo-sources, whenever new sources are available, a new kernel source directory is created under /usr/src/ to host them. Normally, the active kernel sources directory is pointed to by the /usr/src/linux symlink.
The /usr/src directory might look like this:
The linux symlink can be changed in different ways.
- If the
symlinkUSE flag is set in /etc/portage/make.conf, the linux symlink is automatically updated to point to the newly emerged sources.
- If the previous USE flag is not set, the user can change the destination of the symlink using the
eselect kernel listcommand.
Whatever it is,
genkernel always uses the sources pointed by this symlink.
Kernel Configuration file used by genkernel
If a kernel compilation has already been run with the active kernel sources, there might be a file inside the /etc/kernels directory that contains the kernel configuration that has been applied while creating the last bzimage of the kernel. This file is named, for example kernel-config-x86_64-3.7.9-gentoo-r1 where x86_64 might be substituted with your architecture, 3.7.9 might be substituted with the version of the sources you are using and r1 with the release of the sources..
It is this kernel-config-x86_64-3.7.9-gentoo-r1 file that is used as a starting configuration when running
genkernel --menuconfig all}}.
If it is the first time that
genkernel is run with the new kernel sources, or if the previous result has not been saved, this file is substituted with a default configuration file that resides at usr/share/genkernel/arch/x86_64/kernel-config where x86_64 is substituted with the actual architecture.
Saving the compiled configuration
save-config genkernel option is activated, either from the command line or inside /etc/genkernel.conf, the compiled kernel configuration is saved (with the name given above) into the /etc/kernels directory. At the same time, the configuration is saved in the .config file in /usr/src/linux directory but this file is not reused on the next
genkernel all run.
Installing the kernel and initramfs into the /boot directory
all action specified when invoking genkernel, ask
genkernel to install the kernel image and the initramfs into the /boot directory. In order to do it in a convenient manner, set the following in the /etc/genkernel.conf file:
- The first parameter speaks by itself.
- The second parameter tells genkernel to save the compiled kernel configuration into /etc/kernels.
- The last two options tell genkernel to automatically update the grub configuration. In practice, the following happens:
- if a previous kernel image with the same name already exist, it is renamed by appending .old to its name. A symlink kernel.old is automatically created that points to it.
- the new kernel takes the place of any kernel with the same name into /boot. If it is the first time a kernel is compiled, a symlink kernel is automatically created that points to the new kernel.
genkernel --menuconfig all, the /boot directory might look like this:
Configuring the bootloader
The symlinks presented above in the bootloader's configuration can be used so that, even if the new kernel is not bootable, the user can always boot on the old one.
To allow the kernel and intird provided by genkernel to run correctly, provide a minimum information in your bootloader configuration file :
real_root=/dev/sdaxto the kernel parameters passed to the kernel image, where /dev/sdax points to the root partition.
- If splash is used, add a suitable mode line such as
vga=0x317to the parameters passed to the kernel and also add
splash=silentdepending on the verboseness required through the boot process.
- Add the initrd information as required by the bootloader. Consult the Bootloader Configuration Chapter of the Gentoo Handbook for details on how to make your bootloader initrd-aware.
Here is how the grub.conf file might look.
Preserving your working files
The genkernel application automatically saves new changes to the files. If previous changes are to be preserved, then the following actions need to be taken.
- The first file to preserve is the kernel configuration file in /etc/kernels/. If the source hasn't changed prior to the recompilation of the kernel, the previously used name for this file will be used. So copying the previous configuration file under a different name helps in preserving the information while keeping the file available as a starting point for a new configuration.
- The second important thing is to preserve the already bootable kernel and initramfs images. The way to accomplish this depends on the context:
- If the last kernel compiled is bootable, running
genkernelwill rename this kernel (and similarly initramfs) image to kernel-genkernel-ARCH-X.Y.Z-gentoo-rx.old and create a new kernel-genkernel-ARCH-X.Y.Z-gentoo-rx. This mean that even if the new kernel is not bootable, users will always be able to boot the old one.
- If the last kernel compiled is not bootable and sources haven't changed since the user compiled a bootable one, prior to running
genkernel, first delete the new kernel image and remove the .old suffix from the last bootable one. Without this, if the newly compiled kernel is not bootable for the second time, the bootable kernel-genkernel-ARCH-X.Y.Z-gentoo-rx.old will be kicked out by the renaming of the non bootable kernel-genkernel-ARCH-X.Y.Z-gentoo-rx, giving the user an unbootable system. Use the same reasoning for initramfs.
- If the last kernel compiled is bootable, running
Using previous kernel configuration while changing the sources
The previous configuration can be used through the
make menuconfig option in your /etc/genkernel.conf as follows:
Network Booting with Genkernel
Network Booting with Genkernel from an Installation CD
The genkernel utility can build kernel and initrd images that provide support for network booting, or netbooting. With any luck, users should be able to netboot any recent computer into the environment provided by the Installation CD.
The magic lies in genkernel's linuxrc script: it will try to netmount the Installation CD using NFS. From there, the init scripts of the Installation CD can take over, as if the CD was present locally.
Building Kernel and Initrd Images with Support for Netbooting
To enable support for netbooting, include the following options while configuring the kernel:
First, the kernel image must include the drivers for your Network Interface Cards (NIC). Normally, drivers for such devices will be compiled as modules. However, it is essential (for netbooting) that such drivers are compiled directly into the kernel image and not as modules.
Be sure to select <*> and not <M>.
Secondly, it is suggested that IP: kernel level autoconfiguration is enabled as well as IP: DHCP support options. This avoids an unnecessary layer of complexity since the IP address and the NFS path to the Installation CD can be configured on a DHCP server. Of course, this means the kernel command line will remain constant for any machine — which is very important for etherbooting.
These options tell the kernel to send a DHCP request at bootup.
Additionally, enable SquashFS because most modern Gentoo Installation CDs require it. Support for SquashFS is not included with the generic kernel source tree. To enable SquashFS, apply the necessary patches to the generic kernel source or install gentoo-sources.
Once the compilation process is completed, create a compressed tarball (tar.gz) that contains the kernel's modules. This step is only necessary if the kernel version does not match the kernel image version on the Installation CD.
To create an archive containing all the modules:
Depending on the network boot mechanism, one of the following steps need to be followed:
To create an etherboot image:
To create a OpenBoot / SPARC64 TFTP image:
The openboot.img file is the boot image.
Finally, copy this kernel to the TFTP server. The details are architecture-dependent and are beyond the scope of this guide. Please refer to the documentation for your platform.
To setup a NFS share that contains the Installation CD, use the loop device to mount the ISO image and then copy the contents of the CD into the NFS share. As a nice extra, genkernel's initrd scripts will extract all tar.gz files located in the /nfs/livecd/add/ directory. All that needs to be done here is copy the modules-X.Y.Z.tar.gz archive to the /nfs/livecd/add/ directory.
The following assumes that /nfs/livecd is an exported NFS share:
Now copy the modules.tar.gz file into /add:
The netboot images will ask the DHCP server on the network for an IP as well as a root-path parameter. Both can be specified per host using a MAC address to identify machines:
Netbooting itself is again very platform-specific. The important part is to specify the
init=/linuxrc parameters on the kernel command line, as this will bring up the network interface and tell the initrd scripts to mount the Installation CD via NFS. Here are some platform-specific tips.
For etherboot, insert the etherboot disk into the drive and reboot. The kernel command line was specified when the image was constructed.
With Sparc64, hit Stop-A at the boot prompt and enter:
For PXE, setup pxelinux (part of syslinux), then create a pxelinux.cfg/default along the lines of:
Booting a genkernel initramfs
If an initramfs is installed with genkernel, then take a look at the various boot options that can (or should) be defined in the bootloader configuration. The most common ones are added to this guide.
Loading LVM or software-RAID
If the system uses LVM or software-RAID, the initramfs has to be built using the --lvm and --mdadm options. Don't forget to enable support during boot as well. This can be done using the dolvm and domdadm options.
Booting in single-user mode
If for some reason boot-up fails, rescuing the system by booting in the single-user mode is still possible. This will only load the really necessary services and then drop the user to a rescue (root) shell.
We would like to thank the following authors and editors for their contributions to this guide:
- Tim Yamin
- Jimi Ayodele
- Thomas Seiler
- Joshua Saddler
- Sebastian Pipping
- José Fournier