Cataylst Musl Stages Creation

From Gentoo Wiki
Jump to:navigation Jump to:search

This guide is intended for those that wish to build Musl stages on architectures that don't have them built by the official Gentoo build server. Throughout the guide it will be showing the process to build for a MIPS64 target but you can replace the tuple with what is required for that machine.

Create Musl Stage3 Files

Crossdev

Install sys-devel/crossdev to allow building of MIPS environment:

root #emerge --ask sys-devel/crossdev

Now, create the cross compiler:

root #crossdev -s4 -t mips64-unknown-linux-musl

If no errors were reported, move on to the next section.

Building a seed tarball

Set the system profile

For this example, the target machine is using profile 18

root #PORTAGE_CONFIGROOT=/usr/mip64-unknown-linux-musl eselect profile list
[1] default/linux/mips/17.0/o32 (exp)
 [2]   default/linux/mips/17.0/n32 (exp)
 [3]   default/linux/mips/17.0/n64 (exp)
 [4]   default/linux/mips/17.0/multilib/o32 (exp)
 [5]   default/linux/mips/17.0/multilib/n32 (exp)
 [6]   default/linux/mips/17.0/multilib/n64 (exp)
 [7]   default/linux/mips/17.0/mipsel/o32 (exp)
 [8]   default/linux/mips/17.0/mipsel/n32 (exp)
 [9]   default/linux/mips/17.0/mipsel/n64 (exp)
 [10]  default/linux/mips/17.0/mipsel/n64/systemd (exp)
 [11]  default/linux/mips/17.0/mipsel/n64/systemd/merged-usr (exp)
 [12]  default/linux/mips/17.0/mipsel/multilib/o32 (exp)
 [13]  default/linux/mips/17.0/mipsel/multilib/n32 (exp)
 [14]  default/linux/mips/17.0/mipsel/multilib/n64 (exp)
 [15]  default/linux/mips/17.0/mipsel/multilib/n64/systemd (exp)
 [16]  default/linux/mips/17.0/mipsel/multilib/n64/systemd/merged-usr (exp)
 [17]  default/linux/mips/17.0/musl/o32 (exp)
 [18]  default/linux/mips/17.0/musl/n64 (exp)
 [19]  default/linux/mips/17.0/musl/mipsel/o32 (exp)
[20] default/linux/mips/17.0/musl/mipsel/n64 (exp)

Because of the experimental flag, profile 18 in this example must be set with the --force flag.

root #PORTAGE_CONFIGROOT=/usr/mips64-unknown-linux-musl eselect profile set --force 18

Fixes

To stop errors, the following USE flags and unmask need to be set:

root #mkdir /usr/mips64-unknown-linux-musl/etc/portage/package.use
root #mkdir /usr/mips64-unknown-linux-musl/etc/portage/package.unmask
FILE /usr/mips64-unknown-linux-musl/etc/portage/package.use/system
sys-apps/util-linux -su
FILE /usr/mips64-unknown-linux-musl/etc/portage/package.unmask/kbd
sys-apps/kbd

Emerge the system

root #mips64-unknown-linux-musl-emerge -va1 @system --keep-going

Tarball creation

Create a tar.xz of the system files created ready for use later on.

root #cd /usr/mips64-unknown-musl/
root #tar -cvJf /home/USER/mips64-musl-seed.tar.xz *

Change the /home/USER part to wherever is a suitable location to store this tarball.

Qemu User Mode

Use the guide located at Embedded Handbook/General/Compiling with qemu user chroot

Catalyst

Install catalyst:

root #emerge --ask catalyst

Configure the build

First, create some directories to work in:

root #mkdir -p /var/tmp/catalyst/builds

Then, move the seed tarball:

root #mv /home/USER/mips64-musl-seed.tar.xz /var/tmp/catalyst/builds/

Next, build a portage snapshot:

root #emerge --sync
root #catalyst -s $(date +%Y.%m.%d)

Next, create the spec files

root #cd /var/tmp/catalyst
FILE stage1-mips64-musl-n64-openrc.spec
subarch: mips64_n64
target: stage1
version_stamp: musl-openrc-20221019
interpreter: /usr/bin/qemu-mips64
rel_type: default
profile: default/linux/mips/17.0/musl/n64
snapshot: 2022.10.19
source_subpath: mips64-musl-seed
compression_mode: pixz
decompressor_search_order: xz bzip2
update_seed: yes
update_seed_command: -uDN @world
FILE stage3-mips64-musl-n64-openrc.spec
subarch: mips64_n64
target: stage3
version_stamp: openrc-2022-10-19
interpreter: /usr/bin/qemu-mips64
rel_type: default
profile: default/linux/mips/17.0/musl/n64
snapshot: 2022.10.19
source_subpath: default/stage1-mips64_n64-openrc-20221019
compression_mode: pixz
decompressor_search_order: xz bzip2

Start the build

Finally, build the stage:

root #catalyst -f stage1-mips64-musl-n64-openrc.spec
root #catalyst -f stage3-mips64-musl-n64-openrc.spec

If this builds without error, then the stage3 tarball is found at /var/tmp/catalyst/builds/default

Troubleshooting

Some hints to push past some issues which can be encountered.

Autoresume

The autoresume function in Catalyst can be a blessing and a curse so removing the line autoresume from options in /etc/catalyst/catalyst.conf can allow to start from a fresh slate at the cost of undoing all previous progress.

MIPS 2GB limit

When building for a 32bit MIPS environment in QEMU user mode, there is hard limit of 2GB RAM usage. Removing -pipe from the build environment's make.conf will allow big programs like GCC to build.

qemu: qemu_thread_create: Invalid argument

Add FEATURES="-pid-sandbox" to the chroot build environment's make.conf.

CHOST changing part way through the build

You can force the CHOST inside the spec file by setting something like chost: mipsel-unknown-linux-musl if you find it has changed earlier in the build.

See also

  • Project:RelEng — the official Gentoo project focused on coordinating and improving the creation of official media releases of Gentoo Linux and other Gentoo operating systems.
  • Project:Catalyst/FAQ — contains frequently asked questions (FAQs) relating to the Catalyst tool.
  • Stage tarball — an archive of the basic files used for the installation of Gentoo Linux.
  • Catalyst — Gentoo's release building tool.