Skip to content

linuxppc/ci-scripts

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

linuxppc CI scripts

Scripts I use to do continuous integration for linuxppc.

Still (and probably always) under heavy development.

Note

The scripts notionally work with docker or podman, but they're only regularly tested with podman on Fedora.

Quick start

Make sure you can run containers.

On Fedora the scripts will use podman, on Ubuntu they use docker,

You need a Linux source tree, which hasn't been built in. You can make sure it's clean with make mrproper, or clone a fresh tree.

Clone this repo. The examples use ~/ci-scripts for brevity, but the repo can be located anywhere.

$ cd ci-scripts
$ cd build
$ make pull-image@ppc64le@fedora
$ make SRC=~/src/linux kernel@ppc64le@fedora JFACTOR=$(nproc)

This will build you a ppc64le_defconfig using the latest Fedora toolchain.

The kernel will be in ~/ci/scripts/build/output/latest-kernel/vmlinux.

For more help try make help.

Building different defconfigs

You can specify a defconfig with DEFCONFIG.

$ make SRC=~/src/linux kernel@ppc64le@fedora DEFCONFIG=powernv_defconfig JFACTOR=$(nproc)

Note that the subarch (eg. ppc64le) needs to match the defconfig, so to build ppc64_defconfig, use ppc64.

$ make SRC=~/src/linux kernel@ppc64@fedora DEFCONFIG=ppc64_defconfig JFACTOR=$(nproc)

Different toolchains

There are images for various toolchains, they are encoded in the distro name/version.

Only the Ubuntu toolchains can build the selftests.

Building selftests

To build the kernel selftests:

$ make SRC=~/src/linux selftests@ppc64le@ubuntu JFACTOR=$(nproc)

Or just the powerpc selftests:

$ make SRC=~/src/linux ppctests@ppc64le@ubuntu JFACTOR=$(nproc)

You can also build the powerpc selftests with all available toolchains using:

$ make SRC=~/src/linux ppctests JFACTOR=$(nproc)

Other options

As mentioned above you pass the make -j factor with JFACTOR=n.

To run sparse use the fedora image and pass SPARSE=2.

$ make SRC=~/src/linux kernel@ppc64le@fedora SPARSE=2 JFACTOR=$(nproc)

The log will be in eg. ~/ci-scripts/build/output/latest-kernel/sparse.log.

To only run sparse on files being recompiled, pass SPARSE=1.

To build modules pass MODULES=1

To convert all modules to builtin, pass MOD2YES=1.

To build with clang pass CLANG=1, only works using the latest Fedora or Ubuntu image.

For a quiet build pass QUIET=1, for verbose pass VERBOSE=1.

By default the script does an incremental build, ie. it doesn't clean. You can clean before building by passing PRE_CLEAN=1, or afterward with POST_CLEAN=1.

Alternately you can clean everything with make clean.

Multiple builds

If you have enough CPU and disk space, you can run multiple builds at once. The output directory is namespaced based on the subarch, distro, version, and defconfig.

Building your own image

If you don't want to pull an untrusted image, you can build it yourself with:

$ make rebuild-image@ppc64le@fedora

Note that the build mounts the source tree read-only, so nothing it does can affect your source tree.

Bisecting the kernel vs a selftest

Build the selftests using a version of the test that's known good. Usually there's no reason to rebuild the tests on every kernel revision.

These examples are run from the kernel directory, not the ci-scripts directory. It can be done either way, but it's more natural to run from the kernel directory when bisectting the kernel. This assumes Linux is in ~/linux and these scripts are in ~/ci-scripts, adapt as appropriate.

$ cd ~/linux
$ make SRC=$PWD -C ~/ci-scripts/build QUIET=1 JFACTOR=$(nproc) ppctests@ppc64le@[email protected] INSTALL=1

Note

🚨 Building the selftests with Ubuntu 22.04 uses glibc 2.35. The default rootdisk uses glibc 2.36, so there should be no issue with missing symbols in glibc. If using another root disk you may need to build with an older Ubuntu image. Another option is to build the selftests statically.

Tar up the selftests into the current directory, the qemu scripts will detect them:

$ tar -czf selftests.tar.gz -C $HOME/ci-scripts/build/output/latest-selftests/ install
$ ~/ci-scripts/scripts/boot/qemu-pseries+kvm --callback "run_selftests(powerpc/mm:wild_bctr)"
...
INFO: Running 'qemu-system-ppc64 -nographic -vga none -M pseries -smp 8 -m 4G -accel kvm ...
...
/ # INFO: Running individual selftests powerpc/mm:wild_bctr
/var/tmp/selftests/run_kselftest.sh -t powerpc/mm:wild_bctr
[    2.783761][  T201] kselftest: Running tests in powerpc
TAP version 13
1..1
# timeout set to 300
# selftests: powerpc/mm: wild_bctr
# test: wild_bctr
# tags: git_version:v6.8-rc6-2555-gfe559db
# Everything is OK in here.
...
# success: wild_bctr
ok 1 selftests: powerpc/mm: wild_bctr
/ # poweroff
/ # Stopping network: [    3.104385][  T274] ip (274) used greatest stack depth: 10912 bytes left
OK
Saving random seed: OK
Stopping klogd: OK
Stopping syslogd: OK
umount: devtmpfs busy - remounted read-only
umount: can't unmount /: Invalid argument
The system is going down NOW!
Sent SIGTERM to all processes
Sent SIGKILL to all processes
Requesting system poweroff
[    5.152672][  T293] reboot: Power down
INFO: Test completed OK

More than one selftest can be run by passing multiple arguments to run_selftests or by passing multiple --callback options.

From there the bisection can either be run by hand, or fully automated by creating a script to build the kernel and run the qemu test.

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Languages

  • Python 62.5%
  • Shell 25.4%
  • Makefile 8.9%
  • Dockerfile 3.2%