[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[PULL v2 03/15] gitlab-ci.yml: Allow custom # of parallel linkers
From: |
Alex Bennée |
Subject: |
[PULL v2 03/15] gitlab-ci.yml: Allow custom # of parallel linkers |
Date: |
Wed, 10 Mar 2021 15:59:50 +0000 |
From: Daniele Buono <dbuono@linux.vnet.ibm.com>
Define a new variable LD_JOBS, that can be used to select
the maximum number of linking jobs to be executed in parallel.
If the variable is not defined, maintain the default given by
make -j
Currently, make parallelism at build time is based on the number
of cpus available.
This doesn't work well with LTO at linking, because with LTO the
linker has to load in memory all the intermediate object files
for optimization.
The end result is that, if the gitlab runner happens to run two
linking processes at the same time, the job will fail with an
out-of-memory error,
This patch leverages the ability to maintain high parallelism at
compile time, but limit the number of linkers executed in parallel.
Signed-off-by: Daniele Buono <dbuono@linux.vnet.ibm.com>
Signed-off-by: Alex Bennée <alex.bennee@linaro.org>
Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Message-Id: <20210304030948.9367-2-dbuono@linux.vnet.ibm.com>
Message-Id: <20210305092328.31792-8-alex.bennee@linaro.org>
diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml
index 8b6d495288..814f51873f 100644
--- a/.gitlab-ci.yml
+++ b/.gitlab-ci.yml
@@ -27,6 +27,10 @@ include:
else
../configure --enable-werror $CONFIGURE_ARGS ;
fi || { cat config.log meson-logs/meson-log.txt && exit 1; }
+ - if test -n "$LD_JOBS";
+ then
+ meson configure . -Dbackend_max_links="$LD_JOBS" ;
+ fi || exit 1;
- make -j"$JOBS"
- if test -n "$MAKE_CHECK_ARGS";
then
--
2.20.1
- [PULL v2 00/15] testing, docs, semihosting move and guest-loader, Alex Bennée, 2021/03/10
- [PULL v2 02/15] tests/docker: add a test-tcg for building then running check-tcg, Alex Bennée, 2021/03/10
- [PULL v2 01/15] docs/system: add a gentle prompt for the complexity to come, Alex Bennée, 2021/03/10
- [PULL v2 03/15] gitlab-ci.yml: Allow custom # of parallel linkers,
Alex Bennée <=
- [PULL v2 06/15] .editorconfig: update the automatic mode setting for Emacs, Alex Bennée, 2021/03/10
- [PULL v2 04/15] gitlab-ci.yml: Add jobs to test CFI flags, Alex Bennée, 2021/03/10
- [PULL v2 05/15] tests/docker: Use --arch-only when building Debian cross image, Alex Bennée, 2021/03/10
- [PULL v2 12/15] docs: add some documentation for the guest-loader, Alex Bennée, 2021/03/10
- [PULL v2 13/15] tests/avocado: add boot_xen tests, Alex Bennée, 2021/03/10
- [PULL v2 07/15] hw/board: promote fdt from ARM VirtMachineState to MachineState, Alex Bennée, 2021/03/10
- [PULL v2 11/15] docs: move generic-loader documentation into the main manual, Alex Bennée, 2021/03/10