Commit Graph

63477 Commits

Author SHA1 Message Date
Thomas Perrot
aeb712ebb0 ruby: fix the reproducibility issue
Apply some changes on the Ruby makefiles in order to fix the reproducibility:
- use a fixed timestamp,
- sort linked objects,
- doesn't use the current date,
- and use UTC date.

[YOCTO #14268]

(From OE-Core rev: 59b07ab51ff932a4632a31675445ba4192bae36b)

Signed-off-by: Thomas Perrot <thomas.perrot@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-01 14:51:45 +01:00
Joshua Watt
3115aa157d python3: Fix sysroot reproducibility
Fixes the reformatting of the sysconfigdata to be reproducible in the
sysroot as well as in the package. During this a bug was uncovered in
the way that the data was reformatted where it appears that python
cannot parse a single line of code over 40000 characters. To work around
this, pass a maximum with of "1" to pprint instead of sys.maxsize which
will cause it to wrap as often as possible and should keep it
reproducible.

(From OE-Core rev: 2def2c145c303f27d93ba73876d4c6b214f18166)

Signed-off-by: Joshua Watt <JPEWhacker@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-01 14:51:45 +01:00
wangmy
cf08db9f83 strace: upgrade 5.13 -> 5.14
Improvements

Implemented decoding of memfd_secret and quotactl_fd syscalls, introduced in Linux 5.14.
Enhanced prctl syscall decoding.
Enhanced decoding of IFLA_* netlink attributes.
Enhanced decoding of MDBA_ROUTER_PATTR_* mdb router port netlink attributes.
Updated lists of BPF_*, IORING_*, MADV_*, MOUNT_ATTR_*, SCTP_*, and UFFD_* constants.
Updated lists of ioctl commands from Linux 5.14.
Bug fixes

Fixed build using bionic libc.

(From OE-Core rev: bca3d163d9ed804b4c734ac8fe4fa96e1d05906d)

Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-01 14:51:45 +01:00
Thomas Perrot
c619d748ab libevent: mark util/monotonic_prc_fallback as retriable
Backport a patch to fix the below ptest failure:
 # ./run-ptest
 Running tests:
 EVPORT
 Skipping test
 KQUEUE
 Skipping test
 EPOLL
 test-eof: OKAY
 test-dumpevents: OKAY (output not checked)
 regress:
  FAIL ../libevent-2.1.12-stable/test/regress_util.c:1478: assert(diff.tv_sec == 0): 1 vs 0 util/monotonic_prc_fallback:
  [monotonic_prc_fallback FAILED]
 1/312 TESTS FAILED. (33 skipped)
 FAILED
 regress_debug:
  FAIL ../libevent-2.1.12-stable/test/regress_util.c:1478: assert(diff.tv_sec == 0): 1 vs 0 util/monotonic_prc_fallback:
  [monotonic_prc_fallback FAILED]
 1/312 TESTS FAILED. (33 skipped)
 FAILED
 [snip]

(From OE-Core rev: edecbbdacab5227c75e4a199e124389f8036b421)

[YOCTO #14507]

(From OE-Core rev: cae0eb03e8e754bd77651fc017b2669f8fd57f75)

Signed-off-by: Mingli Yu <mingli.yu@windriver.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Thomas Perrot <thomas.perrot@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-01 14:51:45 +01:00
Kristian Klausen
3ac9722e0f ovmf: add TPM PACKAGECONFIG and enable if tpm is in MACHINE_FEATURES
By enabling TPM support the boot will be measured into the TPM's
Platform Configuration Registers (PCRs).

(From OE-Core rev: e71280883c217d86b4636da6e549334183f1aff7)

Signed-off-by: Kristian Klausen <kristian@klausen.dk>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-01 14:51:45 +01:00
Chandana kalluri
327ea9d446 scriptutils.py: Add check before deleting path
Add a check before deleting path when using recipetool commands to avoid the following type of errors:

Traceback (most recent call last):
   File "<workdir>/sources/core/scripts/lib/scriptutils.py", line 218, in fetch_url
    shutil.rmtree(path)
  File "/usr/local/lib/python3.7/shutil.py", line 476, in rmtree
    onerror(os.lstat, path, sys.exc_info())
  File "/usr/local/lib/python3.7/shutil.py", line 474, in rmtree
    orig_st = os.lstat(path)
FileNotFoundError: [Errno 2] No such file or directory: '<workdir>/build/tmp/work/recipetool-usg7o81n/work/recipe-sysroot'
ERROR: Command 'script -e -q -c "recipetool --color=always create --devtool -o /tmp/devtool5sq_op37 'file:///<SRCTREE>'  -x <workdir>/build/workspace/sources/devtoolsrcxc1b9zjq -N test" /dev/null' failed

(From OE-Core rev: b6aa8b47e023004ffd6958d1cec18c2d9c95d77b)

Signed-off-by: Sai Hari Chandana Kalluri <chandana.kalluri@xilinx.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-01 14:51:45 +01:00
Minjae Kim
59a0f26b8a vim: fix CVE-2021-3778
vim is vulnerable to Heap-based Buffer Overflow

reference:
65b6056659
(From OE-Core rev: 494929c4cec21712884e13172c37efad7c908411)

(From OE-Core rev: d7fac573f1e1c9cd93181bce60df5666f5b5b03f)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-29 21:47:46 +01:00
Anibal Limon
35b8966e61 recipes-support/ptest-runner: Bump to v2.4.2
Changes,

bcb8280 utils.c: add system data collection when a test gets stuck.
c29240c utils.c: handle test timeouts directly with poll()
d6f509f tests/utils.c: fix a memory corruption in find_word
c10e747 main: Do not return number of failed tests when calling ptest-runner
4958988 utils.c: fix memory leak in run_ptests()
fcfa6a1 clang: clean-ups to avoid -Weverything warnings.
215e52d Makefile: allow using CC env var to pick compiler
fdd233d mem: Simplify memory management
e5e218a mem: Fix memleak for ptest_opts
0dc42eb git: Extend the gitignore

(From OE-Core rev: 710fa373375beb977af704e17a925ed41c9a858d)

Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-29 21:47:45 +01:00
William A. Kennington III
3af6389ece rm_work.bbclass: Fix for files starting with -
This makes it possible to name files starting with a hyphen in the work
directory. Without this change rm will fail due to an unexpected option
being passed.

(From OE-Core rev: 5f1a63e0de4921ef970114a16d0827fcddcdaa0e)

Signed-off-by: William A. Kennington III <wak@google.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-28 17:55:04 +01:00
Joshua Watt
17bd442f1a lib/oe/spdx.py: Add comments
Adds several comments to this file to explain the intention and how it
should be used

(From OE-Core rev: 0be0ba70e68b57a3617d3c1ea4b6233b37d5d648)

Signed-off-by: Joshua Watt <JPEWhacker@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-28 17:55:04 +01:00
Saul Wold
6d98af48f4 create-spdx: Use SPDXAnnotation to track native recipes
Create a small function that checks for 'isNative' as part of an Annotation

When the collect_dep_sources() runs, it collects sources from both native
and non-native recipes. Later when the GENERATED_FROM matching occurs it
may find the file (via checksum) from the native recipe since it's the
same checksum as the target file. The that are generated DocumentRefs
point to the native recipe rather than the target recipe DocumentRef.

(From OE-Core rev: ba5ec03986a0bce8dccbc381fd34e44b8a135e66)

Signed-off-by: Saul Wold <saul.wold@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-28 17:55:04 +01:00
Saul Wold
859e6a0d00 spdx.py: Add SPDXAnnotation Object
This is added to allow the create-spdx code to create annotations
that store values properly according to the SPDX Specification.

Initialy they will be used to track if a recipe is a native type.

(From OE-Core rev: 8db551bba619f3b3612c59270043148214a462cc)

Signed-off-by: Saul Wold <saul.wold@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-28 17:55:04 +01:00
Kenfe-Mickael Laventure
64ebd0d97c package_ipk: Use localdata store when signing packages
When signing a package, we were resolving the `PKGV` version using the
original data store (`d`). However, since that store does not have the
package name in its `OVERRIDES` list the wrong version can be returned in
recipes that produce multiple packages. One such example would be
`external-arm-toolchain.bb`.

The above issue is fixed by using `localdata` instead of `d` when
resolving the needed variables.

(From OE-Core rev: 2b5f01cf5a92a873ac4c3f0ba0584cab2cc05714)

Signed-off-by: Kenfe-Mickael Laventure <mickael.laventure@verkada.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-28 17:55:04 +01:00
Saul Wold
0e80ffc6c8 spdx-licenses.json: Use 3.14 tagged version
The validation tools expect the licenseListVersion to be a proper X.Y version,
not an intermedite git hash version.

(From OE-Core rev: b96bb3fe6e17a194db0dcb86d2877946eaa77341)

Signed-off-by: Saul Wold <saul.wold@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-28 17:55:04 +01:00
Richard Purdie
da9409d26e glew: Stop polluting /tmp during builds
Currently the glew code creates a new directory in /tmp for each make
invocation. This is a bit ugly, don't do that. The patch does break the
dist targets but we don't use them.

(From OE-Core rev: 3a55194f90e11da5671b24391a4aaf2b86a8e1e6)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-28 17:55:04 +01:00
Trevor Woerner
4ba745f828 hello-mod/hello.c: convert printk to pr_xxx
Convert to the newer pr_xxx aliases for logging, which embed the log level in
the macro names.

(From OE-Core rev: be119ead6d5bb01a50f78fd34024ded1289c9fd7)

Signed-off-by: Trevor Woerner <twoerner@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-28 17:55:04 +01:00
Rasmus Villemoes
165b089a7d kernel.bbclass: remove unnecessary dead code
The grep pattern seems to have been wrong ever since we stopped adding
the -ffile-prefix-map via a patch in commit 20aea61385e, because the
actual upstream gcc produces

  -ffile-prefix-map=<old>=<new>

and not

  -ffile-prefix-map=<old=new>

Besides, these *-prefix-map options are already used when building the
kernel due to the setting of KERNEL_CC, and the kernel build system
itself also probes for and uses at least -fmacro-prefix-map (hence
taking care of __FILE__ etc., but not necessarily things that go in
.debug_info sections).

(From OE-Core rev: 5d56de8cd653d2a3a7f4c104d50c14e22d412f66)

Signed-off-by: Rasmus Villemoes <rasmus.villemoes@prevas.dk>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-28 17:55:04 +01:00
Michael Halstead
0afeb9f740 releases: update to include 3.1.11
Adding 3.1.11 to documentation switcher and release list.

(From yocto-docs rev: 29fb29547322520698b13a4d7c94dbb8defa93b1)

Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-28 07:49:57 +01:00
Richard Purdie
a3d96f122c oeqa/selftest/tinfoil: Update to use test command
We've had IO load issues on the autobuilder with this test. Avoid
those by using a specilised test command instead.

(From OE-Core rev: 106445b1eb74fc37e03c72a0c011541b50a16c19)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 16:35:00 +01:00
Markus Volk
37b4fa7a10 wic:direct.py: ignore invalid mountpoints during fstab update
wic fstab-update creates invalid entries for partitons that are not supposed to
be mounted from userspace eg u-boot partitions.

The following lines were added to fstab on a rock-pi-4:
/dev/mmcblk1p1 loader1 vfat defaults 0 0
/dev/mmcblk1p2 reserved1 vfat defaults 0 0
/dev/mmcblk1p3 reserved2 vfat defaults 0 0
/dev/mmcblk1p4 loader2 vfat defaults 0 0
/dev/mmcblk1p5 atf vfat defaults 0 0
/dev/mmcblk1p6 /boot vfat defaults 0 0

With this patch only valid entries should be added
/dev/mmcblk1p6 /boot vfat defaults 0 0

(From OE-Core rev: 7aa678ce804c21dc1dc51b9be442671bc33c4041)

Signed-off-by: MarkusVolk <f_l_k@t-online.de>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 16:35:00 +01:00
Richard Purdie
c4f0ccb561 libc_package/buildstats: Fix python regex quoting warnings
(From OE-Core rev: 6a8077317ce12e13018ec4472f728dd24880bda9)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 16:35:00 +01:00
Richard Purdie
694a1ae8f8 oeqa/buildproject: Ensure temp directories are cleaned up
(From OE-Core rev: d10aff865120a5feecc42c24726bd119364e0188)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 16:35:00 +01:00
Richard Purdie
4252b89865 oeqa/selftest/gotoolchain: Fix temp file cleanup
The go tests leave readonly files and directories behind.
Fix this to allow cleanup.

[YOCTO #14575]

(From OE-Core rev: 5680e95d7bd9fe00a797b2d0deb8cb4790027508)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 16:35:00 +01:00
Richard Purdie
2446bdf59a bitbake: cooker/command: Add a dummy event for tinfoil testing
We need a command genetating an event to test through the tinfoil API. The
current test has IO load issues so add a dummy version which won't have
the IO constraints.

(Bitbake rev: a144178584394ea0700ffc2f2bfac94e8690effc)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 16:35:00 +01:00
Richard Purdie
72e03d8a91 bitbake: siggen: Fix sorting in diff output
The diff output isn't deterministic at the moment as the sets can have differing
ordering. Sort the output so it is consistent.

(Bitbake rev: 117830c1d7ef3e53052fa326e1ca62c5c3946c45)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 14:37:34 +01:00
Richard Purdie
eab1c2087f bitbake: bitbake-worker: Allow shutdown/database flush of pseudo server at task exit
We have a problem where pseudo server processes exist after bitbake exits
and hold the pseudo database in memory. In a docker container, the processes
will be killed as the container is destroyed with no warning and no opportunity
to write the data to disk. This leads to permissions/inode corruptions and
data loss.

Send a shutdown message to pseudo which in new versions of pseudo will flush
the database, thereby fixing some of the issues people using docker containers
see.

(Bitbake rev: a07a971b40acd3eee12e203d2cfa3e49f56109f6)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 14:37:34 +01:00
Bruce Ashfield
2692037fec yocto-bsp/5.13: drop recipes
5.13 has been removed from core, and we've moved the default
support to 5.14, so we can drop our bbappend.

(From meta-yocto rev: 5cb9ef98c90321ae5d57123d82b68f14e6c85f39)

Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 14:37:05 +01:00
Richard Purdie
4e5321e4bb packagegroup-core-tools-profile: Exclude systemtap from riscv32 as well
The recipe can't be built for riscv32 so exclude it alongside riscv64.

(From OE-Core rev: 61feb650ac450db0a30675fc40bb65fab773159a)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 14:36:48 +01:00
Matt Madison
d6a0c61432 autotools.bbclass: use ordinary append for file-checksums update
Commit 29daffc2410f06f36b779d5bf1fd1ef6e900ca8f added an
anonymous python function to append the site file dependencies
for do_configure. This causes any recipe that inherits allarch
after autotools to end up with a different set of file checksums
for each machine, since the anonymous python would get processed
before the TARGET_ARCH changes in allarch.

Use an ordinary += assignment to fix this.

(From OE-Core rev: 60af398f520c938600205ef40e27f90e5342209c)

Signed-off-by: Matt Madison <matt@madison.systems>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 14:36:48 +01:00
Richard Purdie
a6f6bcb9db pseudo: Add in ability to flush database with shutdown request
Pulls in:
  pseudo_db: Flush DB if there is a shutdown request
  fcntl: Add support for fcntl F_GETPIPE_SZ and F_SETPIPE_SZ (test fix)

(From OE-Core rev: 0882095d608ce3abbcc9814517434c21ea549063)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 14:36:48 +01:00
Richard Purdie
1d2e3d006a oeqa/qemurunner: Use oe._exit(), not sys.exit()
sys.exit will cause finally statements and other code to run at exit. Since
we're using os.fork() here, os._exit() is apprioriate in this codepath.

(From OE-Core rev: ec08498ff29de9ccd23be88b9d7af3dab6bbb81e)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 14:36:48 +01:00
Tom Pollard
24a32132a5 libsamplerate0: Set correct soname for 0.1.9
Manually patch SHARED_VERSION_INFO, which was missed in
the 0.1.9 release and later incorrectly fixed until 0.2.1

(From OE-Core rev: cb2e8efd316d44b9b1453882114856e0eb7b3500)

Signed-off-by: Tom Pollard <tom.pollard@codethink.co.uk>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 14:36:48 +01:00
Tom Pollard
7f66855d11 bzip2: Update soname for libbz2 1.0.8
Set shared library name as libbz2.so.1.0.8, version in configure.ac
already synced via do_configure PV substitution.

(From OE-Core rev: 07e3abc9d282a54add69a6905ec4248f3104219f)

Signed-off-by: Tom Pollard <tom.pollard@codethink.co.uk>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 14:36:48 +01:00
Bruce Ashfield
8bcec870b4 linux-yocto/5.13: drop recipes
5.13 is EOL upstream, and we've moved to 5.14 for the release, so
we drop the versioned recipes. The kernel tree and branches will
stay available for use, but other layers must create recipes if
they wish to continue with 5.13.

(From OE-Core rev: b08456824ce5d8701ddd2db0be3f8f2f4894853c)

Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 14:36:48 +01:00
Bruce Ashfield
b5fba5026b lttng-modules: fix build against 5.15+
When testing linux-yocto-dev 5.15-rc, lttng-modules fails to build.
Upstream already has fixes for 5.15 in the release branch, so we
backport the two patches here and we can drop them on the next version
bump.

(From OE-Core rev: af17b507009be14d6f7069d39feb1fbd7563471d)

Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 14:36:48 +01:00
Bruce Ashfield
7b39470660 lttng-modules/dev-upstream: update to 2.13-latest
To ensure we can build against 5.15, and to keep in sync with the
versioned recipe, we bump to the latest commit on the 2.13 release
branch.

(From OE-Core rev: 1317bd6f92f32444301c5f6cf0c98e7a64e92f66)

Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 14:36:48 +01:00
Bruce Ashfield
eb61ab4088 linux-yocto-dev: update to v5.15-rcX
The main reference kernel has moved to 5.14, so we bump -dev to
5.15 for the release.

(From OE-Core rev: 36e3ae14af7df8584063e5aac4fa32a57542c3a3)

Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 14:36:48 +01:00
Kiran Surendran
bcf0b25248 ffmpeg: fix CVE-2021-38171
backport from upstream

(From OE-Core rev: 3cb40cabc79e4c9b4ffaf99543368b0c57d18df1)

Signed-off-by: Kiran Surendran <kiran.surendran@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 14:36:48 +01:00
Yi Zhao
eafac9940a inetutils: fix CVE-2021-40491
CVE-2021-40491:
The ftp client in GNU Inetutils before 2.2 does not validate addresses
returned by PASV/LSPV responses to make sure they match the server
address. This is similar to CVE-2020-8284 for curl.

References:
https://nvd.nist.gov/vuln/detail/CVE-2021-40491

Patch from:
https://git.savannah.gnu.org/cgit/inetutils.git/commit/?id=58cb043b190fd04effdaea7c9403416b436e50dd

(From OE-Core rev: 1b857807f1cf8fee3175f8479a0c7cb1850bd9a9)

Signed-off-by: Yi Zhao <yi.zhao@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-26 12:05:03 +01:00
Kevin Hao
06dcace68b meta-yocto-bsp: Update the default kernel to v5.14
Introduce the bbappend for v5.14 and also set the default kernel to
v5.14 for all the boards.

(From meta-yocto rev: bed70a64b5b772fd71a7ff88a9f3719082e9398c)

Signed-off-by: Kevin Hao <kexin.hao@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-24 10:15:29 +01:00
Bruce Ashfield
414c5f1103 poky: set default kernel to 5.14
both -rt and -standard have been updated to 5.14, so we switch out
defaults.

(From meta-yocto rev: 952a771f5707d9e84beee6195b7a3cfb3a930702)

Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-24 10:15:29 +01:00
Bruce Ashfield
c744decea1 conf/machine: bump qemu preferred versions to 5.14
5.14 is the latest reference kernel, so let's make it the
default.

(From OE-Core rev: af19c44c4af68568de2ddb5c11d8ad34ac600522)

Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-24 10:15:28 +01:00
Bruce Ashfield
99fcf48327 systemtap: update to 4.5-latest
To fix issues with 5.14+ kernels, we bump to the latest 4.5 systemtap.
This means that we can drop a backported patch, and we pickup the
following changes:

    7f6992539 Correct RISC-V handling of SDT markers and document their format.
    2dfd140fd Fix races in perf probe task finder callback
    f463f6053 The /* pc=0x... */ is no longer printed by "stap -v -L 'kernel.function("*")'
    0bd97a806 Use task_state tapset function to avoid task_struct changes
    4996a29c6 tapset: start adopting kernel netif_* tracepoints in netdev.* tapset
    fb0851e62 dwflpp.h: add conditional EM_RISCV define
    c5599df8e Add dwarfless register access for RISC-V
    33d861435 Add bactrace support for RISC-V
    2ae3fc866 RISC-V dwarf register number to pt_reg mappings
    3df603720 Eliminate the sa_restorer field in sigaction struct for RISC-V.
    a6aff9d33 Avoid generating problematic asynchronous unwind tables on RISC-V
    a463860c3 Add RISC-V 64-bit processor support
    8486fd78d Add the actual RISC-V syscall-number mappings to the tapsets.
    1e383aa38 Add creation of mappings between syscall names and numbers for RISC-V
    aedb2dbe7 RISC-V doesn't have crash available, disable it for rpmbuilds.
    33a9bf1a1 Update to newer config.guess to support RISC-V
    3bca17469 Use lex_cast instead of to_string when shortening function names.
    0b5bc934a Revert "runtime: unregister the control channel before cleaning up"
    166a95089 runtime: fix panics when polling on the control channel while unloading
    e6a1b008b Shorten function names that will exceed the kernel's objtool limit of 128
    4f54ba033 runtime/transport: add a comment blurb for ordering invariant at shutdown
    dbe08f1ac runtime: unregister the control channel before cleaning up
    798a67290 bpf pr23478 :: test non-unique key/val iteration
    079f5d708 bpf pr23478 :: test multi-key associative array iteration
    70b24879d rhbz1938312: un-disable bpf.exp after kernel bugfix
    2896d6f5a pr23478 WIP: fixes for existing foreach testcases
    0d1a38dbc pr23478 WIP: rework bpf foreach to handle multi-key array
    14a2c8f54 Run task_fd_lookup.exp with --compatible 4.0
    f2c147767 PR28184: Adapt to kernel rename __fcheck_files to files_lookup_fd_raw
    0581a6560 PR28184: Adapt to kernel rename __fcheck_files to files_lookup_fd_raw
    559fd51fe testsuite: time-limit auxiliary child processes
    5d89bb03e stapbpf bugfix: missing in_block() in try-catch code
    04b43f48f releng: ditch custom pie/ssp CFLAGS engine in configure.ac
    b47d03c20 PR28079: Adapt to kernel 5.14 task_struct.__state change
    e66f3a83b runtime: adapt to -Werror=implicit-fallthrough=5, dyninst runtime
    ea00c1070 PR28140: kernel 5.14-rc adaptation, jump_label_patch
    ffb0a38ea runtime: adapt to -Werror=implicit-fallthrough=5
    efba2178f Revert to using test_tsk_thread_flag for uprobes2
    23db8b29f PR27984: Adjust the address so dwfl_module_addrinfo finds correct function name
    a29f65d57 PR28079: Adapt to kernel 5.14 task_struct.__state change
    2f7e966c0 testsuite item typo fix
    5abb4d130 PR27934: give fuller diagnosis for pass-5 probe-registration errors
    371805aa0 PR27820 tapset/bpf/logging.stp: implement abort() tapset function
    ee361f183 PR27820 tapset/bpf/logging.stp: move bpf versions of functions
    968173f7f runtime: linux 5.14 compat: <linux/panic_notifier.h>
    ef5a8b9ed runtime: fix unintended compile error with autoconf-x86-uniregs.c
    84ef6bd9f Revert "systemtap.spec: don't buildrequire emacs"
    65fc44163 spin-rawhide: ok tweak the git-archive top level path too
    c7f1c12e1 spin-rawhide: switch to ~ versioning for Source: file names too
    bff2b2ff5 spin-rawhide: switch to ~ versioning for n-v-r
    7c2751e37 task_finder_vma: add autoconf check for hlist_add_tail_rcu()
    ea7c27bbe Don't fail vma tracking mmap callback if module is already known.
    2eb7fdfdb Use the path instead of the module for vma tracking mmap callback.
    a5104a612 update READMEs + man pages for freenode -> oftc move
    23c351645 Update list of reasons for latencytap.stp example
    5409ddea1 rhbz1972805: add basic syscall-in-ptregs support for s390x
    0fc73fc4e systemtap.spec: don't Require: libvirt
    515a6a2d6 rhbz1972828: tapsets: iommu tracepoints
    eaf63df6a ppc64 runtime: FULL_REGS() gone
    757d4f654 c++ buildability: util.cxx - unique_ptr
    1a6e7aea7 systemtap.spec: don't buildrequire emacs
    5ff28c970 Allow for adjacent segments belonging to different modules.
    b1e8cd5de Note that Python is a requirement.
    27115ab4c Get the enumerator's enumeration type
    1288bee31 testsuite/systemtap.base/perf.sh drop bashism
    4755bc453 Add hlist macros for use by hlist_add_tail_rcu
    bccf5123f parse.cxx: Initialize functioncall synthetic field
    9bbee6518 Add hlist_add_tail_rcu for rhel 6.
    630e406b8 Don't assume ISO C99
    4a3ad3532 Extend vma mapped entries when the address is adjacent.
    294b7a53e stap-prep: switch to using main vmlinuz file as debuginfod test download
    643351d22 PR27903: grok more glibc dwarf
    3a843482a c++11 hygiene: use cxx_override macro for pre-4.7 g++
    3e9bcd7b1 Fix more -Wformat-nonliteral and -Wmismatched-tags when compiling with clang
    8e5145ae4 dtrace: Use -o option to specify output file for CPP
    b3a392975 Fix -Wformat-nonliteral and -Wformat warnings with clang
    545535f82 Fix -Woverloaded-virtual warnings when building with clang
    0f4bd3219 set2: Return this from assignment operator
    6de815bca Add missing copy constructors to set1_ref and set1_const_ref
    930b54119 Add some override specifiers where missing
    14f04522b util.cxx: Use abs() instead of labs()
    13016e9dd systemtap.spec: python3 tweaks
    494ece199 PR27864: tolerate loc_unavailable during loc2c transform
    e8f5c058f autoconf: version bumps for the next release-4.6
    77abac91d version bumps for the next release-4.6
    0eba8a46b NEWS: release-4.5

(From OE-Core rev: aa27c2e7570f229bf82f18cf07aae93ba96ca9f6)

Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-24 10:15:28 +01:00
Bruce Ashfield
073321803b linux-yocto: introduce 5.14 reference kernel
Each release of the kernel is not typically used as a versioned
reference kernel, but since 5.13 has gone EOL upstream and was
never part of a release, we take the opportunity to udpate our
reference to 5.14.

5.13 will be removed in subsequent commits, once all dependent
BSPs and layers have been updated.

No issues were found across all architectures, images in qemu
boot testing.

(From OE-Core rev: 634760461542a14bbf3625ff12393dc7428f6001)

Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-24 10:15:28 +01:00
Bruce Ashfield
f66dbd933d libc-headers: bump to v5.14
The reference kernel is moving to 5.14, and 5.13 is EOL upstream, so
we update the libc-headers to match.

No patch issues were found for musl or glibc.

(From OE-Core rev: 3cdaf2cb64303bc58ab8be40fce4091b5a7809b4)

Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-24 10:15:28 +01:00
Changqing Li
fc0e7347f7 lttng-ust: fix do_compile error when PACKAGECONFIG examples is enabled
when PACKAGECONFIG enabled examples, compile failed with error:
fix below compile error during PACKGAGECONFIG examples is enabled:
tmp/work/corei7-64-wrs-linux/lttng-ust/2_2.13.0-r0/recipe-sysroot-native/usr/bin/x86_64-wrs-linux/../../libexec/x86_64-wrs-linux/gcc/x86_64-wrs-linux/11.2.0/ld: warning: liblttng-ust-common.so.1, needed by ../../../src/lib/lttng-ust/.libs/liblttng-ust.so, not found (try using -rpath or -rpath-link)
tmp/work/corei7-64-wrs-linux/lttng-ust/2_2.13.0-r0/recipe-sysroot-native/usr/bin/x86_64-wrs-linux/../../libexec/x86_64-wrs-linux/gcc/x86_64-wrs-linux/11.2.0/ld: warning: liblttng-ust-tracepoint.so.1, needed by ../../../src/lib/lttng-ust/.libs/liblttng-ust.so, not found (try using -rpath or -rpath-link)

(From OE-Core rev: 907ebb5bb3d44dd5f68deb238098fb6f6413e2d4)

Signed-off-by: Changqing Li <changqing.li@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-23 22:13:53 +01:00
Richard Purdie
d08c9290e8 oeqa/selftest: Add tests for bitbake shell/python task output
We've seen issues where shell/python tasks lose their log file entries
or output and also where output is duplicated. Add some tests to attempt
to spot regressions in this area in future.

(From OE-Core rev: 414020a9bd656ee61efe2f47db1b31d86b15c1c8)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-23 22:13:53 +01:00
Richard Purdie
7d0437c4e8 bitbake: build: Fix log flushing race
There is a race between sending the TaskFailed event which could trigger
the UI to look at the logs and flushing and closing the log files.

Reverse the order of the finally clause and the exception handling
to ensure we've handled the logfiles before sending the task events.

This should fix a race seen in bblogging.BitBakeLogging.test_python_exit_logging

(Bitbake rev: 032190aac31604d37740d8aecf6e74a5448de358)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-23 22:13:08 +01:00
Richard Purdie
3d06c164dd bitbake: build: Make exception printing clearer
Shows:

ERROR: SystemExit(1)

instead of:

ERROR: 1

(Bitbake rev: df89e37c33e4398a5f8ece9a8b973be3fe2ff361)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-23 22:13:08 +01:00
Richard Purdie
8f1c2f851a bitbake: build: Ensure python stdout/stderr is logged correctly
Currently we see things like:

Log data follows:
| DEBUG: Executing python function do_pythontest_exit
| DEBUG: Python function do_pythontest_exit finished
| ERROR: 1
| This is python stdout

Whilst after the change we see things like:

Log data follows:
| DEBUG: Executing python function do_pythontest_exit
| This is python stdout
| DEBUG: Python function do_pythontest_exit finished
| ERROR: 1

since the output is now correctly mixed with the log messages. In some cases the logging
tests indicate the output is being lost entirely which is bad for debugging and makes
things rather confusing.

(Bitbake rev: 8966b43761500e0505333d8c9a3f0f2c3dbe7559)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-23 22:13:08 +01:00