Commit Graph

55981 Commits

Author SHA1 Message Date
Richard Purdie
9254d537aa bitbake: runqueue: Small performance optimisation
A minor performance optmisation to keep lists smaller when running large
builds. We can do this since once a task has been built, we don't need
to worry about it. This improves a major bottleneck that shows up on
performance profile charts in dryruns.

(Bitbake rev: cd6b89230823707c3c9bb9e6883bf5a971916581)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 17:23:35 +01:00
Richard Purdie
2f8cd1d021 bitbake: runqueue: Save unihashes more frequently
There are some runqueue code paths where the unihash cache would not be
saved where for example only parsing or an occurred. Save the cache at the
end of runqueue generation to ensure entries are cached.

(Bitbake rev: 9eee0d36870c11dd303894a6151c33a83bd3a1bc)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 17:23:35 +01:00
Richard Purdie
ba0ff38cab bitbake: siggen: Avoid writing misleading sigdata files
Use the unihash in the output filename of sigdata files else the contents
of stamp directories is misleading. Write the unihash into the singature to
make it clear what happened.

(Bitbake rev: feb01ee54d3706fe93768f332054c7532f7209e4)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 17:23:35 +01:00
Richard Purdie
7ab4808e0a bitbake: siggen/runqueue: Fix signature mismatch issues
We need to set the setscene tasklist before we call into the
taskhash/unihash code else the behaviour is inconsistent.

Avoid reporting hashes for non setscene tasks since we'd never
query that.

(Bitbake rev: 419a7840b8627278db694029c25df00214d01d96)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 17:23:35 +01:00
Richard Purdie
ff872fdda5 bitbake: runqueue: Change task migration behaviour for rerunning setscene tasks
Currently runqueue will rerun setscene tasks multiple times as hashes
change. This has caused numerous problems since a setscene task may
become "unavailable" for some future signature combination and the code
then can't easily "unskip" tasks its already passed into the execution
queue.

At least for now, only run setscene once and assume they're equivalent
at that point. In practise that has been much more stable in testing.

Tweak the test to match the change in behaviour.

(Bitbake rev: 4205a3ef23834f317642bba155d67cd772176fb6)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 17:23:35 +01:00
Richard Purdie
155249b1db bitbake: siggen: Ensure setscenetasks list is available to worker context
The setscenetasks list needs to be available in the worker contexts
else the signature behaviour there mismatches what the server does.

Add the data to get/set_taskdata to ensure this happens.

(Bitbake rev: 632980ef90fe126b7ba3d138f4d574ae05914779)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 17:23:35 +01:00
Richard Purdie
d0b7471ba8 bitbake: runqueue: Fix task migration problems
Tasks were not migrating consistently, particularly:

* if a task was rehashed which had already run
* if a task which was valid became invalid due to a rehash

We need to always run the migration code for rehashed tasks and then
reprocess them for hash validity. This means rearranging the code.

It also means several tests are no longer correct and can't be written
correctly to work on all possible workflows so those are removed.

(Bitbake rev: 8443989ee41e9b162972935513e437b5c66ea74d)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 17:23:35 +01:00
Chen Qi
b83d5c15ad systemd: fix NFS regression
Currently systemd cannot boot correctly on NFS. This is because
the code uses readdir which returns DT_UNKNOWN instead of DT_LNK
on NFS. So consider DT_UNKNOWN to fix this problem.

(From OE-Core rev: 9973f89dafdf9d21f4021f59f1f4669f4ac13aff)

Signed-off-by: Chen Qi <Qi.Chen@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 16:55:21 +01:00
Dan Tran
15d6add800 unzip: Fix CVE-2019-13232
(From OE-Core rev: a9db9617349a766ffe0df724fff9266eb1667cdd)

Signed-off-by: Dan Tran <dantran@microsoft.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 16:55:21 +01:00
Trevor Gamblin
3a82a72b63 lighttpd: remove fam as a PACKAGECONFIG option
lighttpd builds fail if "fam" (and therefore gamin) is enabled.

In conf/local.conf:

    CORE_IMAGE_EXTRA_INSTALL += "lighttpd"
    PACKAGECONFIG_append_pn-lighttpd = " fam"

bitbake error:

    ERROR: Nothing PROVIDES 'gamin' (but /yow-lpggp31/tgamblin/oe-core.git/meta/recipes-extended/lighttpd/lighttpd_1.4.54.bb DEPENDS on or otherwise requires it)
    NOTE: Runtime target 'lighttpd' is unbuildable, removing...
    Missing or unbuildable dependency chain was: ['lighttpd', 'gamin']
    ERROR: Required build target 'core-image-minimal' has no buildable providers.
    Missing or unbuildable dependency chain was: ['core-image-minimal', 'lighttpd', 'gamin']

Since gamin hasn't been maintained for several years, this should
be removed from the list of lighttpd PACKAGECONFIG options.
--without-fam is hard-coded in EXTRA_OECONF for good measure.

(From OE-Core rev: ea714fff3869ef19cf1dc94bdffbca2c69658954)

Signed-off-by: Trevor Gamblin <trevor.gamblin@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 16:55:21 +01:00
Khem Raj
2d2d39d414 packagegroups: All groups are not allarch
Some of the packagegroups violate the allarch policy therefore the ones
which do so, should be marked as TUNE specific

Fixes QA errors
packagegroup-self-hosted-1.0: Package version for package packagegroup-self-hosted-graphics went backwards which would break package feeds from (0:1.0-r13.12 to 0:1.0-r13.9) [version-going-backwards]

(From OE-Core rev: c26569320817263a487eceb610e3c70badba0b52)

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 16:55:21 +01:00
Khem Raj
091e5c1653 strace: Upgrade to 5.3
Detailed features are here [1]

[1] https://github.com/strace/strace/releases/tag/v5.3

(From OE-Core rev: a3b3e8fb120f98cdb18d7a9d517d88a313416986)

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 16:55:21 +01:00
Robert Yang
3d7f4b8cbf lttng-ust: Fix for --enable-python-agent
Fixed:
PACKAGECONFIG_append_pn-lttng-ust = ' python3-agent'

require conf/multilib.conf
MULTILIBS = "multilib:lib32"
DEFAULTTUNE_virtclass-multilib-lib32 = "x86"

$ bitbake lttng-ust
ERROR: lttng-ust-2_2.10.4-r0 do_package: QA Issue: lttng-ust: Files/directories were installed but not shipped in any package:
  /usr/lib
  /usr/lib/python3.7
  /usr/lib/python3.7/site-packages
  /usr/lib/python3.7/site-packages/lttngust-2.10.4-py3.7.egg-info

(From OE-Core rev: d1b1bfece08ae32c120844d73aadee96de7bbf9b)

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 16:55:21 +01:00
Peter Kjellerstedt
9a07399607 lib/oe/lsb: Make sure the distro ID is always lowercased
In commit 8689e561 (lib/oe/lsb: attempt to ensure consistent distro id
regardless of source), the distro ID returned by
oe.lsb.distro_identifier() was lowercased, but only if a release
version is also present.

This changes the code to always lowercase the distro ID, including the
default distro ID "unknown", which is used if no other ID can be
identified.

(From OE-Core rev: 4ba7ef79d23a4cf688d7a794064893fe5f2f473b)

Signed-off-by: Peter Kjellerstedt <peter.kjellerstedt@axis.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 16:55:21 +01:00
Robert Yang
7d751fc737 apr: Check for libtoolize rather than libtool
Backport a patch from debian to make it check libtoolize rather than libtool.

https://sources.debian.org/data/main/a/apr/1.6.5-1/debian/patches/libtoolize_check.patch

This can also fix:
$ bitbake nativesdk-apr
buildconf: libtool not found.
           You need libtool version 1.4 or newer installed

(From OE-Core rev: 1a1b9e3ff33dea964bdf79bc47b5c7801e4df5a5)

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 16:55:21 +01:00
Nathan Rossi
ec1104fd7f oeqa/core/case.py: Encode binary data of log
Do not decode the log content into a string only to re-encode it as
binary data again. Some logs might un-intentionally contain bytes that
do not decode as utf-8, as such preserve the log file content as it was
on disk.

Handle the decoding on the resulttool side, but also handle the failure
to decode the data.

(From OE-Core rev: 20531dc0b8f76a6e37cc856f36cd94077b6aba50)

Signed-off-by: Nathan Rossi <nathan@nathanrossi.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 16:55:21 +01:00
Nathan Rossi
02a334c98f oeqa/core/utils/concurrencytest.py: Handle exceptions and details
Handle the streaming of exception content with details data. The
testtools package allows both 'err' and 'details' kwargs but can only
pass one of them to the parent.

To handle the passing of exception traceback and details data at the
same time, encode the traceback into the details object and remove the
'err' arg from the add* result call. This encodes the traceback similar
to how 'err' is handled without any details object. Decoding is already
done by testtools when the traceback is encoded in the details object.

(From OE-Core rev: 3613451825b251784b7673d89db465b9782c3a31)

Signed-off-by: Nathan Rossi <nathan@nathanrossi.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 16:55:21 +01:00
Richard Purdie
e25ee9fe28 populate_sdk_ext: Fix for hash equiv
Write out the hash equiv cache file into any eSDK so that it doesn't rely
on having to call the hash server for the basic data requests.

(From OE-Core rev: 05c6842e747261b3350d6325e238429cf8728ca0)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 16:55:21 +01:00
Richard Purdie
d80dd1c3f9 lib/sstatesig: Fix class inheritance problems
The locked sigs class needs to be inherited after the hashequiv mixin so
that get_unihash can correctly wrap the underlying hashequiv function.

To do this turn the locked sigs class into a second mixin, then the order
can be correctly handled. Tweak the get/set_taskdata to match.

(From OE-Core rev: 73d3414ecf594e426e6024b71931038a201eca52)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 16:55:21 +01:00
Richard Purdie
ca6cc9fa52 oeqa/selftest/signing: Fix for hash equivlance server
There were two issues with the test one is that an equivalent hash
could come from the server meaning the signature didn't change when it
should. A uuid string is injected to ensure this does not happen.

If there were multiple warnings the test would also fail as only the
first is prefixed with WARNING. Tweak the string to avoid that failure
mode.

(From OE-Core rev: e58eaf5b8c93521dc311b77593e0dd7debca602d)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 16:55:21 +01:00
Richard Purdie
c92aca546e sstatesig: Fix hash equivlanency locked signature issues
Using locked signatures with the hash equivalency server ran into
problems. We need to:

a) Ensure the lockedhashes data object is passed from the core to
   any individual tasks using the get/set_taskdata methods

b) Return a locked singature instead of a unihash

c) Write the unihash being used to locked signature lists rather than
   the calculated taskhash

d) Skip warnings of hash mismatch if the hash is a unihash

These changes fix esdk builds (which use locked sigs) when a hash equivalence
server is in use.

(From OE-Core rev: 25dc3d78de01dffa77a3a2452d6a97d741b446d9)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-30 16:55:21 +01:00
Bruce Ashfield
3584fffc72 yocto-bsps: update to v5.2.17
Updating the reference BSP SRCREVs and versions to 5.2.17 to match
the latest for qemu* and to pickup some reference board specific
patches.

(From meta-yocto rev: fcc920580380a2b57b5b8e1649b4ad94bd3d15b7)

Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:46:10 +01:00
Joshua Watt
2ac500a609 bitbake: hashserv: Don't daemonize server process
The hash server process is terminated and waited on with join(), so it
should not be a daemon. Daemonizing it cause races with the server
cleanup, especially in the selftest because the process may not have
terminated and cleanup up its socket before the test cleanup runs and
tries to do it.

[YOCTO #13542]

(Bitbake rev: 7c829675581818f92d57056b57fbd3880829b6bd)

Signed-off-by: Joshua Watt <JPEWhacker@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:19 +01:00
Joshua Watt
1805574559 bitbake: siggen: Fix attribute error when hashserver fails
The HashConnectionError class was moved to the client module and needs
to be updated.

[YOCTO #13537]

(Bitbake rev: 9fb862685e5e5a2aa534bc25cab1e4158d708b40)

Signed-off-by: Joshua Watt <JPEWhacker@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:19 +01:00
Joshua Watt
6f6b41e642 bitbake: hashserve: Add missing import
The os module is required to connect to a unix domain socket

(Bitbake rev: 31a5111bcd0080a583d0d95fad3e09ae78bdf0fa)

Signed-off-by: Joshua Watt <JPEWhacker@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:19 +01:00
Joshua Watt
f971d6ae2e bitbake: cookerdata: Add mc conffiles hashes to cache hash
The variable values that result from parsing multiconfig should be
included in the cooker data hash, otherwise changes to these files won't
be detected, which will allow the parsing cache to be loaded with the
old values for the multiconfigs. This can either manifest as the
variable values simply not updating, or getting basehash changed errors
when building.

This bug was previously undetected because all of the multiconfig base
files were a direct file dependency in all parsed recipes. This was
fixed in 34137a00f60 ("bitbake: bitbake: cooker: Rename __depends in all
multiconfigs"), exposing this bug.

[YOCTO #13541]

(Bitbake rev: c74481aa15226e1bff9d53e4ee4b702ebfa1ad32)

Signed-off-by: Joshua Watt <JPEWhacker@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:19 +01:00
Jacob Kroon
daa6dcfc39 bitbake: tests/data: Test combinations of _append together with override
(Bitbake rev: f31f35e8527c60a95931a4a8311a4cd237770b42)

Signed-off-by: Jacob Kroon <jacob.kroon@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:19 +01:00
Ross Burton
a44d119456 bitbake: tests/fetch: add test case for git-lfs handling
Add a test case to exercise the detection of git-lfs repositories and the
behaviour of the lfs parameter.

(Bitbake rev: a7cf4fc72cce357c425084dc2c5f35b5ed1a4b7b)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:19 +01:00
Ross Burton
560358e922 bitbake: fetch2/git: refactor check for git-lfs command
Refactor the git-lfs checking: this means both clearer code in the download()
function and allows unit testing to monkeypatch the functionality.

(Bitbake rev: 33cf9172ded50a869f7201ba463ab9ecc69b8252)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:19 +01:00
Heiko Schocher
2c58079222 kernel.fitimage.bbclass: remove ramdisk_ctype
set in the ramdisk node the compression property
always to "none", as U-Boot nowadays since commit:

b1307f884a91 ("fit: Support compression for non-kernel components (e.g. FDT)")

decompress non kernel components. Setting compression
to the used comression algorithm now, will end in
fail of your kernel boot with the ramdisk.

This issue is fixed since commit:

bddd98573465 ("fit: Do not automatically decompress ramdisk images")

which now prints a warning in U-Boot, instead of decompressing
the ramdisk, but we should setup compression property correct.

(From OE-Core rev: f963a51544a9a7b1abbaa87c95b3c0279847d697)

Signed-off-by: Heiko Schocher <hs@denx.de>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:17 +01:00
Trevor Gamblin
13a2e8d9cc python3-pip: ensure pickle is installed
pip3 depends on pickle, so add python3-pickle to RDEPENDS.
Without it, errors such as the following occur:

>>> import pip._internal
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/lib64/python3.7/site-packages/pip/internal/init_.py", line 40, in <module>
from pip._internal.cli.autocompletion import autocomplete
File "/usr/lib64/python3.7/site-packages/pip/_internal/cli/autocompletion.py", line 8, in <module>
from pip._internal.cli.main_parser import create_main_parser
File "/usr/lib64/python3.7/site-packages/pip/_internal/cli/main_parser.py", line 7, in <module>
from pip._internal.cli import cmdoptions
File "/usr/lib64/python3.7/site-packages/pip/_internal/cli/cmdoptions.py", line 29, in <module>
from pip._internal.utils.ui import BAR_TYPES
File "/usr/lib64/python3.7/site-packages/pip/_internal/utils/ui.py", line 16, in <module>
from pip._internal.utils.logging import get_indentation
File "/usr/lib64/python3.7/site-packages/pip/_internal/utils/logging.py", line 6, in <module>
import logging.handlers
File "/usr/lib64/python3.7/logging/handlers.py", line 26, in <module>
import logging, socket, os, pickle, struct, time, re
ModuleNotFoundError: No module named 'pickle'

(From OE-Core rev: 39f53aae947f08284bf4864934f62c33e4e9be3c)

Signed-off-by: Trevor Gamblin <trevor.gamblin@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:17 +01:00
Ross Burton
ef637c71ca json-c: use GitHub for upstream release checking
(From OE-Core rev: cce4af642c3c4d94c39a254e969bc6a7f213cab2)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:17 +01:00
Wang Quanyang
eb27d1ab3e kexec-tools: fix arm kexec failure for __NR_kexec_file_load
Once use kexec in arm arch, it will throw out the error info as below:

Could not find a free area of memory of 0xc78e744 bytes...

This is because that kexec use kexec_file_load to load image by default
but arm doesn't support it. So add this patch to avoid use kexec_file_load
in arm platforms.

(From OE-Core rev: 952a3fa77c80f16cd6d97f35afdb474876a39483)

Signed-off-by: Quanyang Wang <quanyang.wang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:17 +01:00
Randy MacLeod
da00de3958 ffmpeg: update from 4.2 to 4.2.1
This update corresponds to 68 commits to the ffmpeg git repo.
52 of these commits are oss-fuzz bug fixes. The remainder include
improved codex handling and some rpi performance tweaks.

(From OE-Core rev: 642b3e79c66779ab2851d978d44cf2e5aab47c68)

Signed-off-by: Randy MacLeod <Randy.MacLeod@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:17 +01:00
Joshua Watt
2b74cece39 oeqa: Test multiconfig parsing
Add a test to verify that when multiconfig conf files changed, recipes
are correctly reparsed.

[YOCTO #13541]

(From OE-Core rev: a424ef0a0c49123f4518e8fef993fd10f6fc5f4e)

Signed-off-by: Joshua Watt <JPEWhacker@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:17 +01:00
Trevor Gamblin
bbe46d8ca3 python3-subunit: ensure runtime dependencies are present
Without access to unittest, subunit cannot be imported in python3:

    root@qemux86-64:~# python3
    Python 3.7.4 (default, Sep 20 2019, 13:38:31)
    [GCC 9.2.0] on linux
    Type "help", "copyright", "credits" or "license" for more information.
    >>> import subunit
    Traceback (most recent call last):
      File "<stdin>", line 1, in <module>
      File "/usr/lib/python3.7/site-packages/subunit/__init__.py", line 123, in <module>
        import unittest
    ModuleNotFoundError: No module named 'unittest'
    >>>

Adding python3-testtools to python3-subunit's RDEPENDS fixes the
issue. This also implicitly provides the functionality found in
the python3-extras module.

(From OE-Core rev: 7ed7dc39e379c18f757e3c326ec1466c8ab27b41)

Signed-off-by: Trevor Gamblin <trevor.gamblin@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:17 +01:00
Peter Kjellerstedt
5af64b55f3 devtool: finish: Add suppport for the --no-clean option
This works just like the already existing --no-clean option to the
`devtool reset` command.

(From OE-Core rev: 4433d3133ce53cdf7db17f5e7914fe8c4d78dba3)

Signed-off-by: Peter Kjellerstedt <peter.kjellerstedt@axis.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:17 +01:00
Niclas Svensson
a70e1fdba2 devtool: finish: Keep patches ordered when updating bbappend
The _get_patchset_revs() function returns the patches in an
OrderedDict to keep them ordered. However, this information was lost
when the patches were added to the bbappend file.

(From OE-Core rev: 69b7a2ba3af1280cc220ab236032f8466246ee93)

Signed-off-by: Niclas Svensson <niclas.svensson@axis.com>
Signed-off-by: Peter Kjellerstedt <peter.kjellerstedt@axis.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:16 +01:00
Robert Yang
b6e5346f46 expect: Fix buffer overflow error when build in long path
Fixed when built the project in a long path (len(TMPDIR) > 200):
$ bitbake dejagnu-native
[snip]
checking Tcl version 8.5 or greater... *** buffer overflow detected ***:
TOPDIR/tmp-glibc/work/x86_64-linux/dejagnu-native/1.6.2-r0/recipe-sysroot-native/usr/bin/expect terminated
[snip]

(From OE-Core rev: c8d0bf3411846bb3852bffaf59193801d9c7530a)

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:16 +01:00
Joshua Watt
68092163cc classes/reproducible_build: Move SDE deploy to another directory
The deployment of the source date epoch file had a race condition where
any task attempting to read from the file would race with creation of
the sstate archive for the do_deploy_source_date_epoch task. The
creation of the sstate archive requires moving the directory to a
temporary location, then moving it back. This means that the file
disappears for a short period of time, which will cause a failure if any
other task is running and trying to open the file to get the current
source date epoch.

The solution is to copy the source date epoch file to a separate
directory when deploying so the file never disappears. When the file is
restored from sstate, it is moved to the correct location after being
extracted.

[YOCTO #13501]

(From OE-Core rev: ac27d12fe5480e9b8cc93de6a32bf9631c52d7f4)

Signed-off-by: Joshua Watt <JPEWhacker@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:16 +01:00
Böszörményi Zoltán via Openembedded-core
72051e74d6 classes/image-live.bbclass: Don't hardcode cpio.gz
There's INITRAMFS_FSTYPES that can be set differently.

(From OE-Core rev: 141d02400696020e83df3edcf13021fde139d261)

Signed-off-by: Böszörményi Zoltán <zboszor@pr.hu>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:16 +01:00
Robert Yang
1cbce6d5c5 net-tools: Fix installed-vs-shipped for nativesdk
Fixed:
$ bitbake nativesdk-net-tools
ERROR: nativesdk-net-tools-1.60-26-r0 do_package: QA Issue: nativesdk-net-tools: Files/directories were installed but not shipped in any package:
  /usr
  /usr/share
  /usr/share/man
[snip]

(From OE-Core rev: fd3c46840851651fd737fe50916294cdffb3d718)

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:16 +01:00
Robert Yang
fe8d87e083 expect: Fix configure error for nativesdk
Fixed:
$ bitbake nativesdk-expect
checking for Tcl public headers... configure: error: tcl.h not found.  Please specify its location with --with-tclinclude

(From OE-Core rev: bd8ba628b0ff1ad3603b08981467edf5e36ec024)

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:16 +01:00
Alessio Igor Bogani
b404c0cd3c wic: Using the right rootfs size during prepare_rootfs
The commit 8e48b4d6c4 makes wic ignores IMAGE_ROOTFS_SIZE for rootfs
size and makes it uses the computed one only. Re-add support for
IMAGE_ROOTFS_SIZE variable and compute roots size only if the former
is not defined. Moreover the size of a provided directory with
--rootfs-dir="" in the .wks file should always be computed on the fly,
else every partition will be constrained to be the same size as what
ever value was in ROOTFS_SIZE.

(From OE-Core rev: 0217a0392b8cc534fcc0d760b7663a1845b306f5)

Signed-off-by: Alessio Igor Bogani <alessio.bogani@elettra.eu>
Signed-off-by: Jason Wessel <jason.wessel@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:16 +01:00
Khem Raj
990fedd595 sdk: Install nativesdk locales for all TCLIBC variants
install_locales() here is actually operating on nativesdk and only glibc
is the default library for nativesdk, since thats what most of
desktop/server distros use, therefore bailing out based on TCLIBC is not
needed here, since nativesdk-glibc would be required for all non-glibc
targetting SDKs as well.

Fixes SDK install time error

ERROR:  OE-core's config sanity checker detected a potential misconfiguration.
Either fix the cause of this error or at your own risk disable the checker (see sanity.conf).
Following is the list of potential problems / advisories:
Your system needs to support the en_US.UTF-8 locale.
ERROR: SDK preparation failed

(From OE-Core rev: ba2df1fa43b79c4959911c1b0bcad996f255b7a8)

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:16 +01:00
Limeng
205069a9e8 u-boot: add CVE patches for u-boot
Add 9 patches to fix below CVE issues.
CVE-2019-13103
CVE-2019-13104
CVE-2019-13105
CVE-2019-13106
CVE-2019-14192
CVE-2019-14193
CVE-2019-14194
CVE-2019-14195
CVE-2019-14196
CVE-2019-14197
CVE-2019-14198
CVE-2019-14199
CVE-2019-14200
CVE-2019-14201
CVE-2019-14202
CVE-2019-14203
CVE-2019-14204

(From OE-Core rev: db22dbe158dcb2298bfd74ff6cbba31f67488035)

Signed-off-by: Meng Li <Meng.Li@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:16 +01:00
Khem Raj
91b787334a qemuriscv: Do not blacklist clang anymore
clang 9.x ( which is now default in meta-clang ) supports riscv

(From OE-Core rev: 198689f74915756ce6ae38d6735780a26e9b3f7e)

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:16 +01:00
Khem Raj
794aa251e2 musl: Fix riscv64 CAS functions
(From OE-Core rev: 853c35003abe5a1430a432f32fa325d6021f2d2f)

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:16 +01:00
Robert Yang
c782ef5360 cases/bbtests.py: test_bitbake_g(): Check base-files rather than busybox
It checked whether busybox is in task-depends.dot after run "bitbake -g
core-image-minimal", but busybox is not a must for core-image-minimal since it
is configurable:

VIRTUAL-RUNTIME_base-utils = ""
VIRTUAL-RUNTIME_base-utils-syslog = ""
VIRTUAL-RUNTIME_base-utils-hwclock  =  ""
VIRTUAL-RUNTIME_login_manager = "shadow"
VIRTUAL-RUNTIME_syslog = ""

So the case may fail when busybox is not present, check
base-files which is more reliable.

(From OE-Core rev: f73676b07f6d8a4573a5f46c3e082831b34b7d18)

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:16 +01:00
Bruce Ashfield
dcc6498bb1 linux-yocto/5.2: update to v5.2.17
Updating linux-yocto/5.2 to the latest korg -stable release that comprises
the following commits:

    5e408889e4af Linux 5.2.17
    12434939ba58 vfs: Fix refcounting of filenames in fs_parser
    d4911cc1f4b6 media: technisat-usb2: break out of loop at end of buffer
    19ad4c4fe19c floppy: fix usercopy direction
    d7aa8c546ab9 ovl: fix regression caused by overlapping layers detection
    52f2aba47d71 Revert "arm64: Remove unnecessary ISBs from set_{pte,pmd,pud}"
    785ca708a908 iommu/amd: Fix race in increase_address_space()
    ed52f6cf0e84 iommu/amd: Flush old domains in kdump kernel
    24962eb0edd0 keys: Fix missing null pointer check in request_key_auth_describe()
    16ed4b9b7bf7 dmaengine: rcar-dmac: Fix DMACHCLR handling if iommu is mapped
    d604a12cc6d5 dmaengine: sprd: Fix the DMA link-list configuration
    d5898d2f06fc iommu/vt-d: Remove global page flush support
    5df0a5fd4d1c x86/hyper-v: Fix overflow bug in fill_gva_list()
    4bdb9988ad38 x86/uaccess: Don't leak the AC flags into __get_user() argument evaluation
    4dabe50389c4 dmaengine: ti: omap-dma: Add cleanup in omap_dma_probe()
    9de496fe242a dmaengine: ti: dma-crossbar: Fix a memory leak bug
    4b898223a979 arm64: dts: renesas: r8a77995: draak: Fix backlight regulator name
    4ad64281e4d3 net: seeq: Fix the function used to release some memory in an error handling path
    0275857577e5 enetc: Add missing call to 'pci_free_irq_vectors()' in probe and remove functions
    d18638671b96 net: dsa: microchip: add KSZ8563 compatibility string
    05172612ab3a net: aquantia: fix out of memory condition on rx side
    95acd66ba70a net: aquantia: linkstate irq should be oneshot
    e4d1449ca4a5 net: aquantia: reapply vlan filters on up
    6a6e09b7a519 net: aquantia: fix removal of vlan 0
    b5789a160c2d tools/power turbostat: Fix CPU%C1 display value
    54f4f3b38133 tools/power turbostat: Add Ice Lake NNPI support
    8bae84e5203b tools/power turbostat: Fix Haswell Core systems
    0926ee9f5327 tools/power turbostat: fix buffer overrun
    94132aca9472 tools/power turbostat: fix file descriptor leaks
    0a1ba2cd9d62 tools/power turbostat: fix leak of file descriptor on error return path
    caab8b8b3aca tools/power x86_energy_perf_policy: Fix argument parsing
    edf8ba32bc2b tools/power x86_energy_perf_policy: Fix "uninitialized variable" warnings at -O2
    e9e492c92d8c netfilter: nf_flow_table: clear skb tstamp before xmit
    27264af16969 amd-xgbe: Fix error path in xgbe_mod_init()
    8b7bf7b1b2dd i2c: mediatek: disable zero-length transfers for mt8183
    316c15048f40 i2c: iproc: Stop advertising support of SMBUS quick cmd
    9027939cc8f7 perf/x86/amd/ibs: Fix sample bias for dispatched micro-ops
    e1efdaaa9b46 perf/x86/intel: Restrict period on Nehalem
    1ffda54f0546 i2c: designware: Synchronize IRQs when unregistering slave client
    0910434c455d sky2: Disable MSI on yet another ASUS boards (P6Xxxx)
    cd6901e723fc ibmvnic: Do not process reset during or after device removal
    3ee4ed9cd3a0 ARM: 8901/1: add a criteria for pfn_valid of arm
    eaaa11a4f8d0 RISC-V: Fix FIXMAP area corruption on RV32 systems
    22c521335522 usb: host: xhci-tegra: Set DMA mask correctly
    97b1d81abc61 libceph: don't call crypto_free_sync_skcipher() on a NULL tfm
    b8632186884a cifs: Use kzfree() to zero out the password
    8db988a98290 cifs: set domainName when a domain-key is used in multiuser
    a8bf51b5c6f5 drm/amd/powerplay: correct Vega20 dpm level related settings
    f5c6d0245f97 netfilter: conntrack: make sysctls per-namespace again
    6612f6edf1f1 kallsyms: Don't let kallsyms_lookup_size_offset() fail on retrieving the first symbol
    7c1a4283b606 NFS: remove set but not used variable 'mapping'
    de932b20ed88 NFSv2: Fix write regression
    646d295fdded NFSv2: Fix eof handling
    16986c7cf8b5 netfilter: nf_conntrack_ftp: Fix debug output
    0dec70d3c249 netfilter: xt_physdev: Fix spurious error message in physdev_mt_check
    e3813a30bd6f drm/amdgpu: fix dma_fence_wait without reference
    9b914306b0f7 NFS: Fix writepage(s) error handling to not report errors twice
    78f0f9007523 NFS: Fix spurious EIO read errors
    fa38f165c78a pNFS/flexfiles: Don't time out requests on hard mounts
    7999b21e2224 x86/apic: Fix arch_dynirq_lower_bound() bug for DT enabled machines
    c19a0d7ef095 r8152: Set memory to all 0xFFs on failed reg reads
    f1b6d7c8de4c bpf: allow narrow loads of some sk_reuseport_md fields with offset > 0
    5e0251d82954 flow_dissector: Fix potential use-after-free on BPF_PROG_DETACH
    31320b857d13 batman-adv: Only read OGM2 tvlv_len after buffer len check
    9ae47d48cd2d ARM: 8874/1: mm: only adjust sections of valid mm structures
    b77b8c17df13 drm/virtio: use virtio_max_dma_size
    5a2ffd1ffa54 drm/omap: Fix port lookup for SDI output
    fc45ccc7b85b qed: Add cleanup in qed_slowpath_start()
    304a65866fbe selftests/bpf: add config fragment BPF_JIT
    c963cd4ec138 selftests/bpf: fix test_cgroup_storage on s390
    f4a9b28782c6 xdp: unpin xdp umem pages in error path
    b484e28554d0 Kconfig: Fix the reference to the IDT77105 Phy driver in the description of ATM_NICSTAR_USE_IDT77105
    b8438c08476c NFS: On fatal writeback errors, we need to call nfs_inode_remove_request()
    518c9d0158e0 NFS: Fix initialisation of I/O result struct in nfs_pgio_rpcsetup
    d29a04e98cdb NFSv4: Fix return value in nfs_finish_open()
    b8cb57c86f93 NFSv4: Fix return values for nfs4_file_open()
    7844dde203db netfilter: xt_nfacct: Fix alignment mismatch in xt_nfacct_match_info
    f30dade2d5d5 netfilter: nft_flow_offload: missing netlink attribute policy
    399676d85515 netfilter: ebtables: Fix argument order to ADD_COUNTER
    5b0d408d8ad6 fpga: altera-ps-spi: Fix getting of optional confd gpio
    52ba08b93fee tools: bpftool: close prog FD before exit on showing a single program
    840aec7a8b48 selftests/bpf: fix "bind{4, 6} deny specific IP & port" on s390
    99eb87b50faa s390/bpf: use 32-bit index for tail calls
    62c3bfff7d9e ARM: dts: Fix incomplete dts data for am3 and am4 mmc
    0a3d2a039339 bus: ti-sysc: Simplify cleanup upon failures in sysc_probe()
    e92814b0aae1 ARM: OMAP1: ams-delta-fiq: Fix missing irq_ack
    3d8729676adb ARM: dts: dra74x: Fix iodelay configuration for mmc3
    70af7f6d9e6a ARM: dts: am335x: Fix UARTs length
    b6858c94d535 ARM: OMAP2+: Fix omap4 errata warning on other SoCs
    71d668a95351 s390/bpf: fix lcgr instruction encoding
    f262a47d4bc9 arm64: dts: meson-g12a: add missing dwc2 phy-names
    3d3879d57e3b ARM: dts: Fix incorrect dcan register mapping for am3, am4 and dra7
    6d326307187b ARM: dts: Fix flags for gpio7
    de457d8d0f18 bus: ti-sysc: Fix using configured sysc mask value
    84b9540898a9 bus: ti-sysc: Fix handling of forced idle
    9f500d6b3df2 ARM: OMAP2+: Fix missing SYSC_HAS_RESET_STATUS for dra7 epwmss
    cff4410f5d31 ARM: dts: am57xx: Disable voltage switching for SD card
    05b57db138f3 ieee802154: hwsim: unregister hw while hwsim_subscribe_all_others fails
    b090ed1779d8 ieee802154: hwsim: Fix error handle path in hwsim_init_module
    6fc6065f5f2c nl80211: Fix possible Spectre-v1 for CQM RSSI thresholds
    fb91d697f851 mwifiex: Fix three heap overflow at parsing element in cfg80211_ap_settings
    314a961abd99 tty/serial: atmel: reschedule TX after RX was started
    3bf0e241c813 serial: sprd: correct the wrong sequence of arguments
    3049e5125169 firmware: google: check if size is valid when decoding VPD data
    ad0ef1b06e7b KVM: coalesced_mmio: add bounds checking
    0d84424bdfcd net: dsa: Fix load order between DSA drivers and taggers
    7f4aa339581b xen-netfront: do not assume sk_buff_head list is empty in error handling
    82369aa61ec7 udp: correct reuseport selection with connected sockets
    a4cb1c43dc6c net_sched: let qdisc_put() accept NULL pointer
    81608038502a net/sched: fix race between deactivation and dequeue for NOLOCK qdisc
    8a00845c5d64 ip6_gre: fix a dst leak in ip6erspan_tunnel_xmit
    8d3dc8dfe890 net: aquantia: fix limit of vlan filters
    bd950d777e3a net: hns: fix LED configuration for marvell phy
    854c67e19e73 scripts/decode_stacktrace: match basepath using shell prefix operator, not regex
    88f16147459f powerpc/mm/radix: Use the right page size for vmemmap mapping
    badbf863ed91 nfs: disable client side deduplication
    543792290cce media: stm32-dcmi: fix irq = 0 case
    1fb6db57b831 SUNRPC: Handle connection breakages correctly in call_status()
    5d96613b372d Input: elan_i2c - remove Lenovo Legion Y7000 PnpID
    41a22481ec5d HID: wacom: generic: read HID_DG_CONTACTMAX from any feature report
    7902ff2b8c97 netfilter: nf_flow_table: set default timeout after successful insertion
    e9bc4f96c596 net: hns3: adjust hns3_uninit_phy()'s location in the hns3_client_uninit()
    32e50e282ea7 phy: renesas: rcar-gen3-usb2: Disable clearing VBUS in over-current
    262c7b193cbb media: tm6000: double free if usb disconnect while streaming
    1fc15d29540a USB: usbcore: Fix slab-out-of-bounds bug during device reset

(From OE-Core rev: ee7b48e1ca1e4262941f71a1735ec5b4a9cfc11d)

Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-09-27 13:02:16 +01:00