Commit Graph

66971 Commits

Author SHA1 Message Date
Marius Kriegerowski
4cc94de992 scriptutils: fix style to be more PEP8 compliant
(From OE-Core rev: 61b346d6c309ebfef50c88260bf5a0650c74db16)

Signed-off-by: Marius Kriegerowski <marius.kriegerowski@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 12:46:45 +01:00
Paulo Neves
73f9326d2a libcheck: Fix too long shebang for native case.
It requires a shebang wrapper due to the fact that awk interpreter
has an argument.

(From OE-Core rev: 3ced538ef2b6d509bec5a619837382de574c710e)

Signed-off-by: Paulo Neves <ptsneves@gmail.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 12:37:52 +01:00
Paulo Neves
eb997a6801 utils: Add cmdline_shebang_wrapper util.
Useful to work around shebang relocation issues, where
shebangs are too long or have arguments in them, thus preventing them
from using the /usr/bin/env shebang.

(From OE-Core rev: 6edc1fffcbe1405d8c309a75643d7d6cd9a92848)

Signed-off-by: Paulo Neves <ptsneves@gmail.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 12:37:52 +01:00
Paulo Neves
00458ee0f8 oeqa/selftest: Test staged .la and .pc files
These files are checked by qa_check_staged but there was no
test cases for whether the tests actually worked. Now there
are.

(From OE-Core rev: 2a96719a201cb7b8db774718adec89dbd7e1aec3)

Signed-off-by: Paulo Neves <ptsneves@gmail.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 12:37:52 +01:00
Paulo Neves
53f0ee8d42 oeqa/selftest: Add test for shebang overflow
Make sure we do not stage any executable with a bigger shebang
than 128. Fixes [1]

[1] https://bugzilla.yoctoproject.org/show_bug.cgi?id=11053

(From OE-Core rev: 280f68528c93b5ffab888c99190accf59e807a3f)

Signed-off-by: Paulo Neves <ptsneves@gmail.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 12:37:52 +01:00
Paulo Neves
82589b5936 insane.bbclass: Make do_qa_staging check shebangs
As reported in the bug report [1], there was no check for shebang
sizes on native scripts and now this is fixed.

The path scope of the qa_staging was increased from just checking
libdir to all the relevant SYSROOT_DIRS.

It is possible to skip this check through INSANE_SKIP.

[1] https://bugzilla.yoctoproject.org/show_bug.cgi?id=11053

(From OE-Core rev: 377fe11bc0d6939ab1aaebab1bf4e55adca1ab15)

Signed-off-by: Paulo Neves <ptsneves@gmail.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 12:37:52 +01:00
Gennaro Iorio
241a27ea80 bitbake: fetch2: gitsm: fix incorrect handling of git submodule relative urls
As specified by git submodule manual relative urls can start either
with '..' or './', second case was incorrectly managed leading to an
interpretation of urls starting with './' as absoulte urls.

(Bitbake rev: 4a0bd3bcd1f7fc25364df8bbf185ff64881c015b)

Signed-off-by: Gennaro Iorio <gennaro.iorio@schindler.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 12:20:18 +01:00
Ross Burton
dfaabf971b ncurses: use GitHub mirror, not Debian's packaging
The GitHub mirror of ncurses is updated daily, whereas the Debian
packaging repository is only updated when they do an upgrade.

(From OE-Core rev: 3c53e0dfb2d41ab2c933764ecd5a56c5f43bf8eb)

Signed-off-by: Ross Burton <ross.burton@arm.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 11:53:33 +01:00
Richard Purdie
2106f39272 openssl: Upgrade 3.0.3 -> 3.0.4
Includes a fix for CVE-2022-2068.

(From OE-Core rev: f034faebd45e63385849078e6ee4b51257763e99)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 11:31:42 +01:00
Kai Kang
f062b02ba8 glibc-tests: not clear BBCLASSEXTEND
It clears BBCLASSEXTEND in glibc-tests recipe to remove 'nativesdk'
which is set in glibc recipe. The side effect is that it removes
"${MULTILIBS}" at same time if multilib enabled. Then there will no
multilib version glibc-tests. So only remove 'nativesdk' from
BBCLASSEXTEND rather than clear it.

(From OE-Core rev: d15975441471c9367b6d8cfa094f093e80f910d4)

Signed-off-by: Kai Kang <kai.kang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 11:31:42 +01:00
wangmy
1c54741c61 createrepo-c: upgrade 0.20.0 -> 0.20.1
(From OE-Core rev: 90793f0e1d67e9f8d84f9c8ad8e576aeec5d12aa)

Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 11:31:42 +01:00
wangmy
a2c589410d sudo: upgrade 1.9.11p2 -> 1.9.11p3
Changelog:
==========
- Fixed "connection reset" errors on AIX when running shell scripts with the
  intercept or log_subcmds sudoers options enabled. Bug #1034.
- Fixed very slow execution of shell scripts when the intercept or log_subcmds
  sudoers options are set on systems that enable Nagle's algorithm on the
  loopback device, such as AIX. Bug #1034.

(From OE-Core rev: 2eaf00e0470b6b77910a349b74f9a634f6a42fb1)

Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 11:31:42 +01:00
wangmy
175d133ed3 sqlite3: upgrade 3.38.5 -> 3.39.0
(From OE-Core rev: 632bf7426a904322904af87c9083b22d6b3c1566)

Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 11:31:42 +01:00
wangmy
c6aad1b4b6 repo: upgrade 2.26 -> 2.27
(From OE-Core rev: 089fb55d7dddd2b6862b267b527f3fc2783f897c)

Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 11:31:42 +01:00
wangmy
c60bec10c7 speex: upgrade 1.2.0 -> 1.2.1
CVE-2020-23903.patch
removed since it's included in 1.2.1

License-Update:
  Add "Organisation (CSIRO)" to Copyright 2005-2008

Changelog:
===========
 Check for _WIN32 instead of WIN32 in preprocessor checks
 wav_io: check for EOF when seeking in wav (fixes hang discovered by fuzzing, see #9)
 CI: add gitlab CI integration
 fixed-point: make left shift macros use unsigned to avoid undefined behaviour
 math_approx: use unsigned int for LCG pseudorandom generator (avoids integer overflow)
 oss-fuzz: add integration and fuzzing target
 speexenc: guard against invalid channel numbers (see #13)
 speexdec: make left shift macros use unsigned to avoid undefined behaviour
 autotools: do not use deprecated macros

(From OE-Core rev: 4a0bd109d59bd51c98ce31c9a9e7904a88e01215)

Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 11:31:42 +01:00
wangmy
a13b12b3c5 speexdsp: upgrade 1.2.0 -> 1.2.1
License-Update:
  Add "Organisation (CSIRO)" to Copyright 2005-2008

Changelog:
=========
    CI: add gitlab CI integration
    fixed-point: Remove unused MULT16_32_Q1[1-4] macros and inlines
    fixed-point: don't truncate 32-bit arg to MULT16_32_Q15
    fixed-point resample: remove 1-bit shift right before interpolation
    fixed-point: introduce MULT16_32_32 to handle unexpected types in MULT16_32_Q15
    Fix incorrect macro names in arch.h
    Remove unused stack_alloc.h
    autotools: do not use deprecated macros

(From OE-Core rev: 71b9992799981d5211b4f38a53b7bafe8d1b9c38)

Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 11:31:42 +01:00
wangmy
01aad9dd15 harfbuzz: upgrade 4.3.0 -> 4.4.0
Changelog:
==========
- Caching of variable fonts shaping, in particular when using HarfBuzz’s own
  font loading functions (ot). Bringing performance of variable shaping in par
  with non-variable fonts shaping.
- Caching of format 2 “Contextual Substitution” and “Chained Contexts
  Substitution” lookups. Resulting in up to 20% speedup of lookup-heavy fonts
  like Gulzar or Noto Nastaliq Urdu.
- Improved ANSI output from hb-view.
- Support for shaping legacy, pre-OpenType, Windows 3.1-era, Arabic fonts
  that relied on a fixed PUA encoding.
- Sinhala script is now shaped by the USE shaper instead of “indic” one.
- Thai shaper improvements.
- hb-ot-name API supports approximate BCP-47 language matching, for example
  asking for “en_US” in a font that has only “en” names will return them.
- Optimized TrueType glyph shape loading.
- Fix subsetting of HarfBuzz faces created via hb_face_create_for_tables().
- Add 32 bit var store support to the subsetter.
- New API
 +HB_BUFFER_FLAG_DEFINED
 +HB_BUFFER_SERIALIZE_FLAG_DEFINED
 +hb_font_changed()
 +hb_font_get_serial()
 +hb_ft_hb_font_changed()
 +hb_set_hash()
 +hb_map_copy()
 +hb_map_hash()

(From OE-Core rev: bfe0f5b8fe449d2f7a4ac9d3629220a4190f70c5)

Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 11:31:42 +01:00
wangmy
c25bce521c git: upgrade 2.36.1 -> 2.37.0
(From OE-Core rev: bfd4abe83f9eae572559b9ec0f33a252dff566f5)

Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 11:31:42 +01:00
wangmy
5f58d68352 dmidecode: upgrade 3.3 -> 3.4
Changelog:
==========
  - Support for SMBIOS 3.4.0. This includes new memory device types, new
    processor upgrades, new slot types and characteristics, decoding of memory
    module extended speed, new system slot types, new processor characteristics
    and new format of Processor ID.
  - Support for SMBIOS 3.5.0. This includes new processor upgrades, BIOS
    characteristics, new slot characteristics, new on-board device types, new
    pointing device interface types, and a new record type (type 45 -
    Firmware Inventory Information).
  - Decode HPE OEM records 194, 199, 203, 236, 237, 238 ans 240.
  - Bug fixes:
    Fix OEM vendor name matching
    Fix ASCII filtering of strings
    Fix crash with option -u
  - Minor improvements:
    Skip details of uninstalled memory modules
    Don't display the raw CPU ID in quiet mode
    Improve the formatting of the manual pages

(From OE-Core rev: 5928085c909365d7569f26243058a328ef2832e1)

Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 11:31:42 +01:00
Ross Burton
b88129ed32 busybox: fix CVE-2022-30065
(From OE-Core rev: bf3d981b0303eab91d4cb19092ac27b489c8ad27)

Signed-off-by: Ross Burton <ross.burton@arm.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 11:31:42 +01:00
Thomas Roos
603652a38e recipetool/devtool: Fix python egg whitespace issues in PACKAGECONFIG
Substitute expressions or whitespace from python egg requires.txt when
generating PACKAGECONFIG

Pysetuptools sees the uvicorn.egg-info/requires.txt as extra requirements.
Recipetool parses this information to generate the PACKAGECONFIG.
These extra requirements contain expressions and whitespace, which are not allowed in PACKGAGECONFIG.
This patch substitute them by hyphens to make PACKAGECONFIG parsable and readable.
Also adding an oe-selftest for this.

[YOCTO #14446]

(From OE-Core rev: a854d95a79e64f3f82abfa4cc1daec750abf4249)

Signed-off-by: Thomas Roos <throos@amazon.de>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-07-01 11:31:42 +01:00
Aryaman Gupta
6958024ed2 buildperf/base.py: skip reduced_proc_pressure directory
Buildperf was designed to skip all non-directories under buildstats, i.e. proc
log files. With the /proc/pressure stats being collected in a new directory,
the following error was seen:
	meta/lib/oeqa/buildperf/base.py", line 392, in split_nevr
    	n_e_v, revision = nevr.rsplit('-', 1)
	ValueError: not enough values to unpack (expected 2, got 1)

Add an additional check to skip the reduced_proc_pressure directory.

(From OE-Core rev: d3a25dd7aa63ab98c8bb931b4b3bc61807806ed3)

Signed-off-by: Aryaman Gupta <aryaman.gupta@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30 23:38:01 +01:00
Michael Opdenacker
012c046628 dev-manual: improve screenshot resolution
Screenshot from executing an NPM package built by npm.bbclass

(From yocto-docs rev: 57acf2f65e5e5798f369a24c4a0cc9b5cdb8e1db)

Signed-off-by: Michael Opdenacker <michael.opdenacker@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30 17:09:51 +01:00
Michael Opdenacker
df1904a85f dev-manual: update section about creating NPM packages
From running the instructions using Poky master

In particular, update command output and the contents
of generated files.

The "cute-files" example application can now directly be run,
without having to run it through "node".

(From yocto-docs rev: a100fb1e25e3f2e144d771d31e952deae2fe3302)

Signed-off-by: Michael Opdenacker <michael.opdenacker@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30 17:09:51 +01:00
Aatir Manzur
9900bb5d13 docs: add CONVERSION_CMD definition
(From yocto-docs rev: 05d376ccc65510a7d636e2685fb92a48d4712b0b)

Signed-off-by: Aatir Manzur <aatrapps@gmail.com>
Reviewed-by: Michael Opdenacker <michael.opdenacker@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30 17:09:51 +01:00
Richard Purdie
b10ba003c8 cve-extra-exclusions: Clean up and ignore three CVEs (2xqemu and nasm)
Remove obsolete comments/data from the file. Add in three CVEs to ignore.
Two are qemu CVEs which upstream aren't particularly intersted in and aren't
serious issues. Also ignore the nasm CVE found from fuzzing as this isn't
a issue we'd expose from OE.

(From OE-Core rev: 68291026aab2fa6ee1260ca95198dd1d568521e5)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30 16:34:36 +01:00
Aryaman Gupta
4678581ea0 buildstats.py: close /proc/pressure/cpu file descriptor
Use python 'with' symantics to ensure that the /proc/pressure/cpu file
descriptor used in SystemStats init is closed. Previously, this would
lead to a single file descriptor being leaked. For example:
   ResourceWarning: unclosed file <_io.BufferedReader name='/proc/pressure/cpu'>

(From OE-Core rev: 643653160cd77d346cdc9b9ec25c7212c7dfe176)

Signed-off-by: Aryaman Gupta <aryaman.gupta@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30 10:54:46 +01:00
Richard Purdie
a26721d83b oe-selftest-image: Ensure the image has sftp as well as dropbear
We need sftp so that scp works with recent openssh. Use the packagegroup
instead of a direct dependency to ensure this.

(From OE-Core rev: 2b76c8e5fc8802bbe54371119e6bf6312bf2a8ec)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30 10:27:17 +01:00
Ross Burton
271909fa4b cve-check: hook cleanup to the BuildCompleted event, not CookerExit
The cve-check class writes temporary files to preserve state across the
build, and cleans them up in a CookerExit handler.

However, in memory-resident builds the cooker won't exit in between
builds, so the state isn't cleared and the CVE report generation fails:

NOTE: Generating JSON CVE summary
ERROR: Error adding the same package twice

Easily solved by hooking to BuildCompleted, instead of CookerExit.

(From OE-Core rev: fccdcfd301de281a427bfee48d8ff47fa07b7259)

Signed-off-by: Ross Burton <ross.burton@arm.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30 10:27:17 +01:00
Ross Burton
1d2b1161a9 cups: ignore CVE-2022-26691
This is fixed in 2.4.2, which we have, but the complex CPE in that CVE
isn't parsed by cve-check correctly so it thinks that we're vulnerable.

(From OE-Core rev: b40dd920f8b40eabe78db363249257818c63c074)

Signed-off-by: Ross Burton <ross.burton@arm.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30 10:27:17 +01:00
Richard Purdie
d71d4b7625 ncurses: 6.3 -> 6.3+20220423
Includes a fix for CVE-2022-29458

(From OE-Core rev: 6032a1049d4693f17ab7f4b67f9b22719decadde)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30 10:27:17 +01:00
Richard Purdie
38f3d1749b vim: 8.2.5083 -> 9.0.0005
The license checksum changed due to a major version change in the referenced file.

(From OE-Core rev: 89f34d8aa4f4572d048dbb732ca4c83d443157fb)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-30 10:27:17 +01:00
Peter Bergin
701ac97c15 rust: fix issue building cross-canadian tools for aarch64 on x86_64
Commit bd36593ba3db758b3eacc974e48468a665967961 did introduce a
regression when building package rust-cross-canadian-aarch64
on a x86_64 host. This commit will fix that configuration.

Suggested-by: Richard Purdie <richard.purdie@linuxfoundation.org>

(From OE-Core rev: ef566af964e9f9d2c440a3b5771ed801216f30f9)

Signed-off-by: Peter Bergin <peter@berginkonsult.se>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29 16:16:56 +01:00
Pgowda
95f8fe68ee binutils : CVE-2019-1010204
Upstream-Status: Backport [https://sourceware.org/git/gitweb.cgi?p=binutils-gdb.git;h=2a4fc266dbf77ed7ab83da16468e9ba627b8bc2d]

(From OE-Core rev: 0c55355a83130c2c0a59e9fb94f8914499943dd4)

Signed-off-by: Pgowda <pgowda.cve@gmail.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29 16:16:56 +01:00
wangmy
df34fc372b python3-pycryptodome: upgrade 3.14.1 -> 3.15.0
Changelog:
=========

New features
------------
    Add support for curves Ed25519 and Ed448, including export and import of keys.
    Add support for EdDSA signatures.
    Add support for Asymmetric Key Packages (RFC5958) to import private keys.

Resolved issues
---------------
    GH#620: for Crypto.Util.number.getPrime , do not sequentially scan numbers searching for a prime.

(From OE-Core rev: 5ed8d56bfcc5b38746d27585e064ff2a0489c1c0)

Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29 16:16:56 +01:00
wangmy
b7e874cd34 python3-numpy: upgrade 1.22.4 -> 1.23.0
Changelog:
==========
The NumPy 1.23.0 release continues the ongoing work to improve the
handling and promotion of dtypes, increase the execution speed, clarify
the documentation, and expire old deprecations. The highlights are:

    Implementation of loadtxt in C, greatly improving its performance.
    Exposing DLPack at the Python level for easy data exchange.
    Changes to the promotion and comparisons of structured dtypes.
    Improvements to f2py.

(From OE-Core rev: 8ac4f77e10b5c73b05c06a712b4c4eccd7681762)

Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29 16:16:56 +01:00
wangmy
2eb83dbc9f python3-dbusmock: upgrade 0.28.0 -> 0.28.1
Changelog:
==========
Again works on RHEL/CentOS 8 (0.27 broke there), now in CI
Avoid glib GI dependency for main dbusmock, for running in virtualenv

(From OE-Core rev: f56350997a8e4678d14abe798d6eb2356b061147)

(From OE-Core rev: e14def00341b3f2f03e9fc8857aa804daaf329e9)

Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29 16:16:56 +01:00
wangmy
042f05285e python3-certifi: upgrade 2022.5.18.1 -> 2022.6.15
(From OE-Core rev: 0a1b314e4cfa8b9ab25ba5b54a12a4862090f214)

Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29 16:16:56 +01:00
wangmy
c4917e660c python3-babel: upgrade 2.10.1 -> 2.10.3
Changelog
=========
    Fallback count=”other” format in format_currency() (#872)

    Fix get_period_id() with dayPeriodRule across 0:00 (#871)

    Add support for b and B period symbols in time format (#869)

    chore(docs/typo): Fixes a minor typo in a function comment (#864)

(From OE-Core rev: 57fe354881a31b8a60d32db4aa561e22fc7bf0a5)

Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29 16:16:56 +01:00
wangmy
3b7d901780 python3-importlib-metadata: upgrade 4.11.4 -> 4.12.0
License-Update:
  Add text content of “http://www.apache.org/licenses/LICENSE-2.0" to LICENSE

Changelog:
===========
py-93259: Now raise ValueError when None or an empty string are passed to
Distribution.from_name (and other callers).

(From OE-Core rev: 3c7237a7348bc85dbc8086aa6fb079af1fa97979)

Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29 16:16:56 +01:00
wangmy
edfa791cc9 python3-chardet: upgrade 4.0.0 -> 5.0.0
This release is the first release of chardet that no longer supports Python < 3.6.

License-Update: Adjust document format, change "St" to "Street"

(From OE-Core rev: d8bc9503058b067d4157b9177c16d06136918071)

Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29 16:16:56 +01:00
Aryaman Gupta
1125adc33b buildstats.bbclass: correct sampling of system stats
The last time of sampling would be updated within the SystemStats class
but not re-recorded into the datastore, leading to multiple samples being
collected in the same second in the sample function of buildstats.py.
Fix this to collect and store only one sample per second within a
certain tolerance to deal with variation in the arrival time.

This fix elimates the spikiness of sampled data, in cases where the difference
between the current and the last sample is taken. Previously, since many
samples per second were recorded, certain types of data would result in a
very small elapsed time and hence a small numerical difference. For example,
the CPU usage from /proc/stat is a running total of usage and taking the
difference between data collected 0.1 seconds apart would result in usage
appearing lower than it actually was.

(From OE-Core rev: 0e2df45ab066bb4ad2c4f8622ee9c1a8ecdea9cb)

Signed-off-by: Aryaman Gupta <aryaman.gupta@windriver.com>
Signed-off-by: Randy MacLeod <randy.macleod@windriver.com>
Signed-off-by: Luca Ceresoli <luca.ceresoli@bootlin.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29 16:16:56 +01:00
Aryaman Gupta
45f1e9d953 pybootchartgui: render cpu and io pressure
Add two new, separate charts showing the avg10 and delta
total pressure over time for the CPU and IO resources. The height of
the avg10 data in each chart represents the percentage of time "some"
task was delayed over the specific resource during the last 10
seconds of the build. The height of the delta total data in each chart
represents the total time "some" task was delayed since the last sample
was collected. If the reduced_proc_pressure data is not present in the
buildstats log, then the new charts are not shown at all rather than
being present but unpopulated.

Note that the delta total graphs may appear "spikey",
oscillating from high values to low. This behaviour is fixed in a
subsequent commit.

(From OE-Core rev: fb9ff46dc3059cb3f4c8df8e4654184c3eab1571)

Signed-off-by: Aryaman Gupta <aryaman.gupta@windriver.com>
Signed-off-by: Randy MacLeod <randy.macleod@windriver.com>
Signed-off-by: Luca Ceresoli <luca.ceresoli@bootlin.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29 16:16:56 +01:00
Aryaman Gupta
ac162116b3 buildstats.py: enable collection of /proc/pressure data
The Linux pressure monitoring system helps determine when system resources
are being overutilized by measuring how contended the CPU, IO and memory are.
This information can be found under /proc/pressure/ which contains 3 files -
cpu, memory and io. In each of the files, the format is as follows:
	some avg10=70.24 avg60=68.52 avg300=69.91 total=3559632828
	full avg10=57.59 avg60=58.06 avg300=60.38 total=3300487258

The "some" state of a given resource represents when one or more tasks are delayed
on that resource whereas the "full" state represents when all the tasks are
delayed. Currently, we only collect data from the "some" state but the
"full" data can simply be appended to the log files if neccessary.
The "avg10", "avg60" and "avg300" fields represent the average percentage
of time runnable tasks were delayed in the last 10, 60 or 300 seconds
respectively. The "total" field represents the total time, in microseconds,
that some runnable task was delayed on a resource.
More information can be found at:
	https://www.kernel.org/doc/html/latest/accounting/psi.html
and in the source code under kernel/sched/psi.c

This commit adds functionality to collect and log the "some" CPU, memory and IO
pressure. The "avg10", "avg60" and "avg300" fields are logged without change.
In place of the "total" field, the difference between the current "total" and
the previous sample's "total" is logged, allowing the measurement of pressure
in between each polling interval, as was done for /proc/stat data. The log files
are stored in:
	<build_name>/tmp/buildstats/<build_time>/reduced_proc_pressure/{cpu,io,memory}.log
mirroring the directory structure of /proc/pressure. If the /proc/pressure
directory does not exist or the resource files can't be read/opened, the
reduced_proc_pressure directory is not created.

(From OE-Core rev: 061931520b8baa7f3a03bf466aa9ec8bf995bc14)

Signed-off-by: Aryaman Gupta <aryaman.gupta@windriver.com>
Signed-off-by: Randy MacLeod <randy.macleod@windriver.com>
Signed-off-by: Luca Ceresoli <luca.ceresoli@bootlin.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29 16:16:56 +01:00
niko.mauno@vaisala.com
ba6160f2e0 strace: Drop redundant oe_runmake parameter
PARALLEL_MAKE is now honored in ptest.bbclass, so drop redundant
parameter from oe_runmake call.

(From OE-Core rev: c314316831ac602a31275c303c36974e8a632ce5)

Signed-off-by: Niko Mauno <niko.mauno@vaisala.com>
Signed-off-by: Luca Ceresoli <luca.ceresoli@bootlin.com>
Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-29 16:16:56 +01:00
Richard Purdie
ddbd90a37c bitbake.conf: Change -dev RDEPENDS to RRECOMMENDS
Switch the default DEPENDS for ${PN}-dev to be a RRECOMMENDS instead. This
takes advantage of a change to complmentary package globbing to not follow
RRECOMMENDS and means and SDK for an image with both openssh and dropbear
compoments will now build successfully.

(From OE-Core rev: 6f28420ab0e8f2ab5eb06326024777a40aded0a6)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-28 23:49:38 +01:00
Richard Purdie
73cf55cdde bitbake.conf/recipes: Introduce add DEV_PKG_DEPENDENCY to change RDEPENDS:${PN}-dev
There is a pattern that several recipes need to break the dependency of ${PN}-dev
on ${PN}, most often as ${PN} may be be empty. Add a new variable to parameterise
this and allow it to be changed more easily.

(From OE-Core rev: a5b381c0f45c590a762647a9956a8f41e2e2315e)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-28 23:49:37 +01:00
Ross Burton
4705dd2646 package_manager: Change complementary package handling to not include soft dependencies
We've some long standing bugs where the RDEPENDS from -dev packages causes
problems, e.g. dropbear and openssh components on an image working fine together
but then the SDK failing to build as the main openssh and dropbear packages
conflict with each other (pulled in by openssh-dev and dropbear-dev).

We propose changing the behavour of complementary package installation to
ignore RRECOMMENDS. If we then change the ${PN}-dev dependency on ${PN}
to a RRECOMMENDS, we can avoid many of the issues people run into yet still
have the desired behaviour of ${PN}-dev pulling in ${PN}.

This therefore changes the package manager code so that it doesn't follow
RRECOMMENDS for completementary package globs.

[RP: Added deb support]
(From OE-Core rev: b44b0b9294675f89aa51ff84f532664f4c479677)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-28 23:49:37 +01:00
Richard Purdie
e8f188c510 packagegroup-core-ssh-dropbear: Add openssh-sftp-server recommendation
Seems sad to have to do this but openssh is moving to use sftp instead
of scp to move files. This means scp from Fedora 36 will no longer be
able to move files to/from a dropbear based image. This breaks a number
of our key QA tests and I suspect will cause users pain too.

The sftp server from openssh is small (200kb uncompressed) and standalone
so adding it to the packagegroup seems to be the best way to preserve user
sanity. If people really don't want it, they can just use dropbear instead
of the packageground.

(From OE-Core rev: a98188e83b2c027d99cc38e3367e1ec2a98efbb0)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-28 23:49:37 +01:00
Alexander Kanavin
ce5b6b8d16 pango: exclude 1.9x versions which are 2.x pre-releases.
(From OE-Core rev: 5f03fe6d3655649fd43774afe65bc2590a416c58)

Signed-off-by: Alexander Kanavin <alex@linutronix.de>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-06-28 12:55:26 +01:00