Commit Graph

37 Commits

Author SHA1 Message Date
Richard Purdie
b0130fcf91 meta/meta-selftest/meta-skeleton: Update LICENSE variable to use SPDX license identifiers
An automated conversion using scripts/contrib/convert-spdx-licenses.py to
convert to use the standard SPDX license identifiers. Two recipes in meta-selftest
were not converted as they're that way specifically for testing. A change in
linux-firmware was also skipped and may need a more manual tweak.

(From OE-Core rev: ceda3238cdbf1beb216ae9ddb242470d5dfc25e0)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2022-02-20 16:45:25 +00:00
Richard Purdie
ddcf16d1f7 meta: Add explict branch to git SRC_URIs
There is uncertainty about the default branch name in git going forward.
To try and cover the different possible outcomes, add branch names to all
git:// and gitsm:// SRC_URI entries.

This update was made with the script added to contrib in this patch which
aims to help others convert other layers.

(From OE-Core rev: b51c405faf6f8c0365f7533bfaf470d79152a463)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-30 18:56:47 +01:00
Tim Orling
baa7f7f62f ptest-runner: install -collect-system-data script
When ptest-runner times out or otherwise fails, it tries to
call ptest-runner-collect-system-data, so install the script.

The script currently calls dmesg, df, free (which are provided
by busybox, etc.) and pstree (which is a sub-package of psmisc).

Add pstree as an RDEPENDS.

(From OE-Core rev: 4e6be3fb521b23cfc175d0c09725bcc3ebbc73b2)

Signed-off-by: Tim Orling <timothy.t.orling@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-09 17:21:47 +01:00
Anibal Limon
35b8966e61 recipes-support/ptest-runner: Bump to v2.4.2
Changes,

bcb8280 utils.c: add system data collection when a test gets stuck.
c29240c utils.c: handle test timeouts directly with poll()
d6f509f tests/utils.c: fix a memory corruption in find_word
c10e747 main: Do not return number of failed tests when calling ptest-runner
4958988 utils.c: fix memory leak in run_ptests()
fcfa6a1 clang: clean-ups to avoid -Weverything warnings.
215e52d Makefile: allow using CC env var to pick compiler
fdd233d mem: Simplify memory management
e5e218a mem: Fix memleak for ptest_opts
0dc42eb git: Extend the gitignore

(From OE-Core rev: 710fa373375beb977af704e17a925ed41c9a858d)

Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-09-29 21:47:45 +01:00
Richard Purdie
bb6ddc3691 Convert to new override syntax
This is the result of automated script conversion:

scripts/contrib/convert-overrides.py <oe-core directory>

converting the metadata to use ":" as the override character instead of "_".

(From OE-Core rev: 42344347be29f0997cc2f7636d9603b1fe1875ae)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-08-02 15:44:10 +01:00
Jose Quaresma
faf1197865 ptest-runner: libgcc must be installed for pthread_cancel to work
This only affects glibc systems and have been
found on runqemu core-image-minimal with gstreamer ptest-runner

STOP: ptest-runner
libgcc_s.so.1 must be installed for pthread_cancel to work
Aborted

(From OE-Core rev: 1cb679e6a4528a2cef16f65342d5e65adb14cb16)

Signed-off-by: Jose Quaresma <quaresma.jose@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-05-04 22:48:16 +01:00
Alexander Kanavin
c4f54b4638 ptest-runner: correct version check
(From OE-Core rev: 0942515b32d79fd1043adaa27942203680b31cfa)

Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-04-05 15:29:02 +01:00
Anibal Limon
da98b5281e ptest-runner: Upgrade to 2.4.1
Changes:

cce0edb utils.c: wait_child reimplement timeout using alarm
acbba90 utils.c: Use a thread to read from child
cb2840a utils.c: Fix exit status of a child
77bc79e utils.c: get_available_ptests allow to specify relative directories
d27e242 README.md: Small fix mtrace call
c5d5831 tests/utils.c: Add braces in START_TEST/END_TEST now required in check 0.15.x

(From OE-Core rev: e3fd8f17dfb41173dbe037c25087a69f90b1346f)

Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-04-05 15:29:01 +01:00
Richard Purdie
744a463831 ptest-runner: Fix license as it contains 'or later' clause
The license headers are clear that the code is "or later", fix LICENSE
to match.

(From OE-Core rev: 5f0b5cdfcb104ac50222a47652e090ad8770e49f)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-11-08 14:03:20 +00:00
Khem Raj
d3e9e5ebf3 ptest-runner: Backport patch to fix inappropriate ioctl error
The srcrev bump is actually bring single commit [1] on top of 2.4.0 which fixes ptest
runs with messges like

ERROR: Unable to detach from controlling tty, Inappropriate ioctl for device

[1] https://git.yoctoproject.org/cgit/cgit.cgi/ptest-runner2/commit/?id=834670317bd3f6e427e1ac461c07ada6b8936dfd

(From OE-Core rev: 791da075619139fa55751f8013c73d2fbf0cf64c)

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-09-28 14:15:48 +01:00
Alexander Kanavin
5df6dc4437 ptest-runner: fix upstream version check
(From OE-Core rev: fd180d21ec907726b2fcd7709b93cb8e464390d5)

Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-06-04 13:27:31 +01:00
Anibal Limon
792d1ebba9 ptest-runner: Bump to 2.4.0
Add support for un ptests in multiple directories, useful in multilib
builds.

Changes,

1e9a845 Add support to specify multiple folder for ptest-runner
287ba30 Makefile: Fix TEST_LDFLAGS gcc cmdline position

[YOCTO #12604]

(From OE-Core rev: 1203ee86e3cf4d73f6ba513452717f1c4f78c501)

Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2020-05-02 09:08:53 +01:00
Randy MacLeod
640c59a706 ptest-runner: update from 2.3.1 to 2.3.2
All local patches are now upstream so they have been dropped.
Other upstream commits make ptest-runner build using: clang -Weverything

$ git log --oneline b73bd54..7015e91
7015e91 (HEAD -> oe-core-master, tag: v2.3.2, origin/master, origin/HEAD, master) Fix additional warnings when using clang
dd1daa8 tests: fix clang warnings.
15fd131 main code: fix clang warnings
59381a6 utils: ensure child can be session leader
5fe2c0a utils: Ensure pipes are read after exit
79a9c27 use process groups when spawning
b73bd54 utils: Ensure stdout/stderr are flushed

(From OE-Core rev: 9a80a352a9d0c4ea09de7bb370267672c32771f2)

Signed-off-by: Randy MacLeod <Randy.MacLeod@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-08-03 23:56:01 +01:00
Randy MacLeod
8478801d49 ptest-runner: enable child procs as session leader
When running the run-execscript bash ptest as a user rather than root, a warning:
  bash: cannot set terminal process group (16036): Inappropriate ioctl for device
  bash: no job control in this shell
contaminates the bash log files causing the test to fail. This happens only
when run under ptest-runner and not when interactively testing!

The changes made to fix this include:
1. Get the process group id (pgid) before forking,
2. Set the pgid in both the parent and child to avoid a race,
3. Find, open and set permission on the child tty, and
4. Allow the child to attach to controlling tty.

(From OE-Core rev: 83795a83505a311058130c662ff3342b0e39e67f)

Signed-off-by: Randy MacLeod <Randy.MacLeod@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-06-18 11:23:48 +01:00
Sakib Sajal
ee5544f301 ptest-runner: update SRCREV to latest HEAD on ptest-runner2 repo
63d097c Add SPDX-License-Identifier: GPL-2.0-or-later in source files (HEAD)
   fb93c99 utils.c: close all file descriptors after completing a ptest

(From OE-Core rev: 4115805fb4ff47fc794651ca59c858f91fe26fc7)

Signed-off-by: Sakib Sajal <sakib.sajal@windriver.com>
Signed-off-by: Randy Macleod <randy.macleod@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-06-06 00:40:07 +01:00
Richard Purdie
65b37734c7 ptest-runner: Add several logging fixes
This change adds three patches to improve the handling of stdout/stderr and child
processes to try and improve logging reliability in ptest-runner.

(From OE-Core rev: 1c0fffc401cdb581a93d16d225f53c83359ff209)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-04-09 13:44:39 +01:00
Aníbal Limón
f1fa6e1bb9 ptest-runner: Upgrade to 2.3.1
Changeset,

05b112b utils.c: Print DURATION after ERROR
acb5efb utils.c: run_child redirect stderr to stdout
e1062f7 ptest-runner: make DEFAULT_DIRECTORY be able to be defined when compiling

(From OE-Core rev: f0b3fa049e0395ffc56237404f79975852ce4e4e)

Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-01-31 23:23:26 +00:00
Li Zhou
a5c4807022 ptest-runner: pass libdir to DEFAULT_DIRECTORY when compiling
Ptest data are installed to PTEST_PATH ?= "${libdir}/${BPN}/ptest".
When libdir isn't "/usr/lib", it will cause "No ptests found" error
when running "ptest-runner" command. Here pass libdir to
DEFAULT_DIRECTORY when compiling to avoid that error.

Need update ptest-runner source code to get the new commit:
<ptest-runner: make DEFAULT_DIRECTORY be able to be defined when compiling>

(From OE-Core rev: 1447afd62035f42344a32a487bec408e6563d5f6)

Signed-off-by: Li Zhou <li.zhou@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-01-24 17:45:25 +00:00
Aníbal Limón
b1c2ef099c ptest-runner: Upgrade to 2.3
Addes support to report timeout in XML file and duration in
stdout and XML file.

See,

http://git.yoctoproject.org/cgit/cgit.cgi/ptest-runner2/commit/?id=a16f2c137b
http://git.yoctoproject.org/cgit/cgit.cgi/ptest-runner2/commit/?id=8071258373

(From OE-Core rev: c2e069a7f8396d0fe62ad75b76202c29ea84d21c)

Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2019-01-11 10:39:09 +00:00
Aníbal Limón
69942186ed recipes-support/ptest-runner: Upgrade to v2.2
The new version contains an option to exclude certain tests to
run, example:

$ ptest-runner -e "perl"

(From OE-Core rev: e529b8a68741992a21be874b62c0ea37f51d6a19)

Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-05-08 16:14:14 +01:00
Aníbal Limón
d151c42749 ptest-runner: Upgrade to 2.1.1
Contains fixes,

- timeout option missing the argument option ":" to getopt
- utils.c: Prefer monotonic clock to calculate elapsed time
- Add support to avoid load/run twice a run_ptest script

(From OE-Core rev: 843fccd46323268252ea698e3b8ab956dd4b48e0)

Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-01-02 17:24:37 +00:00
Yi Zhao
08752aa58f ptest-runner: fix segfault with -t option
The ptest-runner would segfault with -t option:
root@qemux86-64:~# ptest-runner -d /usr/lib test_pkg -t 5
[  237.234112] ptest-runner[810]: segfault at 0 ip 000000382e638060 sp
00007fff9130f400 error 4 in libc-2.26.so[382e600000+1a7000]

It is safe to bump SRCREV to latest upstream commit to fix this issue
because there is only one commit since the last update:

  commit 8a93832dad621535e90aa8e1fb74ae5ba743fc3e
  Author: Anders Wallin <wallinux@gmail.com>
  Date:   Sun May 28 11:47:00 2017 +0200

      timeout option missing the argument option ":" to getopt

      ptest-runner -t xx gives segfault

      Signed-off-by: Anders Wallin <wallinux@gmail.com>
      Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>

(From OE-Core rev: 503ce98bb89dfa019faff872121c8911e6465b05)

Signed-off-by: Yi Zhao <yi.zhao@windriver.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-09-22 17:15:30 +01:00
Aníbal Limón
c4a5fb4e81 ptest-runner: Upgrade to to 2.1+gitAUTOINC+78afe246fb
The new 2.1 version supports creating XML results specifying the
-x option.

The xml output format can be see here [1].

[1] https://wiki.yoctoproject.org/wiki/QA/xUnit_XML_Template

(From OE-Core rev: 93742e37797ef0659bb030cee23a6e3c35e92479)

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-05-18 14:01:47 +01:00
Aníbal Limón
b283b10d53 ptest-runner: Upgrade to minor version 2.0.2
To fix a problem when print ERROR after a ptest timeout, this
causes the user confusion about if a test ends or not.

[YOCTO #10842]

(From OE-Core rev: 210c518ba8f8d6ec6e9d34e0df8b963a3b2e0593)

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-04-11 18:10:18 +01:00
Edwin Plauchu
6c22e39f06 ptest-runner: recipe update related to minor fix.
A minor fix has been published regarding the need of a user
of being noticed when some run-ptest script fails.

Also Found modifications to ptest unit test stuff
* removed unnecessary code from unit test run_timeout_ptest
* added test case for run_ptest failure

Finally..
New content within contributions section of README.md.

[YOCTO #9752]

(From OE-Core rev: 94030ce3322b51d20c7d4a35381c053a4d765ae0)

Signed-off-by: Edwin Plauchu <edwin.plauchu.camacho@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-09-28 10:16:03 +01:00
Christian Schuler
5b5c426225 ptest-runner: allow building from externalsrc
The ${WORKDIR}/git refers to the source folder S which is different in
the case of an external source build.

(From OE-Core rev: fd4f4264a99cb0f8d20e3d87f66102d99cb5b6ad)

Signed-off-by: Christian Schuler <schuler.christian@siemens.com>
Signed-off-by: Pascal Bach <pascal.bach@siemens.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-09-15 12:15:07 +01:00
Aníbal Limón
9e20f94c77 ptest-runner_2.0.bb: Update recipe to point git.yoctoproject.org repo.
Since ptest-runner is a Yocto Project tool is better to have hosted
into git.yoctoproject.org.

(From OE-Core rev: 2fa1e9b3ebf3abb2b0b49ba1404e4f18483695d9)

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-03-30 12:01:29 +01:00
Mike Crowe
246b02e281 ptest-runner: Explicitly set EXTRA_OEMAKE as required
This recipe currently relies on EXTRA_OEMAKE having been set to
"-e MAKEFLAGS=" in bitbake.conf to operate. It is necessary to make this
explicit so that the default in bitbake.conf can be changed.

(From OE-Core rev: 8092aa8ff63d9b2016bff138ec05ceb0d0155869)

Signed-off-by: Mike Crowe <mac@mcrowe.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-02-10 16:06:25 +00:00
Aníbal Limón
209066ccce ptest-runner: Add ptest-runner_2.0 recipe.
The ptest-runner 2.0 is C written program for run ptests of
Yocto/Openembedded, is fully compatible with previous version of
ptest-runner that was a shell script that runs ptests sequencially.

The mainly reason for the new ptest-runner in C is because is designed
for run in tiny systems also the old shell script version have problems
when certain ptest hang it becomes blocked indefinitely.

Now the ptest-runner 2.0 support the next features:

	- Specify the directory for search ptests.
	- List available ptests.
	- Specify the timeout for avoid blocking indefinetly.
	- Only run certain ptests.

Proposed features:

	- Adds support for per ptest output file.
	- Adds support for run ptests in parallel (review possible
	  colisions in ptests).

[YOCTO #8021]

(From OE-Core rev: 2a6746cb5e60c9c5477d1df062bb2657d2fe4780)

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-01-30 11:36:58 +00:00
Ioan-Adrian Ratiu
54df911748 ptest-runner: Allow running of specific tests
By default ptest-runner executes all ptests found in a system.
With this change, ptest-runner can be given a list of ptest
package names to run (the default is still available).

For example, to run only the zlib and rt-tests ptests:
"ptest-runner zlib rt-tests"

(From OE-Core rev: a13333c3e9ab601a11c10aba2a0a55c7fdea2e24)

Signed-off-by: Ioan-Adrian Ratiu <adrian.ratiu@ni.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2015-11-16 11:39:31 +00:00
Petter Mabäcker
4eb3db9a2c meta: set proper S value
After removal of auto-creating S we must ensure that all recipes are
using a proper value for S.

Fix all recipes that only need to set S equals to WORKDIR.

[YOCTO #5627]

(From OE-Core rev: 9d220b1bfe4589736604dd5a7129e3699377d830)

Signed-off-by: Petter Mabäcker <petter@technux.se>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2015-01-23 11:36:27 +00:00
Laszlo Papp
7361876845 ptest-runner: return 1 instead of zero if any test fails
It is better to know this information from the exit code rather than parsing
test specific outputs.

(From OE-Core rev: d6b1c9e7e29aaa8d71ccb485b7a88863a117a8b1)

Signed-off-by: Laszlo Papp <lpapp@kde.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-08-23 23:01:59 +01:00
Richard Purdie
a22ee50865 Update after toplevel LICENSE file checksum change
(From OE-Core rev: bbd88aebcabbb19c27a7d752d4a5b8ad9ff9412e)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-01-02 14:21:04 +00:00
Roy Li
495d05ce7d ptest-runner: compatibile with busybox
Do not use pushd, busybox does not support it if system only has busybox;
Replace find command with ls to avoid some busybox's find unsupported options;

(From OE-Core rev: 1f059654bc81e55896c96c7c8e32e09f8925a761)

Signed-off-by: Roy Li <rongqing.li@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-09-24 17:57:04 +01:00
Roy Li
775bc290fb ptest-runner: trivial fixes and refine
1. ptest files may be installed under /usr/lib64/ for 64bit filesystem
or under /usr/lib/ for 64bit multilib filesystem, so we should check both
directories

2. If a soft link is linking to a directory under the same directory, we
only run once.

[YOCTO #5125]
[YOCTO #5126]

(From OE-Core rev: 51c43e08b388ed15520c66977bbb49df18e5f124)

Signed-off-by: Roy Li <rongqing.li@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-09-11 11:07:59 +01:00
Paul Eggleton
87b6abee38 ptest-runner: add SUMMARY, DESCRIPTION and HOMEPAGE
(From OE-Core rev: 8986e76e8fcaeeddb23d234dbb877dcf5cc45cfe)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Saul Wold <sgw@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2013-04-29 14:45:05 +01:00
Björn Stenberg
daad0d8dda New package: ptest-runner
This package contains a simple shell script which searches for all installed
ptests on the rootfs and runs each test in sequence.

(From OE-Core rev: da25002a0968c12f16719f9fed21c76b9321aeb5)

Signed-off-by: Björn Stenberg <bjst@enea.com>
Signed-off-by: Saul Wold <sgw@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2012-12-26 11:34:04 +00:00