]> code.ossystems Code Review - openembedded-core.git/log
openembedded-core.git
6 years agoselftest/wic: Improve error message for test_fixed_size
Richard Purdie [Mon, 23 Jul 2018 10:54:20 +0000 (10:54 +0000)]
selftest/wic: Improve error message for test_fixed_size

Currently this can fail with a message like 127 != 0 which is unhelpful.

If we remove the ignore_status=False, the debugging from runCmd is much
more helpful printing status.output.

Also remove the now unneeded exit code check.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoRevert "relocate_sdk.py: remove hardcoded SDK path"
Richard Purdie [Wed, 25 Jul 2018 15:45:23 +0000 (16:45 +0100)]
Revert "relocate_sdk.py: remove hardcoded SDK path"

This reverts commit 6671a4d980c8bef8f402780a308f6c43a25044aa.

This breaks uninative tarball since the call of relocate_sdk.py from uninative.bbclass
wasn't updated to account for this change. It isn't clear what value that code could
pass in and this isn't simple to fix so revert until a better fix can be found
that doesn't break uninative.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agouninative-tarball: Add nativesdk-libnss-nis to resolve glibc symbol issues
Richard Purdie [Tue, 24 Jul 2018 10:48:45 +0000 (11:48 +0100)]
uninative-tarball: Add nativesdk-libnss-nis to resolve glibc symbol issues

We need this to avoid symbol mismatch issues for binaries that use this
on newer systems which then won't run on older ones where it isn't present.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooe-selftest: fix for changes to buildhistory-diff
Paul Eggleton [Mon, 23 Jul 2018 12:40:14 +0000 (14:40 +0200)]
oe-selftest: fix for changes to buildhistory-diff

Now we're not reporting the related fields (as of openembedded-core
8658b3677b9f7cb70806061c41570c709086ef05) we shouldn't expect to see
PR reported here since it's not monitored by buildhistory-diff. However,
with a bit of messing about we can check for the exact output that we
should now see as a result of the test changing PR to go backwards.

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agolib/oe/utils: Drop now unused multiprocess_exec
Richard Purdie [Fri, 20 Jul 2018 15:19:57 +0000 (15:19 +0000)]
lib/oe/utils: Drop now unused multiprocess_exec

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agopackage/package_manager: multiprocess_exec -> multiprocess_launch
Richard Purdie [Fri, 20 Jul 2018 15:15:38 +0000 (15:15 +0000)]
package/package_manager: multiprocess_exec -> multiprocess_launch

After this replacement, the parent exception handling works so we don't
need subprocess wrapping with bb.error in the underlying functions.

The underlying contexts also have better module handling so the imports
can be cleaned up.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agopackage: Clean up getstatusoutput usage
Richard Purdie [Fri, 20 Jul 2018 15:44:05 +0000 (15:44 +0000)]
package: Clean up getstatusoutput usage

Replace usage of oe.utils.getstatusoutput() with direct subprocess calls. The
call is just a wraper to the subprocess call of the same name and requires
the caller to handle exceptions themselves. We usually do this badly, failing
to show the output or the command or the return code.

Its much safer to rely on a call like subprocess.check_output() instead.

This also makes it easier to spot and remove cases where shell=True isn't
needed in a later cleanup.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agosstate/bitbake.conf: Use pigz if available
Richard Purdie [Fri, 20 Jul 2018 10:25:17 +0000 (10:25 +0000)]
sstate/bitbake.conf: Use pigz if available

Currently the compression of sstate objects is single threaded. In the case
of ltp, this takes around 33s. If we add pigz into the list of non-fatal
HOSTTOOLS and then use if it available when building the sstate object,
this time drops to around 6s.

Since pigz is now widely available this is an optimisation we should
utilise.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agopackage: Call file to determine elf status in parallel
Richard Purdie [Fri, 20 Jul 2018 09:36:06 +0000 (09:36 +0000)]
package: Call file to determine elf status in parallel

This allows the calls to is_elf (which calls file) to happen in parallel
allowing a speedup of do_package and do_populate_sysroot for native
recipes.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agopackage: Refactor to remove isElf/is_elf function duplication
Richard Purdie [Fri, 20 Jul 2018 08:45:28 +0000 (08:45 +0000)]
package: Refactor to remove isElf/is_elf function duplication

There are probably further cleanups needed here but this at least removes
the major code duplication between these two similar funcitons, keeping the
kernel module ".ko" extension check for efficiency to avoid opening and
reading file contents in the general case.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agopackage: Allow parallel processing of shlib analysis
Richard Purdie [Fri, 20 Jul 2018 08:32:49 +0000 (08:32 +0000)]
package: Allow parallel processing of shlib analysis

This function is a bit more invasive to add parallelism to but
allows the shlibs analysis to happen in multiple threads. In order
to return values correctly/safely the data types needed tweaking
to avoid lists and use immutable objects.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agopackage: Allow parallel processing of debug splitting
Richard Purdie [Fri, 20 Jul 2018 08:31:59 +0000 (08:31 +0000)]
package: Allow parallel processing of debug splitting

Adjust the code so that the splitting of debug symbols from files happens
in parallel. To to this we need to move some path handling code into the
main function and pass more parameters in.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agopackage: Don't use subshell to execute file
Richard Purdie [Fri, 20 Jul 2018 08:29:12 +0000 (08:29 +0000)]
package: Don't use subshell to execute file

We don't need any functionality from the shell here, its just extra fork
overhead. Therefore remove it and use subprocess directly.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agopackage: Drop subshell usage for dwarfsrcfile generation.
Richard Purdie [Thu, 19 Jul 2018 20:59:05 +0000 (20:59 +0000)]
package: Drop subshell usage for dwarfsrcfile generation.

The command for running dwarfsrcfiles is simple and does not need a subshell
for each execution. By expanding out this function to use check_output()
from subprocess and a list of arguments, the shell overhead can be dropped.

For recipes with lots of files this gives a significant saving.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agopackage_ipk|deb: Use oe.utils.multiprocess_launch
Richard Purdie [Thu, 19 Jul 2018 20:32:44 +0000 (20:32 +0000)]
package_ipk|deb: Use oe.utils.multiprocess_launch

The current code had broken exception handling due to the use of a
"traceback" variable as well as an import. Use the new library code
for this instead which reduces code duplication and has fixed/improved
exception handling.

The chdir code can be dropped since any directory changes are in other
processes now so there is no need for it here and the code no longer
changes directory.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agopackage: Rework PACKAGELOCK based upon sstate for do_packagedata
Richard Purdie [Wed, 18 Jul 2018 12:54:05 +0000 (13:54 +0100)]
package: Rework PACKAGELOCK based upon sstate for do_packagedata

I think this lock dates from before we had sstate for do_packagedata.

Since WORKDIR is recipe specific and we write into WORKDIR, we no longer need
any write locks in the do_packagedata code itself, its handled by the sstate
task lock for the final copy in at the end. The final write lock can be simply
removed.

The only time we need read locking is when actually reading data from the
shared directory. We can therefore reduce the window the lock is held
significantly as well, hence improving the speed of packagedata tasks running
in parallel.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoutils: Add multiprocess_launch API and testcase
Richard Purdie [Thu, 19 Jul 2018 20:31:35 +0000 (20:31 +0000)]
utils: Add multiprocess_launch API and testcase

The current methods of spawning processes for parallel execution have
issues around collection of results or exceptions.

Take the code from package_ipk/deb, make it generic, add a results
collection mechanism, fix the exception handling and for it into a
standard library function.

Also add a test case which tests both the success and failure modes
of operation to stop this functionality regressiing again.

In particular, compared to multiprocess_exec, this fork off the parent
approach means we can pass in the datastore and functions work in the
same scope as the parent. This removes some of the complexities
found trying to scale multiprocess_exec to wider use.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoscripts/contrib/mkefidisk.sh: Remove
Richard Purdie [Fri, 20 Jul 2018 08:17:18 +0000 (09:17 +0100)]
scripts/contrib/mkefidisk.sh: Remove

This has been printing a deprecation warning for a while, now remove it
in favour of wic's efi functionality.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agomatchbox-terminal: Upgrade to 0.2
Devarsh Thakkar [Tue, 17 Jul 2018 11:11:22 +0000 (04:11 -0700)]
matchbox-terminal: Upgrade to 0.2

New version adds support for command line options
(-e and -- command) which can be used for launching
programs or running commands through matchbox-terminal.

Signed-off-by: Devarsh Thakkar <devarsht@xilinx.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agorelocate_sdk.py: remove hardcoded SDK path
Ruslan Bilovol [Wed, 22 Nov 2017 11:20:05 +0000 (13:20 +0200)]
relocate_sdk.py: remove hardcoded SDK path

This patch removes hardcodes added to relocate_sdk.py
during SDK build, making it flexible and reusable.
Now default SDK path is passed to the script as
parameter rather then harcoded inside it.

This allows to reuse this script for multiple
relocations, and adds possibility to relocate
SDK multiple times

Signed-off-by: Ruslan Bilovol <rbilovol@cisco.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooe-find-native-sysroot: drop message if pseudo is not found
Paul Eggleton [Tue, 17 Jul 2018 12:34:18 +0000 (14:34 +0200)]
oe-find-native-sysroot: drop message if pseudo is not found

pseudo won't always be in the native sysroot for a recipe, so we
shouldn't be complaining if it isn't there.

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooe-run-native: ensure arguments get quoted
Paul Eggleton [Tue, 17 Jul 2018 12:34:17 +0000 (14:34 +0200)]
oe-run-native: ensure arguments get quoted

If you pass quoted arguments to oe-run-native, they need to be passed
as-is to the underlying tool. Putting quotes around $@ ensures each
argument is quoted individually.

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoxf86-input-libinput: upgrade 0.27.1 -> 0.28.0
Ross Burton [Tue, 17 Jul 2018 16:39:09 +0000 (17:39 +0100)]
xf86-input-libinput: upgrade 0.27.1 -> 0.28.0

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoshared-mime-info: upgrade 1.9 -> 1.10
Ross Burton [Tue, 17 Jul 2018 16:39:08 +0000 (17:39 +0100)]
shared-mime-info: upgrade 1.9 -> 1.10

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoharfbuzz: upgrade 1.7.5 -> 1.8.4
Ross Burton [Tue, 17 Jul 2018 16:39:07 +0000 (17:39 +0100)]
harfbuzz: upgrade 1.7.5 -> 1.8.4

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agolibinput: upgrade 1.11.0 -> 1.11.2
Ross Burton [Tue, 17 Jul 2018 16:39:06 +0000 (17:39 +0100)]
libinput: upgrade 1.11.0 -> 1.11.2

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agopciutils: upgrade 3.5.6 -> 3.6.1
Ross Burton [Tue, 17 Jul 2018 16:39:05 +0000 (17:39 +0100)]
pciutils: upgrade 3.5.6 -> 3.6.1

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agostrace: upgrade 4.22 -> 4.23
Ross Burton [Tue, 17 Jul 2018 16:39:04 +0000 (17:39 +0100)]
strace: upgrade 4.22 -> 4.23

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoxz: upgrade 5.2.3 -> 5.2.4
Ross Burton [Tue, 17 Jul 2018 16:39:03 +0000 (17:39 +0100)]
xz: upgrade 5.2.3 -> 5.2.4

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agosysstat: upgrade 11.7.3 -> 11.7.4
Ross Burton [Tue, 17 Jul 2018 16:39:02 +0000 (17:39 +0100)]
sysstat: upgrade 11.7.3 -> 11.7.4

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agolibgpg-error: upgrade 1.31 -> 1.32
Ross Burton [Tue, 17 Jul 2018 16:39:01 +0000 (17:39 +0100)]
libgpg-error: upgrade 1.31 -> 1.32

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agognupg: upgrade 2.2.8 -> 2.2.9
Ross Burton [Tue, 17 Jul 2018 16:39:00 +0000 (17:39 +0100)]
gnupg: upgrade 2.2.8 -> 2.2.9

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agobtrfs-tools: upgrade 4.16.1 -> 4.17
Ross Burton [Tue, 17 Jul 2018 16:38:59 +0000 (17:38 +0100)]
btrfs-tools: upgrade 4.16.1 -> 4.17

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agolibyaml: upgrade to 0.2.1
Ross Burton [Tue, 17 Jul 2018 16:38:58 +0000 (17:38 +0100)]
libyaml: upgrade to 0.2.1

License changed due to copyright dates being added.

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agotcf-agent: upgrade to 1.7.0
Ross Burton [Tue, 17 Jul 2018 16:38:57 +0000 (17:38 +0100)]
tcf-agent: upgrade to 1.7.0

Remove 0001-canonicalize_file_name-is-specific-to-glibc.patch as upstream has
integrated musl support.

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agobc: upgrade to 1.07.1
Ross Burton [Tue, 17 Jul 2018 16:38:56 +0000 (17:38 +0100)]
bc: upgrade to 1.07.1

Relicensed to just GPLv3+, update LICENSE and checksums.

The build dependency for flex should be flex-native.

libmath.h is missing from the tarball (it was present in 1.06) and the
generation rules are not cross-friendly, so delete the rules and copy in a
pre-generated libmath.h.

Remove fix-segment-fault.patch as the fixes are now upstream.

Add PACKAGECONFIG for readline and libedit, defaulting to readline.

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agopackage.bbclass: exclude packages as shlib providers
Oleksii Konoplitskyi [Tue, 17 Jul 2018 15:40:34 +0000 (18:40 +0300)]
package.bbclass: exclude packages as shlib providers

Some packages containing shared libraries might be registered
as shlib providers when they shouldn't (for example, the lib is for
their private use and must not generate any dependency).

EXCLUDE_FROM_SHLIBS is targeted at that, but it could be set
for entire recipe only.

This patch allows to set list of packages that are not candidates
for shlib providers.

Variable EXCLUDE_PACKAGES_FROM_SHLIBS is used, e.g.:
EXCLUDE_PACKAGES_FROM_SHLIBS = "glibc-ptest glibc-mtest"

Cc: Andrii Bordunov <aborduno@cisco.com>
Signed-off-by: Oleksii Konoplitskyi <okonopli@cisco.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agosystemd-boot: upgrade to 239
Chen Qi [Tue, 17 Jul 2018 02:05:12 +0000 (10:05 +0800)]
systemd-boot: upgrade to 239

Upgrade systemd-boot to 239.

The following patch is removed due to recent fix about meson's cpu family
mapping and validation.

  0001-Also-check-i386-i586-and-i686-for-ia32.patch

Signed-off-by: Chen Qi <Qi.Chen@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agosystemd: upgrade to 239
Chen Qi [Tue, 17 Jul 2018 02:05:11 +0000 (10:05 +0800)]
systemd: upgrade to 239

Upgrade systemd to 239.

1. Patch Changes
* Rebased Patches
  0002-binfmt-Don-t-install-dependency-links-at-install-tim.patch
  0003-use-lnr-wrapper-instead-of-looking-for-relative-opti.patch
  0006-Make-root-s-home-directory-configurable.patch
  0027-remove-nobody-user-group-checking.patch
  0011-socket-util-don-t-fail-if-libc-doesn-t-support-IDN.patch
  0013-add-fallback-parse_printf_format-implementation.patch
  0014-src-basic-missing.h-check-for-missing-strndupa.patch
  0015-don-t-fail-if-GLOB_BRACE-and-GLOB_ALTDIRFUNC-is-not-.patch
  0016-src-basic-missing.h-check-for-missing-__compar_fn_t-.patch
  0017-Include-netinet-if_ether.h.patch
  0019-Do-not-enable-nss-tests-if-nss-systemd-is-not-enable.patch
  0022-don-t-use-glibc-specific-qsort_r.patch
  0024-comparison_fn_t-is-glibc-specific-use-raw-signature-.patch
  0026-Use-uintmax_t-for-handling-rlim_t.patch
  0030-fix-missing-of-__register_atfork-for-non-glibc-build.patch
  0031-fix-missing-ULONG_LONG_MAX-definition-in-case-of-mus.patch
  0001-core-device.c-Change-the-default-device-timeout-to-2.patch
  0001-Remove-fstack-protector-flags-to-workaround-musl-bui.patch

* Dropped Patches and Reasons
  0001-Hide-__start_BUS_ERROR_MAP-and-__stop_BUS_ERROR_MAP.patch
    This patch is dropped because the problem has been fixed by
    binutils upstream. And this workaround could be dropped.
    https://sourceware.org/bugzilla/show_bug.cgi?id=18548

  0007-Revert-rules-remove-firmware-loading-rules.patch
  0008-Revert-udev-remove-userspace-firmware-loading-suppor.patch
    These two patches are dropped because they are for kernel < 3.7.
    But the current minimal requirement of kernel to build systemd
    is as below.
    REQUIREMENTS:
        Linux kernel >= 3.13
        Linux kernel >= 4.2 for unified cgroup hierarchy support
    So these two patches no long make any sense.
    Also remove non-exist firmware-path option

  0009-remove-duplicate-include-uchar.h.patch
  0010-check-for-uchar.h-in-meson.build.patch
    These two patches are dropped because musl has implemented
    uchar.h. See commit below from musl repo.
    """
    ab9672ae73248f51e30f4553c4b8878525e46383
    implement uchar.h (C11 UTF-16/32 conversion) interfaces
    """

  0018-check-for-missing-canonicalize_file_name.patch
    The above patch is dropped because current systemd does not need
    canonicalize_file_name.

  0025-Define-_PATH_WTMPX-and-_PATH_UTMPX-if-not-defined.patch
    The above patch is dropped because utmp makes no sense in musl.
    Check code below from musl.
    include/utmp.h:#define _PATH_UTMP "/dev/null/utmp"
    And utmp PACKAGECONFIG has been explicitly disabled for musl.
    So we don't need this patch.

  0032-memfd.patch
  0033-basic-macros-rename-noreturn-into-_noreturn_-8456.patch
  libmount.patch
  0034-Fix-format-truncation-compile-failure-by-typecasting.patch
    The above patches are dropped because they are backported patches.
    And current systemd has contained these patches.

  0036-time-util-fix-build-with-gcc8-Werror-format-truncati.patch
    The above patch is dropped because it has been merged and is now
    in new version.

* Newly Added Patch
  0005-include-gshadow-only-if-ENABLE_GSHADOW-is-1.patch
    This patch is added to fix build for musl.

  0019-Do-not-disable-buffering-when-writing-to-oom_score_a.patch
    This patch is added to fix the following error which caused system
    unable to boot up.
      systemd-udevd.service: Failed to adjust OOM setting: Invalid argument
      dbus.service: Failed to adjust OOM setting: Invalid argument

  0020-distinguish-XSI-compliant-strerror_r-from-GNU-specif.patch
    This patch is added to fix segment fault error on musl systems.

  0001-login-use-parse_uid-when-unmounting-user-runtime-dir.patch
    This patch is backported to solve a race condition between
    user-runtime-dir@xxx.service stop and user deletion.

2. PACKAGECONFIG and Dependency Changes
* Add a new PACKAGECONFIG item 'gshadow'. Enable it by default for glibc
  but disable it by default for musl. This is because musl does not provide
  gshadow.h.

* Add a new PACKAGECONFIG item 'portabled'. Default to disable it because
  it's still experimental, according to the announcement letter.
  """
  Currently, the support is still experimental, but this is expected to
  change soon. Reflecting this experimental state, the "portablectl" binary
  is not installed into /usr/bin yet.
  """

* Change 'kmod' from a hard dependency to a PACKAGECONFIG item. Default
  to enable it.

* Change 'acl' from a hard dependency to a PACKAGECONFIG item. Default
  to enable it.

* Remove 'readline' from DEPENDS. systemd does not need it.

* Remove 'libcgroup' from DEPENDS. The dependency on libcgroup has been
  removed from systemd a long time ago. We now remove this unnecessary
  dependency from DEPENDS.

3. update-alternatives changes
  The utilities like shutdown, poweroff, etc. are now created as symlinks
  at do_install. So there's no need to use update-alternatives mechanism
  anymore to create the symlinks now. In addtion, I don't think we now
  support multiple init systems at one running system, so there's really
  no need to use update-alternatives mechanism here.

  Also update the FILES_${PN} to include these files to avoid QA issue.

Signed-off-by: Chen Qi <Qi.Chen@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agomusl: Update to latest master
Khem Raj [Tue, 17 Jul 2018 05:05:10 +0000 (22:05 -0700)]
musl: Update to latest master

General bug fixes

Full logs
https://git.musl-libc.org/cgit/musl/log/?qt=range&q=193338e619de7c993efa2c0e1a87240bd732c181..9cad27a3dc1a4eb349b6591e4dc8cc89dce32277

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agorecipes: Enforce ARM ISA just for arm arches <= armv5
Khem Raj [Tue, 17 Jul 2018 04:56:11 +0000 (21:56 -0700)]
recipes: Enforce ARM ISA just for arm arches <= armv5

armv7+ used thumb2 ISA and it compiles fine with thumb2
issues are only when using thumb1 ISA

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agocurl: add PACKAGECONFIG options for brotli, built-in manpages, etc
Andre McCurdy [Fri, 13 Jul 2018 21:12:25 +0000 (14:12 -0700)]
curl: add PACKAGECONFIG options for brotli, built-in manpages, etc

 - Add PACKAGECONFIG option for brotli (disable by default)
 - Add PACKAGECONFIG option for built-in manpages (disabled by
   default). Embedding a copy of the manpages within the curl binary
   adds approx 60k of gzipped data and duplicates the contents of the
   curl-doc package.
 - Add PACKAGECONFIG option for verbose error messages (enabled by
   default)
 - Disable legacy NTLM http authentication via delegation to the
   external winbind ntlm_auth helper (which isn't going to work
   without a runtime dependency on samba).

Signed-off-by: Andre McCurdy <armccurdy@gmail.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agocurl: update 7.60.0 -> 7.61.0
Andre McCurdy [Fri, 13 Jul 2018 21:12:24 +0000 (14:12 -0700)]
curl: update 7.60.0 -> 7.61.0

https://curl.haxx.se/changes.html#7_61_0

Signed-off-by: Andre McCurdy <armccurdy@gmail.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agoatk: add explicit gettext-native dependency
Ross Burton [Mon, 16 Jul 2018 15:27:47 +0000 (16:27 +0100)]
atk: add explicit gettext-native dependency

In native builds we attempt to turn off i18n but this doesn't work in Meson
yet[1] but as the gettext class reduces dependencies in native builds we need to
add gettext-native to DEPENDS explicitly.

[1] https://github.com/mesonbuild/meson/issues/821

Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agomesa: Fix build with wayland and egl
Khem Raj [Sun, 15 Jul 2018 19:44:02 +0000 (12:44 -0700)]
mesa: Fix build with wayland and egl

When wayland and egl both are on then it enables the wayland
plugin which actually fails to build because its not finding wayland-protocol
xml templates in proper location which is recipe sysroot since
we are cross compiling

Fixes build errors e.g.
make[4]: *** No rule to make target `//usr/share/wayland-protocols/unstable/linux-dmabuf/linux-dmabuf-unstable-v1.xml', needed by `drivers/dri2/linux-dmabuf-unstable-v1-client-protocol.h'.  Stop.
make[4]: *** Waiting for unfinished jobs....

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agospdx.bbclass: Encode strings before passing to hashlib
Olof Johansson [Mon, 16 Jul 2018 15:05:56 +0000 (17:05 +0200)]
spdx.bbclass: Encode strings before passing to hashlib

In python3, passing a unicode object to hashlib will result in an
exception that encourages you to encode it first.

Signed-off-by: Olof Johansson <olofjn@axis.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agospdx.bbclass: Make use of bb.utils' sha1_file()
Olof Johansson [Mon, 16 Jul 2018 15:05:55 +0000 (17:05 +0200)]
spdx.bbclass: Make use of bb.utils' sha1_file()

The same functionality already exists within bitbake, so avoid
duplicating.

Signed-off-by: Olof Johansson <olofjn@axis.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agospdx.bbclass: Fix undefined variable error
Olof Johansson [Mon, 16 Jul 2018 15:05:54 +0000 (17:05 +0200)]
spdx.bbclass: Fix undefined variable error

The path variable is used in an error message a few lines later, but was
never defined.

Signed-off-by: Olof Johansson <olofjn@axis.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agospdx.bbclass: Replace deprecated string.replace with str.replace
Olof Johansson [Mon, 16 Jul 2018 15:05:53 +0000 (17:05 +0200)]
spdx.bbclass: Replace deprecated string.replace with str.replace

The string.replace function is removed in python3. Instead, the str
method "replace" should be used instead.

Signed-off-by: Olof Johansson <olofjn@axis.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agoperl: update to 5.24.4
Andrej Valek [Mon, 16 Jul 2018 11:40:58 +0000 (13:40 +0200)]
perl: update to 5.24.4

 - fix CVE-2018-6797, CVE-2018-6798, CVE-2018-6913
 - remove patches, which are now included in update
 - refresh patches

Signed-off-by: Andrej Valek <andrej.valek@siemens.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agobash: fix wrong exit status offset
Rui Wang [Mon, 16 Jul 2018 02:55:08 +0000 (10:55 +0800)]
bash: fix wrong exit status offset

In Linux,8 bits of the return code and 8 bits of the number of
the killing signal are mixed into a single value on the exit code,
so the exit status offset should be 8. But the autoconf checker
can not determine it while cross compiling, and then it is set to
the default value 0, which will cause generating the wrong exit
code if program exit with an error code.

Signed-off-by: Rui Wang <rui.wang@windriver.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agopackagegroups: Disable unbuildable dependencies for riscv64
Khem Raj [Sun, 15 Jul 2018 19:44:03 +0000 (12:44 -0700)]
packagegroups: Disable unbuildable dependencies for riscv64

This helps with cleaner world build parsing logs

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agoepiphany: fix epiphany cannot start problem
Changqing Li [Fri, 13 Jul 2018 01:08:56 +0000 (09:08 +0800)]
epiphany: fix epiphany cannot start problem

Add RDEPEND of gsettings-desktop-schemas to fix below error:
Error: GLib-GIO-ERROR: Settings schema 'org.gnome.desktop.background'
is not installed

This depend was setted in gnome-desktop before, but dropped when we
drop gnome-desktop after upgrade epiphany to 3.28.1.1.

Signed-off-by: Changqing Li <changqing.li@windriver.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agooeqa/sdk/python: clean up Python test
Ross Burton [Mon, 16 Jul 2018 12:54:42 +0000 (13:54 +0100)]
oeqa/sdk/python: clean up Python test

For the same reasons as the runtime Python test, clean up the SDK test.

Also port from Python 2 to Python 3, as that's what is supported now.

Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agooeqa/runtime/python: clean up Python test
Ross Burton [Mon, 16 Jul 2018 12:12:38 +0000 (13:12 +0100)]
oeqa/runtime/python: clean up Python test

Currently this is three test cases:

1) test_python_exists.  Fail if python3 isn't in PATH.
2) test_python_stdout.  Run a Python script and check the output is as expected
3) test_python_testfile.  Check that a file test_python_stdout wrote to exists.

(1) should be a setup and skip the test module if it isn't present.
(2) and (3) should be merged, there's no point copying over a two line Python
file, and the test doesn't verify that the file doesn't exist in the first
place.

Rewrite the test to check that Python is present in a class setup so the entire
test is skipped if it isn't and do some simple rot13 to verify that bytecode is
being executed correctly.

Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agognutls: use HTTP instead of FTP
Ross Burton [Mon, 16 Jul 2018 10:29:41 +0000 (11:29 +0100)]
gnutls: use HTTP instead of FTP

HTTP is in general more reliable so use that in the SRC_URI.

Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agogstreamer1.0-plugins-good: disable gtk plugin
Anuj Mittal [Fri, 13 Jul 2018 06:57:55 +0000 (14:57 +0800)]
gstreamer1.0-plugins-good: disable gtk plugin

gtk-play example assumes that GTK's GL support always works if it is
compiled in and first tries to use gtkglsink element which leads to
problems if there are errors while instantiating GL context at a much
later stage. This failure isn't detected and there is no fallback at
this point.

gtkglsink works on wayland though using poky defaults with gtk+3 since
the gdk backend does support egl with wayland but it doesn't with x11.

Disable the gtk plugin to ensure gtk-play just moves on when gtkglsink
isn't present. This was the default when gtk was part of -plugins-bad
before upgrade to 1.14.0.

Fixes [YOCTO #12832]

Signed-off-by: Anuj Mittal <anuj.mittal@intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agolibva-utils: upgrade 2.1.0 -> 2.2.0
Anuj Mittal [Fri, 13 Jul 2018 02:39:44 +0000 (10:39 +0800)]
libva-utils: upgrade 2.1.0 -> 2.2.0

* Add vainfo support in Android
* Remove driver specific test cases

Signed-off-by: Anuj Mittal <anuj.mittal@intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agolibva: upgrade 2.1.0 -> 2.2.0
Anuj Mittal [Fri, 13 Jul 2018 02:39:43 +0000 (10:39 +0800)]
libva: upgrade 2.1.0 -> 2.2.0

* Bump VA-API version to 1.2.0
* Add support for hevc range extension decoding
* Add support for fast intra prediction in HEVC FEI
* Add 10/12-bit YUV render target formats
* Add fourcc code for Y210/Y216/Y410/Y416/RGB565/BGR565
* Add VA_STATUS_ERROR_NOT_ENOUGH_BUFFER
* Add VA_SURFACE_ATTRIB_USAGE_HINT_EXPORT
* Improve documentation

Tested with Intel vaapi driver. There is support for meson available but
its not being packaged as part of release tarball yet.

Signed-off-by: Anuj Mittal <anuj.mittal@intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agotiff: security fix CVE-2018-10963
Joe Slater [Thu, 12 Jul 2018 18:48:17 +0000 (11:48 -0700)]
tiff: security fix CVE-2018-10963

Denial of service described at https://nvd.nist.gov/vuln/detail/CVE-2018-10963.

Signed-off-by: Joe Slater <joe.slater@windriver.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agopython-setuptools: rationalise dependencies
Ross Burton [Thu, 12 Jul 2018 20:00:47 +0000 (21:00 +0100)]
python-setuptools: rationalise dependencies

There's no need to do native- and nativesdk-specific DEPENDS as the
BBCLASSEXTENDs handles those renames for us.

There's no need to have a subset of RDEPENDS for class-native as all with the
new manifest the python-native PROVIDES are complete.

Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agopython-setuptools.inc: avoid using += with an over-ride
Andre McCurdy [Wed, 4 Jul 2018 00:55:22 +0000 (17:55 -0700)]
python-setuptools.inc: avoid using += with an over-ride

An over-ride replaces the original value regardless of whether or
not it's set up with +=. As replacing the original value seems to be
the intention here, drop the += to make it more explicit. Also some
minor recipe formatting tweaks.

Signed-off-by: Andre McCurdy <armccurdy@gmail.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agoinsane: optimise buildpath search
Ross Burton [Thu, 12 Jul 2018 13:44:06 +0000 (14:44 +0100)]
insane: optimise buildpath search

Instead of decoding every file we open as UTF-8 (with many errors as machine
code isn't UTF-8), convert the build path to the UTF-8 byte representation and
search for that instead.

Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agofile: fix regression for determining DB file type
Yi Zhao [Thu, 12 Jul 2018 05:19:36 +0000 (13:19 +0800)]
file: fix regression for determining DB file type

The version 5.33 introduced a regression bug for determining the DB file
type. Backport a patch from upstream to fix it.

Before apply the patch:
$ file aliases.db
aliases.db: created: Thu Jan  1 00:38:24 1970, modified: Thu Jan  1 00:00:00 1970

After apply the patch:
$ file aliases.db
aliases.db: Berkeley DB (Btree, version 9, native byte-order)

Signed-off-by: Yi Zhao <yi.zhao@windriver.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agowic/engine: use up all free space when expanding partitions
Anuj Mittal [Thu, 12 Jul 2018 02:05:25 +0000 (10:05 +0800)]
wic/engine: use up all free space when expanding partitions

Currently we just divide up the free space by the number of partitions
that need to be re-sized. This leads to problems when a user has
explicitly specified a subset of partitions (but not all) that need
to re-sized along with the sizes. As an example, for an image with 3
partitions, if we use:

wic write image.wic /dev/sdb --expand 1:10G

This would lead to paritions 2 and 3 each being re-sized to one thirds
of the free space instead of half.

Change the behavior to use up all the free space.

Signed-off-by: Anuj Mittal <anuj.mittal@intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agowic/engine: fix errors when expanding partitions
Anuj Mittal [Thu, 12 Jul 2018 02:05:24 +0000 (10:05 +0800)]
wic/engine: fix errors when expanding partitions

The UEFI spec implies that GPT partitions should be assumed to be on a 2048
sector boundary (for a 512 byte sector) and the current logic just
divides the free sectors available by the number of partitions that need
re-sizing, which may or may not align and the final result might
overshoot the limits imposed after alignment.

Since we are expanding already aligned partitions, just divide up the
free space in multiples of 2048. Also use the exec_cmd wrapper instead
of the subprocess call directly.

Fixes [YOCTO #12840]

Signed-off-by: Anuj Mittal <anuj.mittal@intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agomesa: remove hardware float patch
Ross Burton [Wed, 11 Jul 2018 18:14:11 +0000 (19:14 +0100)]
mesa: remove hardware float patch

We don't need the texture float patches anymore, as the relevant patents have
expired so this defaults to on now.

Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agoqemux86*: Add U-Boot machine configuration
Marek Vasut [Wed, 11 Jul 2018 15:03:08 +0000 (17:03 +0200)]
qemux86*: Add U-Boot machine configuration

Add U-Boot machine configuration for the qemux86 and qemux86-64
to allow building U-Boot on those targets. This in turn allows
the auto-updater to update the U-Boot recipe.

Signed-off-by: Marek Vasut <marex@denx.de>
Cc: Alexander Kanavin <alexander.kanavin@linux.intel.com>
Cc: Otavio Salvador <otavio@ossystems.com.br>
Cc: Richard Purdie <richard.purdie@linuxfoundation.org>
Cc: Ross Burton <ross.burton@intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agou-boot: Upgrade to 2018.07 release
Marek Vasut [Wed, 11 Jul 2018 15:03:07 +0000 (17:03 +0200)]
u-boot: Upgrade to 2018.07 release

This upgrades the U-Boot from 2018.05 to 2018.07 release.

Signed-off-by: Marek Vasut <marex@denx.de>
Cc: Alexander Kanavin <alexander.kanavin@linux.intel.com>
Cc: Otavio Salvador <otavio@ossystems.com.br>
Cc: Richard Purdie <richard.purdie@linuxfoundation.org>
Cc: Ross Burton <ross.burton@intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agou-boot: Add missing dependency on flex and bison native
Marek Vasut [Wed, 11 Jul 2018 15:03:06 +0000 (17:03 +0200)]
u-boot: Add missing dependency on flex and bison native

The U-Boot build, in particular the Kconfig, depends on bison and
flex native. Add the missing dependencies.

Signed-off-by: Marek Vasut <marex@denx.de>
Cc: Alexander Kanavin <alexander.kanavin@linux.intel.com>
Cc: Otavio Salvador <otavio@ossystems.com.br>
Cc: Richard Purdie <richard.purdie@linuxfoundation.org>
Cc: Ross Burton <ross.burton@intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agoclasses/buildhistory: properly process escaped chars from pkgdata
Paul Eggleton [Wed, 11 Jul 2018 14:56:51 +0000 (16:56 +0200)]
classes/buildhistory: properly process escaped chars from pkgdata

All values written out to pkgdata are escaped (see write_if_exists() in
package.bbclass). In practice there tend not to be characters that need
escaping except in the scriptlets (pkg_preinst, pkg_postinst, pkg_prerm
and pkg_postrm) where currently we still see the escape codes in the
corresponding files within buildhistory (e.g. \n and \t) and thus also
in the output of buildhistory-diff, hindering proper diffing of changes.
To fix this, when we read values from pkgdata and write them out to
buildhistory, we need to interpret the escape codes by doing the exact
reverse of what we do in package.bbclass.

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agoclasses/buildhistory: handle packaged files with names containing spaces
Paul Eggleton [Wed, 11 Jul 2018 14:56:50 +0000 (16:56 +0200)]
classes/buildhistory: handle packaged files with names containing spaces

The FILELIST field of the package info file in the buildhistory
repository is a space-separated list of all of the files in the package.
If a name of a file packaged by a recipe contains a space character then
of course the result was that we didn't handle its name properly. To fix
that, use quotes around any filename containing spaces and at the other
end use these quotes to extract the proper entries.

Fixes [YOCTO #12742].

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agolib/oe/buildhistory_analysis: drop related field feature
Paul Eggleton [Wed, 11 Jul 2018 14:56:49 +0000 (16:56 +0200)]
lib/oe/buildhistory_analysis: drop related field feature

The original idea here was that changes to certain fields might be able
to be explained if there was a change to another field, for example if
RDEPENDS changed it might be because DEPENDS changed. Thus we were
printing this kind of thing out with each change. Unfortunately in
practice this turned out to be noisy and not particularly useful, so we
might as well remove it.

Fixes [YOCTO #7336].

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agolibdrm: allow to build native and nativesdk
Martin Jansa [Tue, 10 Jul 2018 08:07:02 +0000 (08:07 +0000)]
libdrm: allow to build native and nativesdk

Signed-off-by: Martin Jansa <Martin.Jansa@gmail.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agolttng-modules: Fix do_compile failure for btrfs related tracepoints
He Zhe [Tue, 10 Jul 2018 10:03:42 +0000 (18:03 +0800)]
lttng-modules: Fix do_compile failure for btrfs related tracepoints

Building lttng-modules with linux-yocto-dev will cause do_compile
failure:

lttng-modules/2.10.6-r0/lttng-modules-2.10.6/probes/../probes/lttng-tracepoint-event-impl.h:143:6: error: conflicting types for 'trace_btrfs_reserve_extent'
 void trace_##_name(_proto);
      ^~~~~~

The following commit from latest mainline kernel changes some btrfs
functions' prototype.

3dca5c942dac60164e6a6e89172f25b86af07ce7
"btrfs: trace: Remove unnecessary fs_info parameter for btrfs__reserve_extent event class"

This patch backports a commit from upstream to meet the above changes.

51ab0b1da29354375a19f865abcd233dd2178295
"Fix: btrfs: Remove unnecessary fs_info parameter"

Signed-off-by: He Zhe <zhe.he@windriver.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agooeqa/parselogs: remove references to BSPs that no longer exist
Anuj Mittal [Wed, 11 Jul 2018 05:20:48 +0000 (13:20 +0800)]
oeqa/parselogs: remove references to BSPs that no longer exist

These platform specifc BSPs were removed from meta-intel and superseded by
intel-core* BSPs.

Signed-off-by: Anuj Mittal <anuj.mittal@intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agopopulate_sdk_base: Use default value assignment for SDK_TITLE/SDKEXTPATH
Richard Purdie [Mon, 16 Jul 2018 20:33:06 +0000 (21:33 +0100)]
populate_sdk_base: Use default value assignment for SDK_TITLE/SDKEXTPATH

This allows the user mode flexibility about centrally overriding these
rather than needing to do it on a per recipe basis.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/decorator: Improve reliability
Richard Purdie [Sun, 15 Jul 2018 12:02:50 +0000 (12:02 +0000)]
oeqa/decorator: Improve reliability

Checking if the dependency had any failure is unreliable, for example
if the underlying data doesn't get transferred and the list is empty,
success of the dependency is assumed.

Since we now have success data available, change the code to use it.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agotestsdk: Enable multiprocess execution
Richard Purdie [Fri, 13 Jul 2018 15:23:54 +0000 (15:23 +0000)]
testsdk: Enable multiprocess execution

This uses the new concurrenttest code to enable parallel test execution
if specified.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa: Remove xmlrunner
Richard Purdie [Fri, 13 Jul 2018 12:13:10 +0000 (13:13 +0100)]
oeqa: Remove xmlrunner

This isn't present on modern distros by default and doesn't work with
testtools, needing multiple code paths in the code. Remove it in favour
of finding a better replacement for results collection/analysis.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/runner: Simplify code
Richard Purdie [Wed, 11 Jul 2018 11:54:20 +0000 (11:54 +0000)]
oeqa/runner: Simplify code

There doesn't appear to be any reason we need this _results indirection
any more so remove it.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/core/threaded: Remove in favour of using concurrenttests
Richard Purdie [Thu, 12 Jul 2018 11:10:38 +0000 (11:10 +0000)]
oeqa/core/threaded: Remove in favour of using concurrenttests

We have several options for parallel processing in oeqa, parallel
execution of modules, threading and mulitple processes for the runners.

After much experimentation is appears the most scalable and least
invasive approach is multiple processes using concurrenttestsuite
from testtools. This means we can drop the current threading code
which is only used by the sdk test execution.

oeqa/decorator/depends: Remove threading code

Revert "oeqa/sdk: Enable usage of OEQA thread mode"
This reverts commit adc434c0636b7dea2ef70c8d2c8e61cdb5c703b1.

Revert "oeqa/core/tests: Add tests of OEQA Threaded mode"
This reverts commit a4eef558c9933eb32413b61ff80a11b999951b40.

Revert "oeqa/core/decorator/oetimeout: Add support for OEQA threaded mode"
This reverts commit d3d4ba902dee8b19fa1054330cffdf73f9b81fe7.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa: Add selftest parallelisation support
Richard Purdie [Mon, 9 Jul 2018 15:20:34 +0000 (15:20 +0000)]
oeqa: Add selftest parallelisation support

This allows oe-selftest to take a -j option which specifies how much test
parallelisation to use. Currently this is "module" based with each module
being split and run in a separate build directory. Further splitting could
be done but this seems a good compromise between test setup and parallelism.

You need python-testtools and python-subunit installed to use this but only
when the -j option is specified.

See notes posted to the openedmbedded-architecture list for more details
about the design choices here.

Some of this functionality may make more sense in the oeqa core ultimately.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/selftest/wic: Split tests into two class groups
Richard Purdie [Sat, 14 Jul 2018 16:22:19 +0000 (16:22 +0000)]
oeqa/selftest/wic: Split tests into two class groups

This improves test parallelism.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/sdkbuildproject: Capture output to quieten selftest logs
Richard Purdie [Sat, 14 Jul 2018 16:16:37 +0000 (16:16 +0000)]
oeqa/sdkbuildproject: Capture output to quieten selftest logs

Only show the output in the failure case.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agodevtool: Split tests into multiple classes
Richard Purdie [Fri, 13 Jul 2018 21:59:22 +0000 (21:59 +0000)]
devtool: Split tests into multiple classes

This allows better parallelism between the different tests as currently
this block takes the longest time to execute. devtool tests are still
all grouped into the "devtool" module for ease of exection.

This also makes it easier to execute some subset of devtool tests for
testing devtool changes.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa: Default to buffer mode for tests
Richard Purdie [Sat, 14 Jul 2018 14:50:48 +0000 (14:50 +0000)]
oeqa: Default to buffer mode for tests

Currently some tests run in buffer mode and some don't. Those that don't can
corrupt stdout/stderr. Switch to using buffer mode everywhere so we're consistent.

If there is useful output on stdout/stderr, it will be displayed if the test
fails.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/selftest/wic: Ensure initramfs exists for test_iso_image
Richard Purdie [Sat, 14 Jul 2018 11:02:07 +0000 (11:02 +0000)]
oeqa/selftest/wic: Ensure initramfs exists for test_iso_image

AssertionError: Command 'wic create mkhybridiso --image-name core-image-minimal -o /var/tmp/wic.oe-selftest/' returned non-zero exit status 1:

ERROR: _exec_cmd: gzip -f -9 -c /var/tmp/wic.oe-selftest/tmp.wic.drhn6edm/initrd.cpio > /var/tmp/wic.oe-selftest/tmp.wic.drhn6edm/initrd.cpio.gz returned '1' instead of 0
output: gzip: /var/tmp/wic.oe-selftest/tmp.wic.drhn6edm/initrd.cpio: No such file or directory

This is because in a clean build directory, the initramfs may not be rebuilt.
Add a call to ensure it is built to avoid the error.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/selftest/wic: Use a subdir of builddir, not /var/
Richard Purdie [Sat, 14 Jul 2018 11:01:24 +0000 (11:01 +0000)]
oeqa/selftest/wic: Use a subdir of builddir, not /var/

Using /var/ leave wic open to races with other processes on the system, use
a subdir of builddir instead to avoid this.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/selftest/devtool: Ensure dbus is built befoe running test
Richard Purdie [Fri, 13 Jul 2018 22:16:28 +0000 (22:16 +0000)]
oeqa/selftest/devtool: Ensure dbus is built befoe running test

If dbus isn't build first the dbus dependency of dbus-wait can't be detected
through pkgconfig and the test fails:

AssertionError: {'DEPENDS': {'dbus'}} != {}
- {'DEPENDS': {'dbus'}}
+ {} : Some expected variables not found in recipe: {'DEPENDS': {'dbus'}}

Ensure dbus is built and present in the sysroot.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/selftest/package: Use setUpLocal, not setUp
Richard Purdie [Fri, 13 Jul 2018 16:22:29 +0000 (16:22 +0000)]
oeqa/selftest/package: Use setUpLocal, not setUp

The main setUp function needs to be called and tests are meant to
define setUpLocal. For some reason this one didn't leading to errors
with recent code changes. Fix it.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/runner: Ensure we don't print misleading results output
Richard Purdie [Wed, 11 Jul 2018 11:46:01 +0000 (11:46 +0000)]
oeqa/runner: Ensure we don't print misleading results output

The current code assumes if something isn't a failure of some
kind, it was a pass. When test case IDs weren't matching, this lead
to very confusing output where things would fail, then be listed as
passing.

This adds code to track successes, ensuring we don't end up in this
position again with unmatched entries being listed as UNKNOWN.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooqqa/selftest/lic_checksum: Avoid cache reparse
Richard Purdie [Fri, 13 Jul 2018 12:24:48 +0000 (13:24 +0100)]
oqqa/selftest/lic_checksum: Avoid cache reparse

By having a consistent config for the test, a second reparse is avoided
and the test runs slightly faster.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/selftest/image_tyypedep: Avoid undefined variable failure
Richard Purdie [Wed, 11 Jul 2018 11:06:48 +0000 (11:06 +0000)]
oeqa/selftest/image_tyypedep: Avoid undefined variable failure

If something goes wrong with the test, dep can be undefined. Avoid a
traceback for this and handle it more gracefully.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/core/runner: Improve test case comparision
Richard Purdie [Wed, 11 Jul 2018 11:03:31 +0000 (11:03 +0000)]
oeqa/core/runner: Improve test case comparision

We can directly compare the test case IDs rather than representations,
then if we're using subunit to split the tests, the comparisions still
work as intended.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agofile: Security fix CVE-2018-10360
Yi Zhao [Wed, 11 Jul 2018 03:23:44 +0000 (11:23 +0800)]
file: Security fix CVE-2018-10360

CVE-2018-10360: The do_core_note function in readelf.c in libmagic.a in
file 5.33 allows remote attackers to cause a denial of service
(out-of-bounds read and application crash) via a crafted ELF file.

References:
https://nvd.nist.gov/vuln/detail/CVE-2018-10360

Patch from:
https://github.com/file/file/commit/a642587a9c9e2dd7feacdf513c3643ce26ad3c22

Signed-off-by: Yi Zhao <yi.zhao@windriver.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agowayland-protocols: upgrade 1.14 -> 1.15
Denys Dmytriyenko [Wed, 11 Jul 2018 00:50:28 +0000 (20:50 -0400)]
wayland-protocols: upgrade 1.14 -> 1.15

Signed-off-by: Denys Dmytriyenko <denys@ti.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agopython3-pygobject: update to 3.28.3
Derek Straka [Tue, 10 Jul 2018 21:17:43 +0000 (17:17 -0400)]
python3-pygobject: update to 3.28.3

Update the python3-pygobject package to the latest stable version

Tested on the qemu with core-image-minimal

Signed-off-by: Derek Straka <derek@asterius.io>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agopython*-setuptools: update to 40.0.0
Derek Straka [Tue, 10 Jul 2018 21:16:02 +0000 (17:16 -0400)]
python*-setuptools: update to 40.0.0

Update the python{3}-setuptools to the latest stable version

Tested on the qemu with core-image-minimal

Signed-off-by: Derek Straka <derek@asterius.io>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agoxorg-xserver: Enable systemd-logind if using systemd
Alistair Francis [Tue, 10 Jul 2018 21:08:15 +0000 (14:08 -0700)]
xorg-xserver: Enable systemd-logind if using systemd

Enable the systemd-logind on xserver if the user set systemd as a
DISTRO_CONFIG. If a user is buildling Xorg with systemd then they most
likley want the systemd-logind PACKAGECONFIG set.

Signed-off-by: Alistair Francis <alistair.francis@wdc.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>