]> code.ossystems Code Review - openembedded-core.git/log
openembedded-core.git
6 years agolocale: Allow usage of cross-localedef for ARC
Alexey Brodkin [Mon, 12 Nov 2018 22:43:51 +0000 (01:43 +0300)]
locale: Allow usage of cross-localedef for ARC

With this it's possible to build locale data for ARC
and not do it instead on the first boot.

Signed-off-by: Alexey Brodkin <abrodkin@synopsys.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agopackagegroup-core-sdk: Disable SANITIZERS for ARC
Alexey Brodkin [Mon, 12 Nov 2018 13:09:38 +0000 (16:09 +0300)]
packagegroup-core-sdk: Disable SANITIZERS for ARC

Sanitizers are not yet supported on ARC.

Signed-off-by: Alexey Brodkin <abrodkin@synopsys.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoopkg-utils: Fix update-alternatives link relocation
Niko Mauno [Mon, 12 Nov 2018 17:30:08 +0000 (19:30 +0200)]
opkg-utils: Fix update-alternatives link relocation

Recently Debian-style support for link relocation was added to
'update-alternatives' script, but it fails under circumstances where
host rootfs root directory differs from target rootfs root directory
and two alternative packages provide a symbolic link with source
located in different directories.

An example of the case is busybox provided /bin/rev (symlinking to
/bin/busybox.nosuid) and util-linux provided /usr/bin/rev (symlinking
to /usr/bin/rev.util-linux) in which case following failure occurs
during image recipe's do_rootfs() task:

  ERROR: core-image-minimal-1.0-r0 do_rootfs: Postinstall scriptlets of ['util-linux'] have failed. If the intention is to defer them to first boot,
  then please place them into pkg_postinst_ontarget_${PN} ().
  Deferring to first boot via 'exit 1' is no longer supported.
  Details of the failure are in .../tmp/work/qemux86-poky-linux/core-image-minimal/1.0-r0/temp/log.do_rootfs.
  ERROR: core-image-minimal-1.0-r0 do_rootfs: Function failed: do_rootfs

Looking in log.do_rootfs file, following relevant lines can be observed:

  update-alternatives: renaming rev link from /bin/rev to /usr/bin/rev
  mv: cannot stat '/bin/rev': No such file or directory

Mitigate issue by applying patch which adds target root filesystem root
directory path prefix to failing 'mv' calls relevant variable references

Signed-off-by: Niko Mauno <niko.mauno@iki.fi>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agotestimage: Further cleanup DEFAULT_TEST_SUITES
Richard Purdie [Fri, 9 Nov 2018 09:59:19 +0000 (09:59 +0000)]
testimage: Further cleanup DEFAULT_TEST_SUITES

Now the test markup of the development tools tests is complete, this
can be further tweaked to auto run the correct tests.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/runtime/cases: Improve dependencies of kernel/gcc/build tests
Richard Purdie [Fri, 9 Nov 2018 09:55:40 +0000 (09:55 +0000)]
oeqa/runtime/cases: Improve dependencies of kernel/gcc/build tests

Mark up these tests as needing a compiler, make and kernel source code
as appropriate, the image feature requirements can then be retired.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agotestimage: Simplfy DEFAULT_TEST_SUITES logic
Richard Purdie [Thu, 8 Nov 2018 19:57:49 +0000 (19:57 +0000)]
testimage: Simplfy DEFAULT_TEST_SUITES logic

Now that the tests have correct markup to automatically determine which images
they can run against, clean up the default test suites logic to be simpler
and not image specific.

Some cleanup of the compiler tests still needs to be completed but this
is a good first step.

The only downside to this is more noise during testing as we now see
many skipped messages for simple images like core-image-minimal.

The auto type is being removed since it currently breaks badly due to the
socat mandatory inclusion from the meta-selftest layer which is a problem
which needs to be addressed seperately.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/runtime/cases: Improve test dependency information
Richard Purdie [Thu, 8 Nov 2018 19:55:17 +0000 (19:55 +0000)]
oeqa/runtime/cases: Improve test dependency information

Add the OEHasPackage decorator to a variety of tests so they determine
automatically if they should run against a given image.

To ensure tests can do this we need to move target operations such
as scp commands into the tests and out of the class startup/teardown.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agorng-tools: fix typo of unrecognised options: --disable-jitterntropy
Hongxu Jia [Sat, 10 Nov 2018 02:03:19 +0000 (10:03 +0800)]
rng-tools: fix typo of unrecognised options: --disable-jitterntropy

- Fix typo of `--disable-jitterntropy' in both of PACKAGECONFIG and configure --help

- Enable jitterntropy for musl

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agomaintainers.inc: Add entry for libjitterentropy (copied from rng-tools)
Richard Purdie [Sat, 10 Nov 2018 11:34:23 +0000 (11:34 +0000)]
maintainers.inc: Add entry for libjitterentropy (copied from rng-tools)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agolibjitterentropy: add 2.1.2
Hongxu Jia [Fri, 9 Nov 2018 09:12:22 +0000 (17:12 +0800)]
libjitterentropy: add 2.1.2

>From the following kernel commit we know: Fedora has integrated the jitter
entropy daemon to work around slow boot problems, especially on VM's that
don't support virtio-rng

https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=81e69df38e2911b642ec121dec319fad2a4782f3

Do the same thing for Yocto.

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agorng-tools: 5 -> 6.6
Hongxu Jia [Fri, 9 Nov 2018 09:12:21 +0000 (17:12 +0800)]
rng-tools: 5 -> 6.6

- Update SRC_URI, previously upstream is dead, latest update is 2014

- Drop read_error_msg.patch

- Rework do_configure and do_compile

- Enable jitterentropy

License-Update: Upstream changed, but license is still gplv2

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agomachine/qemu*: fix kernel finish crng init more and more slowly
Hongxu Jia [Tue, 30 Oct 2018 02:22:49 +0000 (22:22 -0400)]
machine/qemu*: fix kernel finish crng init more and more slowly

Just adding `-device virtio-rng-pci' to the QEMU invocation will
add the device with a default host backend. As of QEMU 1.3+,
the default backend is to use the host's /dev/random as a
source of entropy. [1]

When the entropy pool is empty, reads from /dev/random will
block until additional environmental noise is gathered. [2]

For Yocto, if call runqemu frequently, it will consume lots
of host's /dev/random, and kernel finish crng init in guest get
more and more slowly.

Here are 4 times runqemu boot test:

[    3.464432] random: crng init done
[   20.874030] random: crng init done
[   23.583589] random: crng init done
[   23.858945] random: crng init done

Modify entropy source to /dev/urandom device on the host which
returns random bytes using a pseudorandom number generator seeded
from the entropy pool. Reads from this device do not block and
kernel finish crng init in guest will not delay.

Of course, the side effect is obviously, we lost the quality of
randomness, but the modification is only on runqemu script
rather than real embedded device, and it benefits oeqa efficiency
in which many cases call runqemu especially multiple oeqa builds
on one host.

After apply the fix:

[    3.364670] random: crng init done
[    4.619061] random: crng init done
[    3.403897] random: crng init done
[    3.450717] random: crng init done

[1] https://wiki.qemu.org/Features/VirtIORNG
[2] http://man7.org/linux/man-pages/man4/random.4.html

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agorng-tools: Fix crazy defaults
Hongxu Jia [Fri, 9 Nov 2018 08:54:21 +0000 (16:54 +0800)]
rng-tools: Fix crazy defaults

Since commit [f1dc9ac rng-tools: Fix crazy defaults] fixed
init based on sysvinit, this fix rngd.service based on systemd.

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agotestsdk: fix skipped testcase output "UNKNOWN" status while multiprocess execution
Hongxu Jia [Fri, 9 Nov 2018 08:36:20 +0000 (00:36 -0800)]
testsdk: fix skipped testcase output "UNKNOWN" status while multiprocess execution

Usually skipped testcase output "SKIPPED"
[snip serial execution]
|RESULTS - buildgalculator.GalculatorTest.test_galculator - Testcase -1: SKIPPED (0.01s)
|RESULTS - python.PythonTest.test_python3 - Testcase -1: SKIPPED (0.01s)
[snip serial execution]

But if enable multiprocess execution, skipped testcase output "UNKNOWN" status
[snip enable multiprocess execution]
|RESULTS - buildgalculator.GalculatorTest.test_galculator - Testcase -1: UNKNOWN
|RESULTS - python.PythonTest.test_python3 - Testcase -1: UNKNOWN
[snip enable multiprocess execution]

Here is my investigation:

There is a class pairs TestProtocolClient and TestProtocolServer
provided by python3-subunit. The TestProtocolClient generates a
subunit stream of TestResult from a test run, and TestProtocolServer
parses the stream of subunit TestResult.

The class ProtocolTestCase is a unittest.TestCase adapter and it
uses TestProtocolServer to parse the stream of subunit TestResult.

In Yocto testsdk, it forks multiple processes to execute testcases
and use TestProtocolClient to generate TestResult stream; and then
it creates multiple threads to use ProtocolTestCase to parse stream
of subunit TestResult through pipe; finally it passes multiple
ProtocolTestCase as TestCase instance to main process and output
status result.

The problem point is TestProtocolServer parses `skip:' directive
after reading a `test:' directive. Without `test:' directive,
`skip:' directive will be ignored. All above requires SkipTest should
be raised inside a test method rather than setUpClass method.

Throwing SkipTest inside setUp works correctly

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agolibaio: Extend to native
Peter Kjellerstedt [Fri, 9 Nov 2018 21:08:17 +0000 (22:08 +0100)]
libaio: Extend to native

lvm2 currently requires libaio. So building lvm2-native will result in
the following error.

  ERROR: Required build target 'lvm2-native' has no buildable providers.
  Missing or unbuildable dependency chain was: ['lvm2-native', 'libaio-native']

Extend libaio to native to fix this issue.

Signed-off-by: Peter Kjellerstedt <peter.kjellerstedt@axis.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agolibsm: extend to nativesdk
Mingli Yu [Thu, 8 Nov 2018 06:08:16 +0000 (14:08 +0800)]
libsm: extend to nativesdk

After enable tk via PACKAGECONFIG for python3,
there comes below error:
Missing or unbuildable dependency chain was: ['buildtools-tarball', 'nativesdk-python3-testtools', 'nativesdk-python3-pbr', 'nativesdk-python3', 'nativesdk-tk', 'nativesdk-libxt', 'nativesdk-libsm']

Extend libsm to nativesdk to fix this issue.

Signed-off-by: Mingli Yu <Mingli.Yu@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agolibice: extend to nativesdk
Mingli Yu [Thu, 8 Nov 2018 06:08:17 +0000 (14:08 +0800)]
libice: extend to nativesdk

After enable tk via PACKAGECONFIG for python3,
there comes below error:
Missing or unbuildable dependency chain was: ['buildtools-tarball', 'nativesdk-python3-git', 'nativesdk-python3-gitdb', 'nativesdk-python3-async', 'nativesdk-python3', 'nativesdk-tk', 'nativesdk-libxt', 'nativesdk-libsm', 'nativesdk-libice']

Extend libice to nativesdk to fix this issue.

Signed-off-by: Mingli Yu <Mingli.Yu@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agofontconfig: extend to nativesdk
Mingli Yu [Thu, 8 Nov 2018 06:08:15 +0000 (14:08 +0800)]
fontconfig: extend to nativesdk

After enable tk via PACKAGECONFIG for python3,
there comes below error:
Missing or unbuildable dependency chain was: ['nativesdk-packagegroup-sdk-host', 'nativesdk-opkg', 'nativesdk-libsolv', 'nativesdk-rpm', 'nativesdk-python3', 'nativesdk-tk', 'nativesdk-xft', 'nativesdk-fontconfig']

Extend fontconfig to nativesdk to fix this issue.

Signed-off-by: Mingli Yu <Mingli.Yu@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agolibxft: extend to nativesdk
Mingli Yu [Thu, 8 Nov 2018 06:08:14 +0000 (14:08 +0800)]
libxft: extend to nativesdk

After enable tk via PACKAGECONFIG for python3,
there comes below error:
Missing or unbuildable dependency chain was: ['buildtools-tarball', 'nativesdk-python3-testtools', 'nativesdk-python3-pbr', 'nativesdk-python3', 'nativesdk-tk', 'nativesdk-xft']

Extend libxft to nativesdk to fix this issue as
PROVIDES = "xft" in libxft recipe.

Signed-off-by: Mingli Yu <Mingli.Yu@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agolibxt: extend to nativesdk
Mingli Yu [Thu, 8 Nov 2018 06:08:13 +0000 (14:08 +0800)]
libxt: extend to nativesdk

After enable tk via PACKAGECONFIG for python3,
there comes below error:
Missing or unbuildable dependency chain was: ['buildtools-tarball', 'nativesdk-python3-pytz', 'nativesdk-python3', 'nativesdk-tk', 'nativesdk-libxt']

Extend libxt to nativesdk to fix this issue.

Signed-off-by: Mingli Yu <Mingli.Yu@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agotestimage: Remove duplicate dependencies
Richard Purdie [Thu, 8 Nov 2018 20:01:43 +0000 (20:01 +0000)]
testimage: Remove duplicate dependencies

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/runtime/utils/targetbuildproject: Use a subdir within ~/
Richard Purdie [Fri, 9 Nov 2018 12:49:47 +0000 (12:49 +0000)]
oeqa/runtime/utils/targetbuildproject: Use a subdir within ~/

Without doing this, the code can and sometimes does try and do "rm ~/"
which I think we'd all prefer it didn't.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/utils/buildproject: Only clean files if we've done something
Richard Purdie [Fri, 9 Nov 2018 12:48:39 +0000 (12:48 +0000)]
oeqa/utils/buildproject: Only clean files if we've done something

We should only be wiping out things on target if the tests have
actually run.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agodistcc: Handle upstream branch deletion for old releases
Richard Purdie [Thu, 8 Nov 2018 14:24:00 +0000 (14:24 +0000)]
distcc: Handle upstream branch deletion for old releases

distcc upstream dropped the 3.2 branch which we reference in older project releases
the revisions are there, just the branch is not. In order to be able to continue
to build those old releases, adjust any mirror tarball to contain the missing branch.
We have updated the  newer point releases but the previous tags were failing to build.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/manual/build-appliance: Drop test which is already automated
Richard Purdie [Fri, 2 Nov 2018 15:57:08 +0000 (15:57 +0000)]
oeqa/manual/build-appliance: Drop test which is already automated

The nightly-build-appliance target already tests this particular build.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agobase.bbclass: Display name of licenses which caused SkipRecipe
Nathan Rossi [Wed, 7 Nov 2018 08:51:56 +0000 (08:51 +0000)]
base.bbclass: Display name of licenses which caused SkipRecipe

Display the name of the restricted licenses which caused the recipe to
be skipped. This makes it easy to determine which license or licenses
are missing and need to be checked and whitelisted.

Signed-off-by: Nathan Rossi <nathan@nathanrossi.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoopenssl-1.1.1: remove build path from version info
Martin Hundebøll [Thu, 8 Nov 2018 08:25:24 +0000 (09:25 +0100)]
openssl-1.1.1: remove build path from version info

The openssl build system generates buildinf.h containing the full
compiler command line used to compile objects. This breaks
reproducibility, as the compile command is baked into libcrypto, where
it is used when running `openssl version -f`.

Add stripped build variables for the compiler and cflags lines, and use
those when generating buildinfo.h.

This is based on a similar patch for older openssl versions:
https://patchwork.openembedded.org/patch/147229/

Signed-off-by: Martin Hundebøll <martin@geanix.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agocpan.bbclass: avoid newer MakeMaker run perl.real
Jens Rehsack [Thu, 8 Nov 2018 15:32:42 +0000 (16:32 +0100)]
cpan.bbclass: avoid newer MakeMaker run perl.real

In newer versions of ExtUtils::MakeMaker, the location of the perl
binary to run is determined differently which results in finding
${bindir}/perl.real instead of ${bindir}/perl

Signed-off-by: Jens Rehsack <sno@netbsd.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agobusybox: make busybox.links.{suid, nosuid} reproducible
Martin Hundebøll [Thu, 8 Nov 2018 12:07:27 +0000 (13:07 +0100)]
busybox: make busybox.links.{suid, nosuid} reproducible

The busybox.link.* files are generated from autoconf.h and applets.h,
which are both auto-generated by the build system. The contents of the
two files might be in different order, and so the link files are not
reproducble as is.

Fix this by sorting the lists using `sort`.

Signed-off-by: Martin Hundebøll <martin@geanix.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/runtime: Add tests for gstreamer CLI
Yeoh Ee Peng [Thu, 8 Nov 2018 09:41:54 +0000 (17:41 +0800)]
oeqa/runtime: Add tests for gstreamer CLI

We should not be finding GStreamer issues right around
release time but that's what we seem to do.

Port gstreamer tests from Intel Ref Kit.
https://github.com/intel/intel-iot-refkit/blob/master/meta-iotqa/
lib/oeqa/runtime/multimedia/gstreamer/gstreamer_cli.py

Add tests for gstreamer commandline tools (gst-inspect-1.0
& gst-launch-1.0).

[YOCTO #11418]

Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoscripts/autobuilder-worker-prereq-tests: Shore up qemu testing
Michael Halstead [Thu, 8 Nov 2018 20:58:40 +0000 (12:58 -0800)]
scripts/autobuilder-worker-prereq-tests: Shore up qemu testing

Check that yocto-autobuilder-helper has been cloned to the correct location.
Check that vnc is running using the same script the autobuilder does.
Set the DISPLAY enviroment variable to :1 the same way we do when building
normally.
Make the VM's serial console available so we can log in and power off allowing
the tests to continue.

Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoscripts/runqemu: Replace subprocess.run() for compatibilty
Michael Halstead [Thu, 8 Nov 2018 20:58:39 +0000 (12:58 -0800)]
scripts/runqemu: Replace subprocess.run() for compatibilty

subprocess.run() was introduced in Python 3.5. We currently support down to
Python 3.4 so I've replaced it with subprocess.check_call() which is available
in that version.

Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoscripts/runqemu: Add serialstdio mode
Richard Purdie [Thu, 8 Nov 2018 20:58:38 +0000 (12:58 -0800)]
scripts/runqemu: Add serialstdio mode

Its currently not possible to have a console available whilst using qemu in graphics
mode. This is causing some issues for testing autobuilder bringup so all a "serialstdio"
mode to runqemu to accomodate this.

The existing serialstdio internal variable is renamed to allow the new user visible option.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agosqlite3_3: Update to 3.25.2
Jens Rehsack [Sat, 3 Nov 2018 13:12:23 +0000 (14:12 +0100)]
sqlite3_3: Update to 3.25.2

Update SQLite3 from 3.23.1 to 3.25.2 for UPSERT, window
functions and improved ALTER TABLE support.

For a detailed list of changes since 3.23.1, see
* https://www.sqlite.org/releaselog/3_25_2.html
* https://www.sqlite.org/releaselog/3_24_0.html

Signed-off-by: Jens Rehsack <sno@netbsd.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agosystemd-systemctl-native: handle Install wildcards
Brad Bishop [Tue, 6 Nov 2018 00:23:07 +0000 (19:23 -0500)]
systemd-systemctl-native: handle Install wildcards

Handle the %i wildcard appearing in a dependency in the Install section
of a template unit, e.g.

  $ cat foo@.service

  [Install]
  WantedBy=bar@%i.target

Using the real systemctl something like:

  $ systemctl enable foo@baz.service

will create a symlink in /etc/systemd/system/bar@baz.target.wants.
Detect wildcards in templates and make the appropriate substitution.

Signed-off-by: Brad Bishop <bradleyb@fuzziesquirrel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agopseudo: fix link with new sqlite3
Ross Burton [Tue, 6 Nov 2018 12:24:29 +0000 (12:24 +0000)]
pseudo: fix link with new sqlite3

If sqlite3 is built with FTS5 it uses log() from libm, but that linkage is lost
if we manually statically link so explicitly link to libm.

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoglide: disable ptest on mips
Kai Kang [Wed, 7 Nov 2018 08:30:46 +0000 (16:30 +0800)]
glide: disable ptest on mips

It fails to run task compile_ptest_base of glide on mips:

| vet config not found

The root cause is that go lang lacks '-buildmode=pie' support for mips.
So disable glide ptest on mips for now.

Signed-off-by: Kai Kang <kai.kang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agorootfs: ensure that packages in IMAGE_INSTALL_DEBUGFS are existing
Andrej Valek [Wed, 7 Nov 2018 08:43:05 +0000 (09:43 +0100)]
rootfs: ensure that packages in IMAGE_INSTALL_DEBUGFS are existing

Ensure that additional packages in IMAGE_INSTALL_DEBUGFS are available
before installation.

Signed-off-by: Andrej Valek <andrej.valek@siemens.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agometadata_scm: Drop orphaned monotone functions
Richard Purdie [Thu, 8 Nov 2018 12:19:01 +0000 (12:19 +0000)]
metadata_scm: Drop orphaned monotone functions

Its been 'a while' since we used monotone, drop these revision
function remnants.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agometadata_scm.bbclass: simplify base_detect_revision()
Robert Yang [Wed, 7 Nov 2018 10:02:37 +0000 (18:02 +0800)]
metadata_scm.bbclass: simplify base_detect_revision()

The previous code looks strange because of historical reason, simply return
base_get_metadata_git_revision/branch() is enough, the later functions has
handled everything like '<unknown>' and strip().

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoshadow: improve reproducibility by hard-coding shell path
Martin Hundebøll [Wed, 7 Nov 2018 12:22:22 +0000 (13:22 +0100)]
shadow: improve reproducibility by hard-coding shell path

The shadow configure script tries really hard to detect the running
shell to make sure it doesn't do unsupported calls.

On my system the shell is detected as /bin/sh, while a build in an
ubuntu docker it resolves to /bin/bash. And since the shell path is
baked into the target binaries through config.h, the build becomes
inreproducible.

Fix reproducibility by hard-coding the shell to be /bin/sh

Signed-off-by: Martin Hundebøll <martin@geanix.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agogo 1.9/1.11: fix textrel qa warning for non mips arch
Hongxu Jia [Mon, 29 Oct 2018 08:21:15 +0000 (16:21 +0800)]
go 1.9/1.11: fix textrel qa warning for non mips arch

While building go itself, the go build system does not support
to set `-buildmode=pie' from environment.

Add GOBUILDMODE to support it which make PIE executables the default
build mode, as PIE executables are required as of Yocto

But mips doesn't support -buildmode=pie, so skip the QA checking for
mips and its variants

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agopkgconfig: export variables
Joshua Watt [Fri, 2 Nov 2018 02:45:13 +0000 (21:45 -0500)]
pkgconfig: export variables

Export the PKG_CONFIG_PATH and PKG_CONFIG_LIBDIR variables in case the
parent shell hasn't done so.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoppce500v2: remove spe
Chunrong Guo [Fri, 2 Nov 2018 06:52:45 +0000 (06:52 +0000)]
ppce500v2: remove spe

*The PowerPC SPE support is split off to a separate powerpcspe port

Signed-off-by: Chunrong Guo <chunrong.guo@nxp.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agostrace: Bump to version 4.25
Mauno Niko [Mon, 12 Nov 2018 11:32:14 +0000 (11:32 +0000)]
strace: Bump to version 4.25

V4L2_CID_USER_IMX_BASE value differs in v4.14 and v4.19 LTS kernels
https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/tree/include/uapi/linux/v4l2-controls.h?h=v4.14.79#n191
https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/tree/include/uapi/linux/v4l2-controls.h?h=v4.19.1#n191

Building strace v4.24 against 4.19 kernel headers results in following
build failure

  | arm-vaisala-linux-gnueabi-ranlib libstrace.a
  | In file included from ../strace-4.24/static_assert.h:31,
  |                  from ../strace-4.24/xlat/v4l2_pix_fmts.h:4,
  |                  from ../strace-4.24/v4l2.c:78:
  | ../strace-4.24/xlat/v4l2_control_id_bases.h:36:1: error: static assertion failed: "V4L2_CID_USER_IMX_BASE != (V4L2_CID_BASE + 0x1090)"

This Linux kernel ABI breakage that occurred wrt V4L2_CID_USER_IMX_BASE
has been observed and addressed in strace upstream commit
https://github.com/strace/strace/commit/b89a69dec27cf638df0e17db80ed937c3e1abf77

Bump strace to version 4.25 which also addresses ABI breakage so that
strace once again builds against both v4.14 and v4.19 LTS kernel headers

Signed-off-by: Niko Mauno <niko.mauno@vaisala.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agogpgme: 1.11.1 -> 1.12.0
Hongxu Jia [Fri, 9 Nov 2018 09:07:07 +0000 (17:07 +0800)]
gpgme: 1.11.1 -> 1.12.0

Rebase 0007-qt-python-Add-variables-to-tests.patch

Rework 0007-qt-python-Add-variables-to-tests.patch -> 0007-python-Add-variables-to-tests.patch

Drop newly added option --disable-lang-qt-test which is merged to --disable-gpg-test by
upstream commit [26820ba qt: Respect --disable-gpg-test for tests]

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoman-db: 2.8.3 -> 2.8.4
Hongxu Jia [Fri, 9 Nov 2018 09:07:06 +0000 (17:07 +0800)]
man-db: 2.8.3 -> 2.8.4

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoncurses: upgrade 6.1 -> 6.1+20180714
Hongxu Jia [Fri, 9 Nov 2018 09:07:05 +0000 (17:07 +0800)]
ncurses: upgrade 6.1 -> 6.1+20180714

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agognupg: upgrade 2.2.9 -> 2.2.10
Hongxu Jia [Fri, 9 Nov 2018 09:07:04 +0000 (17:07 +0800)]
gnupg: upgrade 2.2.9 -> 2.2.10

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoapr: upgrade 1.6.3 -> 1.6.5
Hongxu Jia [Fri, 9 Nov 2018 09:07:03 +0000 (17:07 +0800)]
apr: upgrade 1.6.3 -> 1.6.5

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoxf86-video-intel: update to latest
Anuj Mittal [Fri, 2 Nov 2018 06:58:52 +0000 (14:58 +0800)]
xf86-video-intel: update to latest

For changes, please see:

https://cgit.freedesktop.org/xorg/driver/xf86-video-intel/log/?qt=range&q=e4fe79cf0d9a05ee3f3a027148ef0aeb2b1b34e1...0932a6b37ba6d5c9e916a1cb6ab89c3205b81a0c

Enable sna by default and remove upstreamed patches.

Also include a patch from fedora to fix compile issues when using
qemux86 which doesn't enable sse2 leading to gcc refusing to
inline vertex_emit_2s in emit_vertex because they are defined as:

  static __attribute__((always_inline)) void
  vertex_emit_2s(struct sna *sna, int16_t x, int16_t y)

  __attribute__((target("sse2,fpmath=sse"))) __attribute__((always_inline))
  static void emit_vertex(/* omitted */)

leading to errors like:

| In file included from ../../../git/src/sna/gen4_vertex.c:34:
| ../../../git/src/sna/gen4_vertex.c: In function 'emit_vertex':
| ../../../git/src/sna/sna_render_inline.h:40:26: error: inlining failed in call to always_inline 'vertex_emit_2s': target specific option mismatch
|  static force_inline void vertex_emit_2s(struct sna *sna, int16_t x, int16_t y)
|                           ^~~~~~~~~~~~~~
| ../../../git/src/sna/gen4_vertex.c:308:25: note: called from here
|  #define OUT_VERTEX(x,y) vertex_emit_2s(sna, x,y) /* XXX assert(!too_large(x, y)); */
|                          ^~~~~~~~~~~~~~~~~~~~~~~~
| ../../../git/src/sna/gen4_vertex.c:360:2: note: in expansion of macro 'OUT_VERTEX'
|   OUT_VERTEX(dstX, dstY);
|   ^~~~~~~~~~

Signed-off-by: Anuj Mittal <anuj.mittal@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoconnman: update to 1.36
Olekandr Kravchuk [Mon, 8 Oct 2018 21:05:51 +0000 (23:05 +0200)]
connman: update to 1.36

- updated connman to v1.36
- removed mainstreamed patches
- includes.patch has been rabased and transformed into git format

Signed-off-by: Oleksandr Kravchuk <dev@sashko.rv.ua>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoxserver-xorg: update to 1.20.3
Armin Kuster [Wed, 31 Oct 2018 14:39:58 +0000 (07:39 -0700)]
xserver-xorg: update to 1.20.3

1.20.3 fixes arm booting in testimage

Signed-off-by: Armin Kuster <akuster808@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agokernel: use olddefconfig as the primary target for KERNEL_CONFIG_COMMAND
Bruce Ashfield [Tue, 30 Oct 2018 19:04:26 +0000 (15:04 -0400)]
kernel: use olddefconfig as the primary target for KERNEL_CONFIG_COMMAND

As was warned by commit 312ee68752fa [kconfig: announce removal of
oldnoconfig if used], oldnoconfig has been removed from the 4.20 kernel.

So we switch our default mode to olddefconfig.

commit fb16d8912 [kconfig: replace 'oldnoconfig' with 'olddefconfig',
and keep the old name as an alias] introduced olddefconfig in the 3.10
kernel, we shuffle oldnoconfig to the fallback target.

The fallback mode allows kernels between 3.10 and the currently listed
oldest kernel of 3.2 to continue to configure.

Signed-off-by: Bruce Ashfield <bruce.ashfield@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agobind: update to latest LTS 9.11.5
Armin Kuster [Wed, 31 Oct 2018 14:39:59 +0000 (07:39 -0700)]
bind: update to latest LTS 9.11.5

includes:
CVE-2018-5738

drop patch for CVE-2018-5740 now included in update

see: https://ftp.isc.org/isc/bind9/9.11.5/RELEASE-NOTES-bind-9.11.5.html

Add RECIPE_NO_UPDATE_REASON for lts

Signed-off-by: Armin Kuster <akuster808@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agodhcp: fix issue with new bind changes
Armin Kuster [Wed, 24 Oct 2018 00:19:46 +0000 (01:19 +0100)]
dhcp: fix issue with new bind changes

Signed-off-by: Armin Kuster <akuster808@gmail.com>
6 years agoxf86-input-libinput: update to 0.28.1
Armin Kuster [Sat, 20 Oct 2018 18:08:04 +0000 (19:08 +0100)]
xf86-input-libinput: update to 0.28.1

Signed-off-by: Armin Kuster <akuster808@gmail.com>
6 years agoxkeyboard-config: update to 2.25
Armin Kuster [Sat, 20 Oct 2018 18:46:27 +0000 (19:46 +0100)]
xkeyboard-config: update to 2.25

Signed-off-by: Armin Kuster <akuster808@gmail.com>
6 years agolibxcb: update to 1.13.1
Armin Kuster [Sat, 20 Oct 2018 17:39:17 +0000 (18:39 +0100)]
libxcb: update to 1.13.1

Signed-off-by: Armin Kuster <akuster808@gmail.com>
6 years agolibx11: update to 1.6.7 and sytle cleanup
Armin Kuster [Sat, 20 Oct 2018 17:02:55 +0000 (18:02 +0100)]
libx11: update to 1.6.7 and sytle cleanup

refresh Fix-hanging-issue-in-_XReply.patch

Signed-off-by: Armin Kuster <akuster808@gmail.com>
6 years agolibsm: update to 1.2.3
Armin Kuster [Sat, 20 Oct 2018 16:56:09 +0000 (17:56 +0100)]
libsm: update to 1.2.3

reoder things per style

Signed-off-by: Armin Kuster <akuster808@gmail.com>
6 years agoopenssh: Update to 7.9 primarily bug fixes
Armin Kuster [Sat, 20 Oct 2018 15:53:33 +0000 (16:53 +0100)]
openssh: Update to 7.9 primarily bug fixes

see: https://lwn.net/Articles/768991/

Signed-off-by: Armin Kuster <akuster808@gmail.com>
6 years agolibpcre2: update to 10.32
Armin Kuster [Sat, 20 Oct 2018 15:30:48 +0000 (16:30 +0100)]
libpcre2: update to 10.32

LIC_FILES_CHKSUM changed do to typo fixes and tidies for 10.32

see: https://www.pcre.org/changelog.txt

Signed-off-by: Armin Kuster <akuster808@gmail.com>
6 years agognutls: update to 3.6.4
Armin Kuster [Sat, 20 Oct 2018 14:55:49 +0000 (15:55 +0100)]
gnutls: update to 3.6.4

Notable change:

libgnutls: Added the final (RFC8446) version numbering of the TLS1.3 protocol.
see: https://lists.gnupg.org/pipermail/gnutls-help/2018-September/004457.html

Signed-off-by: Armin Kuster <akuster808@gmail.com>
--
[v2]
Fix typo in version in subject

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agonspr: Update to 4.20
Armin Kuster [Sat, 20 Oct 2018 14:07:23 +0000 (15:07 +0100)]
nspr: Update to 4.20

RISC-v support now included in this release so drop patch.
and refresh patches

Signed-off-by: Armin Kuster <akuster@mvista.com>
6 years agocurl: actually apply latest CVE patches
Ross Burton [Fri, 9 Nov 2018 16:53:11 +0000 (16:53 +0000)]
curl: actually apply latest CVE patches

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agounzip: actually apply CVE-2018-18384
Ross Burton [Fri, 9 Nov 2018 16:28:36 +0000 (16:28 +0000)]
unzip: actually apply CVE-2018-18384

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/selftest/recipetool: Fix problems from changing upstream source
Mohamad Noor Alim Hussin [Fri, 9 Nov 2018 09:57:58 +0000 (17:57 +0800)]
oeqa/selftest/recipetool: Fix problems from changing upstream source

The upstream source tarball checksums changed. Use the copy from our source
mirror to avoid failures.

[YOCTO #12979]

Signed-off-by: Mohamad Noor Alim Hussin <mohamad.noor.alim.hussin@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoimage-buildinfo,oeqa/selftest/containerimage: Ensure image-buildinfo doesn't break...
Richard Purdie [Fri, 9 Nov 2018 11:24:47 +0000 (11:24 +0000)]
image-buildinfo,oeqa/selftest/containerimage: Ensure image-buildinfo doesn't break tests

Having image-buildinfo enabled causes containerimage.ContainerImageTests.test_expected_files
to fail due to the presence of an unexpected file:
  ['./',
   './etc/',
-  './etc/build',
   './etc/default/',
   './etc/default/postinst',

Tweak the class to allow it to be disabled and disable it from the test just in
case it was enabled.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agovalgrind: drop mips n32 support
Randy MacLeod [Wed, 7 Nov 2018 17:59:22 +0000 (12:59 -0500)]
valgrind: drop mips n32 support

valgrind for qemumips64 multilib builds fails to configure
for libn32 with the error:
   configure:6190: checking for 32 bit build support
   ...
   fatal error: bits/long-double-32.h: No such file or directory
It seems that the toolchain is producing:
   tmp-glibc/sysroots-components/mips64-n32/libn32-glibc/usr/include/bits/long-double-n32.h

Until the toolchain problem is resolved, skip valgrind for libn32.

Signed-off-by: Randy MacLeod <Randy.MacLeod@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/selftest: Standardize json logging output directory
Yeoh Ee Peng [Wed, 7 Nov 2018 07:08:31 +0000 (15:08 +0800)]
oeqa/selftest: Standardize json logging output directory

Currently sdk & sdkext will output json file to LOG_DIR, while
selftest will output json file to TOPDIR/log.

Standardize selftest json output file to LOG_DIR.

Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoglibc: make ld-2.28.so reproducible on arm
Martin Hundebøll [Tue, 6 Nov 2018 10:04:16 +0000 (11:04 +0100)]
glibc: make ld-2.28.so reproducible on arm

Play the whack-a-mole game and add the .file directive to another
assembly file that otherwise shows itself in ld-2.28.so debug file,
which in turns alters the build-id of ld-2.28.so on target.

Signed-off-by: Martin Hundebøll <martin@geanix.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agobase.bbclass: avoid 'find -ignore_readdir_race -delete'
Matthias Schiffer [Tue, 6 Nov 2018 08:56:23 +0000 (09:56 +0100)]
base.bbclass: avoid 'find -ignore_readdir_race -delete'

Due to a bug in find [1], -ignore_readdir_race does not work correctly with
-delete. This can lead to spurious build failures when files disappear
while such a command is running; specifically this was seen in the case of
do_configure and do_populate_lic running concurrently for packages
with ${B} == ${WORKDIR}:

   find: '.../sstate-build-populate_lic': No such file or directory

While the issue is fixed in the findutils git master, the find command of
the host system is called here, so we can't ensure that the used version
contains the fix. Many common distros have not updated to a recent enough
findutils version yet (Ubuntu 18.10 contains the fix, while 18.04 is still
affected).

Work around the issue by passing the output of find to 'rm -f' instead of
using -delete.

[1] https://savannah.gnu.org/bugs/?52981

Signed-off-by: Matthias Schiffer <matthias.schiffer@ew.tq-group.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agobinutils: fix four CVE issues
Zhixiong Chi [Tue, 6 Nov 2018 06:43:41 +0000 (22:43 -0800)]
binutils: fix four CVE issues

Backport the CVE patches from the binutils upstream.

Signed-off-by: Zhixiong Chi <zhixiong.chi@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoperf: Disable libunwind for ARC & RISCV64
Alexey Brodkin [Wed, 31 Oct 2018 18:54:23 +0000 (21:54 +0300)]
perf: Disable libunwind for ARC & RISCV64

libunwind is not yet ported for ARC & RISCV64 and on attempt
to build it for those arches we just get an error message.

If we explicitly disable libunwind it is gracefully handled by
perf build system and it just gets configured to not use it
so perf is still usable even on those arches.

Signed-off-by: Alexey Brodkin <abrodkin@synopsys.com>
Cc: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoapt: update SRC_URI
Changqing Li [Thu, 1 Nov 2018 03:15:17 +0000 (11:15 +0800)]
apt: update SRC_URI

update SRC_URI since previous link is not valid now

Signed-off-by: Changqing Li <changqing.li@windriver.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoarchiver: Drop unwanted directories
Fabien Lahoudere [Mon, 29 Oct 2018 11:02:29 +0000 (12:02 +0100)]
archiver: Drop unwanted directories

In sources directory we can find patches/ and temp/.
The first one is filled with symbolic link unusable on another
machines.
The second contains yocto logs to create this archives and are
typically copied when 'S = "${WORKDIR}"'

Signed-off-by: Fabien Lahoudere <fabien.lahoudere@collabora.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoscripts/autobuilder-worker-prereq-tests: adjust max_user_watches
Michael Halstead [Mon, 5 Nov 2018 17:10:48 +0000 (09:10 -0800)]
scripts/autobuilder-worker-prereq-tests: adjust max_user_watches

Temporarily modify path to run as non-privileged user on more distros.
Change the recommended value to match what we use on the autobuilder.

Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agometa: Use double colon for chown OWNER:GROUP
Kosta Zertsekel [Sun, 4 Nov 2018 19:24:46 +0000 (21:24 +0200)]
meta: Use double colon for chown OWNER:GROUP

Rationale - excerp from `info chown`
====================================

OWNER‘:’GROUP
     If the OWNER is followed by a colon and a GROUP (a group name or
     numeric group ID), with no spaces between them, the group ownership
     of the files is changed as well (to GROUP).

   Some older scripts may still use ‘.’ in place of the ‘:’ separator.
POSIX 1003.1-2001 (*note Standards conformance::) does not require
support for that, but for backward compatibility GNU ‘chown’ supports
‘.’ so long as no ambiguity results.  New scripts should avoid the use
of ‘.’ because it is not portable, and because it has undesirable
results if the entire OWNER‘.’GROUP happens to identify a user whose
name contains ‘.’.

Signed-off-by: Kosta Zertsekel <zertsekel@gmail.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agowic: use explicit errno import
Ross Burton [Mon, 5 Nov 2018 11:23:03 +0000 (11:23 +0000)]
wic: use explicit errno import

os.errno doesn't work in Python 3.7 and shouldn't have ever worked, so use
import errno explicitly.

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/selftest: Add test for Yocto source mirror functionality/completeness
Richard Purdie [Mon, 5 Nov 2018 15:52:09 +0000 (15:52 +0000)]
oeqa/selftest: Add test for Yocto source mirror functionality/completeness

We've had a number of occasions where the Yocto Project source mirrors have not
been complete or functioning correctly. This adds a test so that if this happens
we find out out it sooner.

It also only works over http meaning we should be able to test that anyone behind
an http only proxy (no git protocol) also has functional fetches for OE-Core and
layers built by the core of the project.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agolibgpg-error: Support build for native on ppc64/ppc64le hosts
Serhey Popovych [Thu, 1 Nov 2018 17:21:10 +0000 (19:21 +0200)]
libgpg-error: Support build for native on ppc64/ppc64le hosts

Both RHEL and SLES uses ppc64/ppc64le for powerpc 64 bit big/little
endian targets instead of powerpc64/powerpc64le in libgpg-error.

Also libgpg-error provides common target system names in form like
<arch>-unknown-linux-gnu.

Add mapping for ppc64/ppc64le targets to their libgpg-error equivalents
to fix native builds.

Cross build for arm64 tested on IBM Power 8 machine with RHEL7 for
ppc64le variant only, but should work for ppc64 as well.

Signed-off-by: Serhey Popovych <serhe.popovych@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agov86d: Make cross compilation working on more architectures
Serhey Popovych [Wed, 31 Oct 2018 14:55:47 +0000 (16:55 +0200)]
v86d: Make cross compilation working on more architectures

Since commit 709c603dec19 ("v86d: Accept aarch64 as build host") we
support cross compilation on aarch64 host in addition to x86 host.
However building on hosts different than two above will fail.

Make cross compilation support more generic by checking for TARGET_ARCH
in v86d configure script with fallback to `uname -m` when not present in
environment and pass TARGET_ARCH explicitly in do_configure().

Cross build for x86 tested on IBM Power 8 machine with RHEL7. Should
work on aarch64 and rest too.

Signed-off-by: Serhey Popovych <serhe.popovych@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooe-init-buildenv/base: Relax python version checks in favour of HOSTTOOLS manipulation
Richard Purdie [Tue, 30 Oct 2018 11:18:54 +0000 (11:18 +0000)]
oe-init-buildenv/base: Relax python version checks in favour of HOSTTOOLS manipulation

Several distros are now shipping "python" as python v3 contra to the original
python guidelines. This causes users confusion/pain in trying to use our tools.

We can just force "python" to "python2" within HOSTTOOLS to avoid this issue
and hide the complexity from the user.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agooeqa/runtime/ptest: Inject results+logs into stored json results file
Richard Purdie [Fri, 2 Nov 2018 13:13:43 +0000 (13:13 +0000)]
oeqa/runtime/ptest: Inject results+logs into stored json results file

This allows the ptest results from ptest-runner, run in an image to be
transferred over to the resulting json results output.

Each test is given a pass/skip/fail so individual results can be monitored
and the raw log output from the ptest-runner is also dumped into the
results json file as this means after the fact debugging becomes much easier.

Currently the log output is not split up per test but that would make a good
future enhancement.

I attempted to implement this as python subTests however it failed as the
output was too confusing, subTests don't support any kind of log
output handling, subTest successes aren't logged and it was making things
far more complex than they needed to be.

We mark ptest-runner as "EXPECTEDFAILURE" since its unlikely every ptest
will pass currently and we don't want that to fail the whole image test run.
Its assumed there would be later analysis of the json output to determine
regressions. We do have to change the test runner code so that
'unexpectedsuccess' is not a failure.

Also, the test names are manipuated to remove spaces and brackets with
"_" used as a replacement and any duplicate occurrences truncated.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agocrosssdk: Remove usage of host flags for cross-compilation
Richard Purdie [Wed, 31 Oct 2018 22:38:43 +0000 (22:38 +0000)]
crosssdk: Remove usage of host flags for cross-compilation

Similarlly to OE-Core rev 4b936cde58ca0a6f34092ce82640a02859110411 for
cross.sdk, BUILD_* flags can't be used as TARGET_* flags

gcc-crosssdk buils leaks config.log's through "gcc-stashed-builddir" and
TARGET_* flags to libgcc cross-build through "gcc/libgcc.mvars" file
on "gcc-stashed-builddir". This means that if BUILD_CFLAGS contains
host-specific flags like "-isystem/usr/include" libgcc build will
fail "do_qa_configure" and "do_package_qa" checks.

Remove host-related flags from TARGET_* flags for gcc-crosssdk builds.

[YOCTO #11874]

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agogo: Change from TARGET_ARCH to TUNE_PKGARCH
Richard Purdie [Wed, 31 Oct 2018 14:52:11 +0000 (14:52 +0000)]
go: Change from TARGET_ARCH to TUNE_PKGARCH

Right now go-cross is changing signatures when you change TUNE for a given
architecture. In particular this breaks layer tests like:

yocto-check-layer ../meta-yocto-bsp/ --machines qemuarm beaglebone-yocto

This changes the PN addtion to something containing the tune rather than
the arch which avoids these kinds of errors. If go-cross can be tune
independent that would be nice but currently that isn't the case.

[YOCTO #12586]

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agogo-dep: disable PTEST_ENABLED for mips and mips64
Chen Qi [Tue, 30 Oct 2018 06:32:42 +0000 (14:32 +0800)]
go-dep: disable PTEST_ENABLED for mips and mips64

The current go-dep does not compile ptest successfully on mips
and mips64. So as a workaround, disable PTEST_ENABLED explicitly
to avoid error like below.

  | vet config not found

Signed-off-by: Chen Qi <Qi.Chen@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agopython3: add python3-venv to the python3-modules RDEPENDS
Ross Burton [Mon, 5 Nov 2018 11:22:58 +0000 (11:22 +0000)]
python3: add python3-venv to the python3-modules RDEPENDS

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agopython3: Fix python3-pyvenv run-time dependency
Hugues Kamba [Tue, 30 Oct 2018 09:37:25 +0000 (09:37 +0000)]
python3: Fix python3-pyvenv run-time dependency

Pyvenv is just a small script that uses venv to create virtual
environments.
https://www.python.org/dev/peps/pep-0405/#creating-virtual-environments

This patch adds the python3-venv module as a self-contained package which
python3-pyvenv must depend on at run-time.

The patch also provides the package python3-pyvenv from the pyhton3-venv
package.This is good for future-proofing since python3-pyvenv has been
deprecated and only python3-venv is now available in Python 3.6.
https://docs.python.org/3/library/venv.html.

Without this patch python3-pyvenv is broken because it is missing the
venv module at run-time. This patch specifies the newly created
python3-venv as a run-time dependency of python3-pyvenv.

Signed-off-by: Hugues Kamba <hugues.kamba@arm.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agogdbm: fix ptest failure
Chen Qi [Tue, 30 Oct 2018 08:06:42 +0000 (16:06 +0800)]
gdbm: fix ptest failure

Some of gdbm's ptest cases require gdbmtool, which is packaged into
${PN}-bin. So extend the RDEPENDS_${PN}-ptest to include the package.

Signed-off-by: Chen Qi <Qi.Chen@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agopixman: Trim license info extracted from pixman-matrix.c
Peter Kjellerstedt [Sat, 3 Nov 2018 09:30:29 +0000 (10:30 +0100)]
pixman: Trim license info extracted from pixman-matrix.c

Four unrelated lines were extracted from pixman-matrix.c for the
license information.

License-Update: Only extract the relevant part from pixman-matrix.c
Signed-off-by: Peter Kjellerstedt <peter.kjellerstedt@axis.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agolibgpg-error: Trim license info extracted from init.c & gpg-error.h.in
Peter Kjellerstedt [Sat, 3 Nov 2018 09:30:28 +0000 (10:30 +0100)]
libgpg-error: Trim license info extracted from init.c & gpg-error.h.in

License-Update: Only extract relevant parts from init.c & gpg-error.h.in
Signed-off-by: Peter Kjellerstedt <peter.kjellerstedt@axis.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoapr-util: Trim license info extracted from apu_version.h
Peter Kjellerstedt [Sat, 3 Nov 2018 09:30:27 +0000 (10:30 +0100)]
apr-util: Trim license info extracted from apu_version.h

Two unrelated lines were extracted from apu_version.h for the license
information.

License-Update: Only extract the relevant part from apu_version.h
Signed-off-by: Peter Kjellerstedt <peter.kjellerstedt@axis.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoapr: Trim license info extracted from apr_lib.h
Peter Kjellerstedt [Sat, 3 Nov 2018 09:30:26 +0000 (10:30 +0100)]
apr: Trim license info extracted from apr_lib.h

Two unrelated lines were extracted from apr_lib.h for the license
information.

License-Update: Only extract the relevant part from apr_lib.h
Signed-off-by: Peter Kjellerstedt <peter.kjellerstedt@axis.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agocommon-licenses: Correct the FreeType license text
Peter Kjellerstedt [Sat, 3 Nov 2018 09:30:25 +0000 (10:30 +0100)]
common-licenses: Correct the FreeType license text

It now matches:
http://git.savannah.gnu.org/cgit/freetype/freetype2.git/tree/docs/FTL.TXT

Signed-off-by: Peter Kjellerstedt <peter.kjellerstedt@axis.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoreproducible_build: update do_deploy_source_date_epoch commment
Douglas Royds [Mon, 5 Nov 2018 05:39:41 +0000 (18:39 +1300)]
reproducible_build: update do_deploy_source_date_epoch commment

Once the value of SOURCE_DATE_EPOCH is determined, it is stored in the recipe's SDE_FILE.
If none of the existing mechanisms are suitable, replace the do_deploy_source_date_epoch task
with recipe-specific functionality to write the appropriate SOURCE_DATE_EPOCH into the SDE_FILE.

Signed-off-by: Douglas Royds <douglas.royds@taitradio.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
6 years agocurl: fix for CVE-2018-16839/CVE-2018-16840/CVE-2018-16842
Changqing Li [Fri, 2 Nov 2018 06:07:49 +0000 (14:07 +0800)]
curl: fix for CVE-2018-16839/CVE-2018-16840/CVE-2018-16842

Signed-off-by: Changqing Li <changqing.li@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoopenssl: fix CVE-2018-0735 for 1.1.1
Kai Kang [Fri, 2 Nov 2018 08:02:14 +0000 (16:02 +0800)]
openssl: fix CVE-2018-0735 for 1.1.1

Backport patch to fix CVE-2018-0735 for openssl 1.1.1.

Signed-off-by: Kai Kang <kai.kang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
6 years agoopenssl: fix CVE-2018-0734 for both 1.0.2p and 1.1.1
Kai Kang [Fri, 2 Nov 2018 08:02:13 +0000 (16:02 +0800)]
openssl: fix CVE-2018-0734 for both 1.0.2p and 1.1.1

Backport patches to fix CVE-2018-0734 for both openssl 1.0.2p and 1.1.1
versions.

Signed-off-by: Kai Kang <kai.kang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>