Scott Murray [Tue, 22 Feb 2022 14:45:34 +0000 (09:45 -0500)]
scripts: fix file writing in convert-spdx-licenses
The convert-spdx-licenses.py script needs the same file closing
fix as was made to convert-variable-renames to ensure modified
file contents get flushed out.
Signed-off-by: Scott Murray <scott.murray@konsulko.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Martin Jansa [Tue, 22 Feb 2022 13:26:57 +0000 (14:26 +0100)]
icecc.bbclass: fix syntax error
'class' is already taken as keyword and python doesn't like this:
ERROR: Error in compiling python function in oe-core/meta/classes/icecc.bbclass, line 151:
The code lines resulting in this error were:
0020: check_pn = set([pn, bpn])
0021:
0022: class_disable = (d.getVar('ICECC_CLASS_DISABLE') or "").split()
0023:
*** 0024: for class in class_disable:
0025: if bb.data.inherits_class(class, d):
0026: bb.debug(1, "%s: class %s found in disable, disable icecc" % (pn, class))
0027: return "no"
0028:
SyntaxError: invalid syntax (icecc.bbclass, line 151)
Signed-off-by: Martin Jansa <Martin.Jansa@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Scott Murray [Tue, 22 Feb 2022 04:21:38 +0000 (23:21 -0500)]
scripts: fix file writing in convert-variable-renames
In my test environments (Fedora 35 and Debian 10.10 on AMD 2970WX),
running the convert-variable-renames.py rename script was resulting
in empty files instead of updated ones. From inspection, the new
files are never flushed/closed before moving them into place, which
seems inherently racy. Adding an explicit close to flush the modified
contents out before moving into place fixes the issue for me.
Signed-off-by: Scott Murray <scott.murray@konsulko.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Richard Purdie [Thu, 17 Feb 2022 11:43:36 +0000 (11:43 +0000)]
icecc: Improve variables/terminology
The SYSTEM and USER seperation between variables seems odd and not necessary,
drop it. Avoid the use of whitelist/blacklist and also change "packages" to
"recipes" since that misuse causes confusion.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Saul Wold [Thu, 17 Feb 2022 00:32:48 +0000 (16:32 -0800)]
scripts: Add convert-variable-renames script for inclusive language variable renaming
This script searches for a list of variable that have been renamed
and converts them to their more descriptive names. It also searches
for a list of variables that have been removed or deprecated and
prints a message.
It will print a message to inform the user that there are terms that
need to be updated in their files. Many of these changes are context
sensitive and may not be modified as they might be existing calls to
other libraries. This message is informational only.
I have tested this on poky and meta-openembedded so far.
Saul Wold [Fri, 4 Feb 2022 17:01:40 +0000 (09:01 -0800)]
blacklist: Replace class with SKIP_RECIPE variable
Remove the old class and rename VarFlag to SKIP_RECIPE, handling this
in base.bbclass for efficiency. This means a separate inherit is no longer
needed.
This change better describes what the VarFlag is doing since it
is implemeted with the SkipRecipe() function.
By moving this into base.bbclass we simplify the distro inherit.
Signed-off-by: Saul Wold <saul.wold@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Scott Murray [Thu, 17 Feb 2022 22:12:55 +0000 (17:12 -0500)]
local.conf/oeqa: Update BB_DISKMON_DIRS use
Update the example BB_DISKMON_DIRS definitions in the sample
local.conf files for the rename of the "ABORT" action to "HALT",
and also update related error messages in one selftest to use
the new action name.
Signed-off-by: Scott Murray <scott.murray@konsulko.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
yocto-check-layer: add ability to perform tests from a global bbclass
This is useful when needing to test layer's recipes, where this special
bbclass can define a global python function that gets called on each
recipe parsing during "bitbake -S none world" signature dump and be able
to fail layer's check accordingly.
First test being added is to detect recipes skipping "installed-vs-shipped"
QA check. As "installed-vs-shipped" is a packaging QA check, it happens very
late in the build process and failing it could mean some potential issues
with packaging, especially when recipe uses BBCLASSEXTEND="nativesdk" and
resulting package is used in an SDK.
In OE-Core failing this QA check leads to an error, but other layers can
suppress it or change it to a warning. Detecting weird packaging problems
with SDKs is quite difficult and time consuming. Also, waiting for the
actual "installed-vs-shipped" packaging QA check to fail means that all
recipes in the layer under test have to run through all standard tasks in
the build chain, equivalent to a multi-hour world-build.
Hence yocto-check-layer takes a shortcut and only detects a mere attempt
at skipping "installed-vs-shipped" QA check in the INSANE_SKIP list during
initial parsing when dumping the signature information for the layer.
Signed-off-by: Denys Dmytriyenko <denis@denix.org> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Ross Burton [Thu, 10 Feb 2022 11:52:01 +0000 (11:52 +0000)]
kernel: make kernel-base recommend kernel-image, not depend
As kernel modules depend on the base kernel package, and the base kernel
recipe depends on the kernel image, it's impossible to build file system
images which contain kernel modules but not the kernel itself, such as
an initramfs.
Change the RDEPENDS to RRECOMMENDS so that the disk images can set
PACKAGE_EXCLUDE = "kernel-image-*" to remove the kernel.
Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
oeqa/selftest/bblogging: Add logging tests for bb.build.exec_func with shell/python code
The situation regarding logging is different when a function called by
bb.build.exec_func() fails compared to when the task code fails
directly. There is a recent fix in bitbake to solve that and these
tests will hopefully prevent regressions.
Signed-off-by: Peter Kjellerstedt <peter.kjellerstedt@axis.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Richard Purdie [Sun, 20 Feb 2022 14:03:39 +0000 (14:03 +0000)]
perl: Improve and update module RPDEPENDS
The perl module RDEPENDS needed refreshing so I updated it with the script. I
also found a ton of issues with missing test2 module dependencies so I've tweaked
the generator script to improve those. For some reason they were previously excluded
but I can't see anything wrong with the generated dependencies so I've added them. A
number of manual dependencies were still needed in addition.
I did notice an issue with trailing ")" characters so the sed is updated to handle
that (it did already handle "(").
This fixes issues seen in the dependecies for libxml-parser-perl's ptest package.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Richard Purdie [Sat, 19 Feb 2022 17:59:07 +0000 (17:59 +0000)]
sstate: Setup fetcher environment in advance
The threading code here can race as the fetcher changes the environment which is
shared between the threads. By setting it up in advance, it isn't changed and
therefore no longer races.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Richard Purdie [Fri, 18 Feb 2022 17:15:36 +0000 (17:15 +0000)]
meta/meta-selftest/meta-skeleton: Update LICENSE variable to use SPDX license identifiers
An automated conversion using scripts/contrib/convert-spdx-licenses.py to
convert to use the standard SPDX license identifiers. Two recipes in meta-selftest
were not converted as they're that way specifically for testing. A change in
linux-firmware was also skipped and may need a more manual tweak.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Richard Purdie [Fri, 18 Feb 2022 17:09:23 +0000 (17:09 +0000)]
scripts: Add a conversion script to use SPDX license names
We're standardising on SPDX license names so it is overdue to change
the ones in the LICENSE fileds to the SPDX values. Add a conversion
script which makes this straightforward on the most part.
Ultimately this allows the core code to be more efficient and not need
to consult the mappings.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Jose Quaresma [Fri, 18 Feb 2022 00:26:59 +0000 (00:26 +0000)]
gstreamer1.0: update licenses of all modules
Since all gstreamer modules uses LGPLv2.1 with exceptions
for some plugins in bad and ugly modules that has GPLv2+.
Signed-off-by: Jose Quaresma <quaresma.jose@gmail.com> Cc: Peter Kjellerstedt <peter.kjellerstedt@axis.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Hongxu Jia [Wed, 16 Feb 2022 02:54:29 +0000 (18:54 -0800)]
glibc: fix create thread failed in unprivileged process
Since upstream commit [d8ea0d0168 Add an internal wrapper for clone, clone2
and clone3] applied, start a unprivileged container (docker run without
--privileged), it creates a thread failed in container.
In commit d8ea0d0168, it calls __clone3 if HAVE_CLONE3_WAPPER is defined. If
__clone3 returns -1 with ENOSYS, fall back to clone or clone2.
As known from [1], cloneXXX fails with EPERM if CLONE_NEWCGROUP,
CLONE_NEWIPC, CLONE_NEWNET, CLONE_NEWNS, CLONE_NEWPID, or CLONE_NEWUTS
was specified by an unprivileged process (process without CAP_SYS_ADMIN)
Richard Purdie [Fri, 18 Feb 2022 10:53:25 +0000 (10:53 +0000)]
recipeutils: Add missing get_srcrev() call
Updates within bitbake now require this call to be triggered somewhere with
floating git source revs. Add the missing call. Issue can be reproduced with:
devtool check-upgrade-status dbus-wait
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
There is no other unit in oe-core where watchdog is enabled, and
this feature starts to behave weirdly when test_date is adjusting the clock,
which means weston is restarted without need, so disable for weston
test stability.
The issue won't show up on kvm qemu (x86/x86_64) because it runs
too quickly, but non-kvm qemu (ppc/mips/arm) all fail in the same
way due to slower timings.
Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Richard Purdie [Thu, 10 Feb 2022 13:44:22 +0000 (13:44 +0000)]
selftest/bbtests: Add tests for git floating tag resolution
This test ensures that where a floating tag is used for a git url, there
aren't a number of different bugs such as inconsistent source revisions
for the tag within a given build and that the recipe is reparsed at each
run to ensure the tag is checked.
A test is also added to ensure that the build fails if SRCPV (get_srcrev())
isn't used yet there is a floating tag.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
wangmy [Mon, 14 Feb 2022 23:54:35 +0000 (07:54 +0800)]
mesa: upgrade 21.3.5 -> 21.3.6
Changelog:
=========
Bug fixes
---------
radv: CullDistance fail
i965: Segmentation fault during glinfo context destruction, regression in 21.3.x
Vulkan Wayland WSI returns empty surface formats
[REGRESSION][BISECTED] iris: Qutebrowser/QtWebEngine sporadically flashes the window in white
Flickering Intel Uhd 620 Graphics
Broken Terraria & Glitches in Forza Horizon 4
Changes
-------
Revert "nir/algebraic: distribute fmul(fadd(a, b), c) when b and c are constants"
anv: Fix subgroupSupportedStages physical property
Revert "zink: handle vertex buffer offset overflows"
ir3: Fix copy-paste mistakes in ir3_block_remove_physical_predecessor()
ir3/cp: ir3: Prevent propagating shared regs out of loops harder
ir3: opt_deref in opt loop to remove unnecessary tex casts
crocus: find correct relocation target for the bo.
vulkan: Fix leak of error messages
pick_status.json: Update to cb781fc350108584116280fc597c695d2f476c68
pick_status.json: Mark 15e77504461a30038a054c87cc53a694171c9cf4 as denominated
pick_status.json: Mark 960e72417f3e8885699cf384f690853e14ba44da as denominated
intel/fs: Take into account region strides during SIMD lowering decision of SHUFFLE.
vulkan/wsi/wayland: Fix add_wl_shm_format alpha/opaqueness.
vulkan/wsi/wayland: Convert missing vulkan formats to shm formats.
vulkan/wsi/wayland: Add modifiers for RGB formats.
vulkan/wsi/wayland: Fix add_drm_format_modifier aplha/opaqueness.
anv/pass: Don't set first_subpass_layout for stencil-only attachments
vulkan/wsi: Set MUTABLE_FORMAT_BIT in the prime path
i965: Avoid NULL drawbuffer in brw_flush_front
intel/fs: don't set allow_sample_mask for CS intrinsics
intel/nir: fix shader call lowering
panvk: Fix pointer corruption in panvk_add_wait_event_syncobjs
zink: never use SpvOpImageQuerySizeLod for texel buffers
zink: reorder fbfetch flag-setting to avoid null deref
zink: fix vertex buffer mask computation for null buffers
zink: clamp tbo creation to maxTexelBufferElements
zink: add vertex shader pipeline bit for generated barrier construction
zink: fix waiting on current batch id
zink: cast image atomic op params/results based on image type
zink: use SpvScopeDevice over SpvScopeWorkgroup for atomic shader ops
zink: disable PIPE_SHADER_CAP_FP16_CONST_BUFFERS
llvmpipe: disable PIPE_SHADER_CAP_FP16_CONST_BUFFERS
llvmpipe: ci updates
zink: add VK_BUFFER_USAGE_CONDITIONAL_RENDERING_BIT_EXT for query binds
zink: fix PIPE_CAP_TGSI_BALLOT export conditional
zink: reject invalid draws
zink: min/max blit region in coverage functions
anv: Disable CCS_E for some 8/16bpp copies on TGL+
anv: Use ANV_FAST_CLEAR_DEFAULT_VALUE for CCS on TGL+
anv: Re-enable CCS_E on TGL+
iris: implement inter-context busy-tracking
aco: fix neg(abs(mul(a, b))) if the mul is not VOP3
aco: don't encode src2 for v_writelane_b32_e64
radv: fix R_02881C_PA_CL_VS_OUT_CNTL with mixed cull/clip distances
radv/winsys: fix missing buffer_make_resident() for the null winsys
tu: VkExternalImageFormatProperties is optional
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
wangmy [Mon, 14 Feb 2022 23:54:36 +0000 (07:54 +0800)]
rng-tools: upgrade 6.14 -> 6.15
0001-Adding-ability-to-detect-non-posix-extensions-for-pt.patch
0002-Allow-for-use-of-either-pthread-affinity-set-methods.patch
removed since they're included in 6.15.
Changelog:
=========
Adjust rngtests for better behavior in travis
fix use of non-posix setaffinity call to allow building on strict posix (musl) systems
Add armv6l to list of detected arches for pkcs11
misc fixes to allow building on libc-musl
fix a deadlock in jitter shutdown sequence
minor warning fixups (unused variables)
improve cpu detection code
improve jitter cpu monopolization on small/single cpu systems
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Christian Eggers [Tue, 15 Feb 2022 12:54:56 +0000 (13:54 +0100)]
curl: configure with '--without-ssl' if ssl is disabled
curl requires that at least one SSL implementation or explicitly
'--without-ssl' is specified. This is particularly the case if
PACKAGECONFIG is empty.
| configure: error: select TLS backend(s) or disable TLS with
--without-ssl.
|
| Select from these:
|
| --with-amissl
| --with-bearssl
| --with-gnutls
| --with-mbedtls
| --with-mesalink
| --with-nss
| --with-openssl (also works for BoringSSL and libressl)
| --with-rustls
| --with-schannel
| --with-secure-transport
| --with-wolfssl
|
Fixes: eef6c45fc6ec ("curl: Rework openssl and random PACKAGECONFIGs") Signed-off-by: Christian Eggers <ceggers@arri.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Konrad Weihmann [Tue, 15 Feb 2022 12:41:02 +0000 (13:41 +0100)]
gmp: fix EXTRA_OECONF for mipsarchr6
previously used mipsarchr6:append created an empty set for
EXTRA_OECONF and then appended --disable-assembly
while it should be just added to the existing var value.
Without this patch gmp will be configured without
--enable-cxx=detect for mipsarchr6 targets
Signed-off-by: Konrad Weihmann <kweihmann@outlook.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Konrad Weihmann [Tue, 15 Feb 2022 10:14:32 +0000 (11:14 +0100)]
ruby: fix DEPENDS append
recent change create a blank scope of DEPENDS for class-target,
basically leaving out all general dependencies, leading to the effect
that ruby will be shipped without the runtime dependencies of zlib,
openssl and libffi, making the corresponding gems unusable at runtime.
As the class-target scope should be appended only the correct override
is append:class-target
Signed-off-by: Konrad Weihmann <kweihmann@outlook.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Richard Purdie [Mon, 14 Feb 2022 16:20:18 +0000 (16:20 +0000)]
ltp: Disable proc01 test
This test has history of hanging on arm trying to read from /proc/kmsg and it has
reappeared. Disable the test since hanging autobuilder builds are annoying. I suspect
there is a genuine race on ARM somewhere here in the kernel.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
wangmy [Mon, 14 Feb 2022 14:28:42 +0000 (22:28 +0800)]
python3-pathlib2: upgrade 2.3.6 -> 2.3.7
Changelog:
=========
This version will be the last release to support Python 2.7.
Fix bug in samefile on Windows when file does not exist.
Add newline parameter for write_text (see issue #64).
Add many more type annotations.
Continuous integration migrated to github actions.
Project migrated to jazzband.
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
wangmy [Mon, 14 Feb 2022 14:28:14 +0000 (22:28 +0800)]
harfbuzz: upgrade 3.3.2 -> 3.4.0
Changelog:
=========
*Perform sanity checks on shaping results is now part of "harfbuzz" library
and can be enabled by setting the buffer flag HB_BUFFER_FLAG_VERIFY.
*Arabic Mark Transient Reordering Algorithm have been updated to revision 6.
*ISO 15924 code for mathematical notation, 'Zmth', now maps to the OpenType
'math' tag.
*It is now possible to get at once all math kerning values for a given glyph
at a given corner.
*Fix locale_t portability issues on systems the typedef's it to a void pointer
*New API:
+HB_BUFFER_FLAG_VERIFY
+HB_OT_TAG_MATH_SCRIPT
+HB_SCRIPT_MATH
+hb_ot_math_kern_entry_t
+hb_ot_math_get_glyph_kernings
Deprecated API
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Add support for packed images to wic rawcopy handler do minimize disk
usage in deploy directory and reuse of packed images between wic and
swupdate. Add `unpack` to sourceparams to unpack an bz2, gz and xz
archives.
Example:
part / --source rawcopy --sourceparams="file=core-image-minimal-qemu.ext4.gz,unpack"
Signed-off-by: Stefan Herbrechtsmeier <stefan.herbrechtsmeier@weidmueller.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Christian Eggers [Mon, 14 Feb 2022 10:18:14 +0000 (11:18 +0100)]
mc: fix build if ncurses have been configured without wide characters
Some distros like poky-tiny set ENABLE_WIDEC=false, which disables wide
character support for ncurses. The new patch fixes the build of mc for
this case.
Since 9000f8033662, NCURSES_WIDECHAR is set explicitly to 1 for musl.
This doesn't work for ENABLE_WIDEC==false. In this case,
NCURSES_WIDECHAR must be set explicitly to 0, as curses.h does not
record whether the ncurses library has actually been built with or
without wide characters.
Fixes: 9000f8033662 ("mc: upgrade 4.8.25 -> 4.8.26") Signed-off-by: Christian Eggers <ceggers@arri.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Richard Purdie [Mon, 14 Feb 2022 11:47:11 +0000 (11:47 +0000)]
openssl: Add perl functionality test to do_configure
Loading the POSIX module after loading others in perl causes errors to get hidden. The
resulting build failures are obtuse and hard to debug. We see this quite often when
we upgrade glibc but not uninative and there are symbol mismatches.
Add a quick test to the start of configure which tests perl operates correct and shows
a much more obvious error if it isn't since the POSIX module doesn't have to reload.
An example of the new error is:
| Can't load 'XXX/buildtools-extended-tarball/1.0-r0/testimage-sdk/XXX/openssl-native/3.0.1-r0/recipe-sysroot-native/usr/lib/perl5/5.34.0/x86_64-linux/auto/POSIX/POSIX.so' for module POSIX:
| XXX/buildtools-extended-tarball/1.0-r0/testimage-sdk/sysroots-uninative/x86_64-linux/lib/libm.so.6: version `GLIBC_2.35' not found
| (required by XXX/buildtools-extended-tarball/1.0-r0/testimage-sdk/XXX/openssl-native/3.0.1-r0/recipe-sysroot-native/usr/lib/perl5/5.34.0/x86_64-linux/auto/POSIX/POSIX.so) at
| XXX/buildtools-extended-tarball/1.0-r0/testimage-sdk/XXX/openssl-native/3.0.1-r0/recipe-sysroot-native/usr/lib/perl5/5.34.0/XSLoader.pm line 111.
| at XXX/buildtools-extended-tarball/1.0-r0/testimage-sdk/XXX/openssl-native/3.0.1-r0/recipe-sysroot-native/usr/lib/perl5/5.34.0/x86_64-linux/POSIX.pm line 24.
which clearly shows the glibc symbol issue.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
