Haris Okanovic [Mon, 5 Dec 2016 21:48:18 +0000 (15:48 -0600)]
run-postinsts: Print message before running deferred postinst scripts
Opkg can defer running postinst scripts to first boot, which can take
a while on some systems. The output of `opkg configure` (or whatever pm
is used) is redirected to a file when logging is enabled
(I.e. $POSTINST_LOGGING == 1), making the machine appear hung during
this process. This change simply prints a wait message on the console
to inform the user of this potentially long and silent operation so
that they do not mistakenly reboot their machine.
Why not simply `tee` the output instead?
Tee might be provided by BusyBox in some distros, which may need to run
update-alternatives in the very postinst scripts being executed by this
process. It's therefore not safe to assume Tee (or any other packaged
util) is available until the configure process finishes.
Signed-off-by: Haris Okanovic <haris.okanovic@ni.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Marek Vasut [Mon, 7 Nov 2016 18:20:06 +0000 (19:20 +0100)]
u-boot: mkimage: Fix build of u-boot-mkimage
The build failed in multiple configurations. First, the native and
nativesdk was using the host compiler and was pulling host libraries
into the build. Second, the target configuration was attempting to
execute tools/bin2header tool on host, which is compiled for target,
to generate license header file that is not used by tools.
This patch changes the EXTRA_OEMAKE to address these issues, to build
both native and target builds with the correct compilers and correct
sysroots. Moreover, this patch removes the CONFIG_CMD_LICENSE from
tools build, thus disabling the execution of target tools/bin2header.
Signed-off-by: Marek Vasut <marex@denx.de> Cc: Ross Burton <ross.burton@intel.com>
Contains just enough to mount and unmount nfs volumes, i.e.
the same as nfs-utils-client before commit 39bb7e3 ("nfs-utils:
separate package as Debain style").
Drop nfs-utils-client's dependency on bash. It contains two shell
scripts, /etc/init.d/nfscommon and /usr/sbin/start-statd, both
using /bin/sh.
Signed-off-by: Andreas Oberritter <obi@opendreambox.org> Signed-off-by: Ross Burton <ross.burton@intel.com>
update-rc.d: ignore initscript in prerm and preinst when systemd is active
In hybrid systemd/sysvinit builds, if the recipe inherits systemd and systemd
is installed, we can safely assume that the service gets stopped by the prerm
script fragment from systemd.bbclass. This fixes deinstallation of packages
with initscripts returning errors when no running service was found. The preinst
shouldn't run the initscript either, because postinst will call systemctl restart.
Signed-off-by: Andreas Oberritter <obi@opendreambox.org> Signed-off-by: Ross Burton <ross.burton@intel.com>
libc-package.bbclass: split binary localedata even more if asked to
If GLIBC_SPLIT_LC_PACKAGES is set to a non-zero value, convert
glibc-binary-localedata-XX-YY to be a meta package depending on
glibc-binary-localedata-XX-YY-lc-address and so on. This enables
saving quite some space if someone doesn't need LC_COLLATE for
example.
Some regex code was removed from output_locale_binary_rdepends,
because legitimize_package_name already converts to lowercase.
Signed-off-by: Andreas Oberritter <obi@opendreambox.org> Signed-off-by: Ross Burton <ross.burton@intel.com>
Robert Yang [Mon, 5 Dec 2016 14:54:40 +0000 (06:54 -0800)]
image.bbclass: inherit image_types_uboot when needed
Fixed:
MACHINE = "qemuarm"
IMAGE_FSTYPES += "ext3.bz2.u-boot"
[snip]
No IMAGE_CMD defined for IMAGE_FSTYPES entry 'ext3.bz2.u-boot' - possibly invalid type name or missing support class
[snip]
This is because image_types_uboot is not inherited, inherit it when
needed will fix the problem.
Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Yet another instance of us expecting a string back from subprocess when
in Python 3 what you get back is bytes. Just decode the output within
run_command() so we avoid this everywhere.
Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Khem Raj [Mon, 28 Nov 2016 21:26:06 +0000 (13:26 -0800)]
systemd: Upgrade to 232
* Drop support for rcS.d SysV init scripts.
These are prone to cause dependency loops, and almost all packages with
rcS scripts now ship a native systemd service.
* Drop mount propagation patch, it only happens with libseccomp, OE doesnt
enable it
* kdbus option has disappeared from configure
* Ignore dev-so for PN now since systemd introduced private .so see
https://github.com/systemd/systemd/issues/3810
* Add libnss* to PACKAGES_DYNAMIC for libnss-resolve to work correctly
* Forward port systemd-boot patches to systemd-232
Signed-off-by: Khem Raj <raj.khem@gmail.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Khem Raj [Fri, 2 Dec 2016 19:32:52 +0000 (11:32 -0800)]
libva: Import from meta-intel and update to 1.7.3
This recipe is used by intel and amd BSP layers
additional copies are also there see
https://layers.openembedded.org/layerindex/branch/master/recipes/?q=libva
Signed-off-by: Khem Raj <raj.khem@gmail.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Mingli Yu [Wed, 7 Dec 2016 08:01:11 +0000 (16:01 +0800)]
tiff: Security fix CVE-2016-9535
* libtiff/tif_predict.h, libtiff/tif_predict.c:
Replace assertions by runtime checks to avoid assertions in debug mode,
or buffer overflows in release mode. Can happen when dealing with
unusual tile size like YCbCr with subsampling.
Richard Purdie [Wed, 7 Dec 2016 13:54:18 +0000 (13:54 +0000)]
subversion: Fix issues in LDFLAGS sed manipulation
The existing sed expression can match expressions like
--sysroot=/some/path/xxx-linux/ which clearly isn't intended and
injects incorrect paths into LDFLAGS.
Fix this in the same way we address the problem in CFLAGS. This fixes corrupt
build paths and incorrect paths in .la files amongst other issues.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Richard Purdie [Wed, 7 Dec 2016 12:07:31 +0000 (12:07 +0000)]
attr: Convert SSTATEPOSTINSTFUNCS to a do_install_append
A SSTATEPOSTINSTFUNCS function here is overkill, just do this in a
do_install_append_class-native and create relative symlinks rather
than absolute ones which would then have to be relocated.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Bruce Ashfield [Fri, 2 Dec 2016 21:09:25 +0000 (16:09 -0500)]
kernel-yocto: exit on non-zero return code
Historically the processing of kernel meta data contained some
commands that exited with a non-zero return code. Special processing
was required to properly deal with their exit.
That is no longer true, and instead of handling all return codes
and doing an explicit 'exit' call, we can remove set -e from the
routine and have all errors be trapped and stop processing.
Signed-off-by: Bruce Ashfield <bruce.ashfield@windriver.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
To provide useful error messages the tools dump pre-processed
files and messages to a temporary file. If multiple users are
doing builds, this means they either race, or can have permissions
issues.
By creating the temporary file via mktemp, we avoid both issues.
(We also make sure to clean these up on exit, or /tmp will get
polluted quickly).
patch: do not assume a branch specific patch queue is needed
When processing input files per-branch and global patch queues are
generated. If the meta-data has not created any branches in the
repo, no branch specific queue is required.
The tools assumed that one is always valid, and hence would throw a
non-zero exit code and stop processing.
By testing for a named per-branch queue, we avoid this issue.
Signed-off-by: Bruce Ashfield <bruce.ashfield@windriver.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Bruce Ashfield [Fri, 2 Dec 2016 21:09:22 +0000 (16:09 -0500)]
linux-yocto/4.8: update to v4.8.10
Integrating the 4.8.9 and 4.8.10 -stable updates. The commit log is
as follows:
cf5ae2989a32 Linux 4.8.10 5cd8f6788ff3 usb: gadget: f_fs: stop sleeping in ffs_func_eps_disable e2458382c792 usb: gadget: f_fs: edit epfile->ep under lock e34a0f1c53b5 sparc64: Delete now unused user copy fixup functions. af97481a6f5b sparc64: Delete now unused user copy assembler helpers. ac663c54f40b sparc64: Convert U3copy_{from,to}_user to accurate exception reporting. d91bb7a87e26 sparc64: Convert NG2copy_{from,to}_user to accurate exception reporting. a15859f9d839 sparc64: Convert NGcopy_{from,to}_user to accurate exception reporting. bb522726d311 sparc64: Convert NG4copy_{from,to}_user to accurate exception reporting. b0580eadc19f sparc64: Convert U1copy_{from,to}_user to accurate exception reporting. 50e927483ccf sparc64: Convert GENcopy_{from,to}_user to accurate exception reporting. 620ec41010d1 sparc64: Convert copy_in_user to accurate exception reporting. bf4d0da8e800 sparc64: Prepare to move to more saner user copy exception handling. bbbab9f59ea7 sparc64: Delete __ret_efault. 81a91edbb91a sparc64: Handle extremely large kernel TLB range flushes more gracefully. 7f8a50eb38d3 sparc64: Fix illegal relative branches in hypervisor patched TLB cross-call code. f7ef55af2f1b sparc64: Fix instruction count in comment for __hypervisor_flush_tlb_pending. 2a28ab3d4148 sparc64: Fix illegal relative branches in hypervisor patched TLB code. f4fb552a033e sparc64: Handle extremely large kernel TSB range flushes sanely. 51915c6d9070 sparc: Handle negative offsets in arch_jump_label_transform da6fe239ceff spi: spidev_test: fix build with musl libc 4ea98e573d65 net: stmmac: Fix lack of link transition for fixed PHYs 150b491b1b88 sctp: change sk state only when it has assocs in sctp_shutdown 5235fcfa6cf8 bnx2: Wait for in-flight DMA to complete at probe stage 6523ff2e27fe Revert "bnx2: Reset device during driver initialization" 224fb8cbefb2 mlxsw: spectrum_router: Correctly dump neighbour activity 9092bbd64bd9 mlxsw: spectrum: Fix refcount bug on span entries 5712922773b5 Revert "include/uapi/linux/atm_zatm.h: include linux/time.h" 2b5f22e4f7fd tcp: take care of truncations done by sk_filter() 22a78d4c7f43 ipv4: use new_gw for redirect neigh lookup bccb4093d464 net: __skb_flow_dissect() must cap its return value a1632e969a55 net: icmp_route_lookup should use rt dev to determine L3 domain 9885f474d92b sock: fix sendmmsg for partial sendmsg b78ba0a0f231 fib_trie: Correct /proc/net/route off by one error 92fd1c1f2fd2 net: icmp6_send should use dst dev to determine L3 domain 09ee09498bca bpf: fix htab map destruction when extra reserve is in use de289ad2e575 sctp: assign assoc_id earlier in __sctp_connect 76b5fee5cfa0 ipv6: dccp: add missing bind_conflict to dccp_ipv6_mapped 84d9c612bb7a ipv6: dccp: fix out of bound access in dccp_v6_err() ba93cf7d2118 dccp: fix out of bound access in dccp_v4_err() 378a61101374 dccp: do not send reset to already closed sockets 72b03e549b95 dccp: do not release listeners too soon b3523a0773ed tcp: fix return value for partial writes 1f49cc6fa91c ipv4: allow local fragmentation in ip_finish_output_gso() 842a858fa048 tcp: fix potential memory corruption fc3b825f2c81 ip6_tunnel: Clear IP6CB in ip6tunnel_xmit() f5f4b71d5632 bgmac: stop clearing DMA receive control register right after it is set 0c7f764d2c6a net: mangle zero checksum in skb_checksum_help() ac22a3ba0796 net: clear sk_err_soft in sk_clone_lock() 5b078dc6fb64 dctcp: avoid bogus doubling of cwnd after loss 876577321657 Linux 4.8.9 07d00beb1e04 netfilter: fix namespace handling in nf_log_proc_dostring 8ef009e09c13 drm/i915: Fix mismatched INIT power domain disabling during suspend 88a45e5d2c0d drm/amdgpu: fix a vm_flush fence leak 25ed6e4b0b65 drm/amdgpu: fix fence slab teardown de5e9aa77a3c NFSv4.1: work around -Wmaybe-uninitialized warning 18c801047a18 libceph: fix legacy layout decode with pool 0 53c1792b94da memcg: prevent memcg caches to be both OFF_SLAB & OBJFREELIST_SLAB 02e1ee6b3e1c mmc: mxs: Initialize the spinlock prior to using it ce0702e35aeb pinctrl: iproc: Fix iProc and NSP GPIO support 320244ac9eb6 ASoC: sun4i-codec: return error code instead of NULL when create_card fails 2140d4fd9277 ASoC: Intel: Skylake: Always acquire runtime pm ref on unload 5037fdbc62c2 gpio: of: fix GPIO drivers with multiple gpio_chip for a single node 7a9239fd0480 gpio/mvebu: Use irq_domain_add_linear 6de98e87effb batman-adv: Modify neigh_list only with rcu-list functions a3f000ce7b44 ACPI/PCI: pci_link: Include PIRQ_PENALTY_PCI_USING for ISA IRQs 6c76dd0c7066 ACPI/PCI: pci_link: penalize SCI correctly 86c711665c84 ACPI/PCI/IRQ: assign ISA IRQ directly during early boot stages ad185d9251e1 ACPI / APEI: Fix incorrect return value of ghes_proc() b55ebc89ab1d mmc: sdhci-msm: Fix error return code in sdhci_msm_probe() 85284c0850f9 i40e: fix call of ndo_dflt_bridge_getlink() 1242c9dfab0c hwrng: core - Don't use a stack buffer in add_early_randomness() c1a2ada73dac lib/genalloc.c: start search from start of chunk 06bb5ebedbb4 s390/dumpstack: restore reliable indicator for call traces 1ef1bd02ad23 rtc: pcf2123: Add missing error code assignment before test 4baabb72e9dd clk: samsung: clk-exynos-audss: Fix module autoload 3bbdbd8aa3c8 x86/build: Fix build with older GCC versions f5eadc27a60c Revert "clocksource/drivers/timer_sun5i: Replace code by clocksource_mmio_init" 645a6b823739 nvme: Delete created IO queues on reset 07c4cbe01341 svcrdma: Tail iovec leaves an orphaned DMA mapping 4131e00a436e svcrdma: Skip put_page() when send_reply() fails 755ab7aa1466 mei: bus: fix received data size check in NFC fixup d1b564536c6a perf top: Fix refreshing hierarchy entries on TUI 6ac4e06b717f Input: synaptics-rmi4 - fix error handling in I2C transport driver d3716f1b3e4b Input: synaptics-rmi4 - fix error handling in SPI transport driver 66503ec38f34 watchdog: core: Fix devres_alloc() allocation size c5e9e5cc8cd1 agp/intel: Flush chipset writes after updating a single PTE 813617a4c8dc iommu/vt-d: Fix dead-locks in disable_dmar_iommu() path b6ef0b142208 iommu/amd: Free domain id when free a domain of struct dma_ops_domain 2ef38255b588 iommu/io-pgtable-arm: Check for v7s-incapable systems d3d9428d7133 xprtrdma: Fix DMAR failure in frwr_op_map() after reconnect 31c749bee3de xprtrdma: use complete() instead complete_all() 67080e2785a3 drm/amd: fix scheduler fence teardown order v2 b0da5ab2ffb5 drm/amdgpu: fix sched fence slab teardown 920a85ba4306 tty/serial: at91: fix hardware handshake on Atmel platforms 9d76a886eb2f drm/amdgpu: fix crash in acp_hw_fini 6e652d18d73d drm/amdgpu: disable runtime pm in certain cases 8c8fdc683295 drm/i915/dp: Extend BDW DP audio workaround to GEN9 platforms db8e005bf2ba drm/i915/dp: BDW cdclk fix for DP audio f50b7450a8e4 drm/i915: Respect alternate_ddc_pin for all DDI ports e1b24f6a0b3c drm/radeon: disable runtime pm in certain cases eb13abb0e515 KVM: arm/arm64: vgic: Prevent access to invalid SPIs 2850fad5acb0 scsi: scsi_dh_alua: Fix a reference counting bug 5fac70d772a4 scsi: scsi_dh_alua: fix missing kref_put() in alua_rtpg_work() f29bcd11a170 scsi: mpt3sas: Fix for block device of raid exists even after deleting raid disk b2040deabb07 scsi: qla2xxx: Fix scsi scan hang triggered if adapter fails during init 1281b9683f96 iio: st_sensors: fix scale configuration for h3lis331dl 4dfb6d1dd11d iio: orientation: hid-sensor-rotation: Add PM function (fix non working driver) 341c5534edad iio: hid-sensors: Increase the precision of scale to fix wrong reading interpretation. b9d031f354da cdc-acm: fix uninitialized variable c480880cd12c clk: qoriq: Don't allow CPU clocks higher than starting value ee27fd32c499 toshiba-wmi: Fix loading the driver on non Toshiba laptops f713523a234c drbd: Fix kernel_sendmsg() usage - potential NULL deref 31da266e4b9a usb: gadget: u_ether: remove interrupt throttling 264e4131a167 USB: cdc-acm: fix TIOCMIWAIT c12c24eeaf77 usb: dwc3: Fix error handling for core init 6b95417150b7 staging: nvec: remove managed resource from PS2 driver 82239ab105a5 Revert "staging: nvec: ps2: change serio type to passthrough" 529789866abe drivers: staging: nvec: remove bogus reset command for PS/2 interface dea774aac054 staging: comedi: ni_tio: fix buggy ni_tio_clock_period_ps() return value 5d510185f99a staging: sm750fb: Fix bugs introduced by early commits 45983d678b70 staging: iio: ad5933: avoid uninitialized variable in error case 5289e59246dd mmc: mmc: Use 500ms as the default generic CMD6 timeout ce4dfe7d927e mmc: sdhci: Fix unexpected data interrupt handling bde8d3f73375 mmc: sdhci: Fix CMD line reset interfering with ongoing data transfer 10d24701f3f4 cpupower: Correct return type of cpu_power_is_cpu_online() in cpufreq-set f062e738c19b pinctrl: cherryview: Prevent possible interrupt storm on resume 1d99fe3317e3 pinctrl: cherryview: Serialize register access in suspend/resume f5ad96462615 arc: Implement arch-specific dma_map_ops.mmap 004e7c97f181 PCI: Don't attempt to claim shadow copies of ROM 7fac0361f94e ARC: timer: rtc: implement read loop in "C" vs. inline asm 4058116db4d0 s390/hypfs: Use get_free_page() instead of kmalloc to ensure page alignment 2f3e0b82ebe9 coredump: fix unfreezable coredumping task d6ee4f47e2e7 mm/hugetlb: fix huge page reservation leak in private mapping error paths e87bf4f558f1 mm: hwpoison: fix thp split handling in memory_failure() 67c79e166d46 swapfile: fix memory corruption via malformed swapfile c87739e5d029 shmem: fix pageflags after swapping DMA32 object 5b5243b606ec mm, frontswap: make sure allocated frontswap map is assigned 2e594273d4c5 dib0700: fix nec repeat handling 9964230320d5 ASoC: cs4270: fix DAPM stream name mismatch 9386a722d250 ALSA: info: Limit the proc text input size c3ea1b15b71e ALSA: info: Return error for invalid read/write
Signed-off-by: Bruce Ashfield <bruce.ashfield@windriver.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Ed Bartosh [Fri, 2 Dec 2016 23:48:06 +0000 (01:48 +0200)]
selftest: wic: fix test_qemu
Setting WKS_FILE variable in qemux86-64 made wic test to
use wrong wks file to produce an image and resulted in
test_qemu failure.
Used conditional assignment in qemux86-64 and explicitly
set WKS_FILE in wic testing suite to make the suite to use
wic-image-minimal.wsk. This should fix test_qemu failure.
Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Robert Yang [Thu, 1 Dec 2016 08:12:38 +0000 (00:12 -0800)]
kernel.bbclass: let do_deploy depend on do_packagedata
The do_deploy runs depmodwrapper which requires
pkgdata/kernel-depmod/kernel-abiversion, which is generated by
PACKAGEFUNCS. So we need let do_deploy depend on do_packagedata.
This can fix the errors which happens sometimes when kernel upgrades:
DEBUG: Executing shell function do_deploy
Error: Kernel version 4.8.8-WR9.0.0.1_standard does not match kernel-abiversion (4.8.8-WR9.0.0.0_standard)
And we only see this error when kernel upgrades and rebuild, but doesn't
see it in a normal build, this is becuase depmodwrapper doesn't exit
error when kernel-depmod/kernel-abiversion doesn't exit, it just prints
an error which should go into log.do_deploy:
if [ ! -r /path/to/sysroots/qemux86-64/pkgdata/kernel-depmod/kernel-abiversion ]; then
echo "Unable to read: /path/to/sysroots/qemux86-64/pkgdata/kernel-depmod/kernel-abiversion" >&2
else
[foo]
fi
We can see that there is no "exit 1", I guess it was designed to let it
can run without kernel-abiversion
Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
André Draszik [Thu, 1 Dec 2016 11:23:22 +0000 (11:23 +0000)]
arch-mips: sort new MACHINEOVERRIDES by priority
While I couldn't find explicit documentation, it appears
that the list of MACHINEOVERRIDES should be sorted from
less specific to more specific left to right, so that
more specific overrides take precedence.
Signed-off-by: André Draszik <adraszik@tycoint.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Patrick Ohly [Thu, 1 Dec 2016 09:40:46 +0000 (10:40 +0100)]
libarchive: enable non-recursive extract/list
Required for meta-swupd performance enhancements: in meta-swupd, the
so called "mega" image contains a rootfs with all files that can
potentially be installed on a device. Other virtual image recipes need
a subset of those files or directories, and a partial extraction from
a single tar archive is faster than letting all virtual image recipes
share access to a directory under a single pseudo instance.
It may be necessary to extract a directory with all of its attributes
without the content of the directory, hence this patch. Upstream
agreed to consider merging such a patch (see
https://groups.google.com/forum/#!topic/libarchive-discuss/JO3hqSaAVfs)
but has been slow in actually commenting on it, so for now it has
to be carried as distro patch.
Signed-off-by: Patrick Ohly <patrick.ohly@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Khem Raj [Thu, 1 Dec 2016 05:56:01 +0000 (21:56 -0800)]
ffmpeg: Add packageconfig for vdpau accelaration
Fixes dangling dependency QA issue
WARNING: ffmpeg-3.2.1-r0 do_package_qa: QA Issue: libavutil rdepends on libvdpau, but it isn't a build dependency, missing libvdpau in DEPENDS or PACKAGECONFIG? [build-deps]
Signed-off-by: Khem Raj <raj.khem@gmail.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Jussi Kukkonen [Fri, 4 Nov 2016 13:16:49 +0000 (15:16 +0200)]
run-postinsts: Use opkg/dpkg to configure when possible
Currently run-postinsts script has code to run postinst scripts
via opkg/dpkg configure but that code is never used. The advantage
of using package managers instead of just executing the scripts is
to keep the package manager DB updated.
Fix the script so that the package managers are used when appropriate.
Also use $localstatedir for the opkg runtime file location.
Fixes [YOCTO #10478].
Signed-off-by: Jussi Kukkonen <jussi.kukkonen@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Andre McCurdy [Tue, 29 Nov 2016 18:36:46 +0000 (10:36 -0800)]
tune-cortexa*.inc: squash whitespace within TUNE_FEATURES strings
TUNE_FEATURES is include in BUILDCFG_VARS, so any whitespace is
visible to the user during the build process. Remove the extra
whitespace added during the 2.1 development cycle:
Patrick Ohly [Wed, 30 Nov 2016 09:50:11 +0000 (10:50 +0100)]
pybootchartgui: support reading reduced /proc logs
Pre-processing /proc data during the build considerably reduces the
amount of data written to disk: 176KB instead of 4.7MB for a 20
minuted build. Parsing also becomes faster.
buildstats.bbclass only writes the reduced logs now, but support for
the full /proc files is kept around as reference.
Signed-off-by: Patrick Ohly <patrick.ohly@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Patrick Ohly [Wed, 30 Nov 2016 09:50:10 +0000 (10:50 +0100)]
buildstats: reduce amount of data stored for system utilization
Pre-processing /proc data during the build considerably reduces the
amount of data written to disk: 176KB instead of 4.7MB for a 20
minuted build. Parsing also becomes faster.
The disk monitor log added another 16KB in that example build. The
overall buildstat was 20MB, so the overhead for monitoring system
utilization is small enough that it can be enabled by default.
Signed-off-by: Patrick Ohly <patrick.ohly@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Patrick Ohly [Wed, 30 Nov 2016 09:50:09 +0000 (10:50 +0100)]
pybootchartgui: simplify drawing of memory usage
The internal representation after parsing now matches exactly
what the drawing code needs, thus speeding up drawing a bit.
However, the main motivation is to store exactly that required
information in a more compact file.
Signed-off-by: Patrick Ohly <patrick.ohly@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Patrick Ohly [Wed, 30 Nov 2016 09:50:08 +0000 (10:50 +0100)]
pybootchartgui: render disk space usage
This adds a new, separate chart showing the amount of disk space used
over time for each volume monitored during the build. The hight of the
graph entries represents the delta between current usage and minimal
usage during the build.
That's more useful than showing just the current usage, because then a
graph showing changes in the order of MBs in a volume that is several
GB large would be just flat.
The legend shows the maximum of those deltas, i.e. maximum amount of
space needed for the build. Minor caveat: sampling of disk space usage
starts a bit later than the initial task, so the displayed value may
be slightly lower than the actual amount of space needed because
sampling does not record the actual initial state.
Signed-off-by: Patrick Ohly <patrick.ohly@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Patrick Ohly [Wed, 30 Nov 2016 09:50:06 +0000 (10:50 +0100)]
buildstats: record disk space usage
Hooks into the new monitordisk.py event and records the used space for
each volume. That is probably the only relevant value when it comes to
visualizing the build and recording more would only increase disk
usage.
Signed-off-by: Patrick Ohly <patrick.ohly@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Patrick Ohly [Wed, 30 Nov 2016 09:50:04 +0000 (10:50 +0100)]
pybootchartgui: show system utilization
This enables rendering of the original bootchart charts for CPU, disk
and memory usage. It depends on the /proc samples recorded by the
updated buildstats.bbclass. Currently, empty charts CPU and disk usage
charts are drawn if that data is not present; the memory chart already
gets skipped when there's no data, which will also have to be added
for the other two.
Signed-off-by: Patrick Ohly <patrick.ohly@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Patrick Ohly [Wed, 30 Nov 2016 09:50:03 +0000 (10:50 +0100)]
pybootchartgui/draw.py: fix drawing of samples not starting at zero
The code did not handle x scaling correctly when drawing starts at
some time larger than zero, i.e. it worked for normal bootchart data,
but not for the system statistics recorded by buildstats.bbclass.
Signed-off-by: Patrick Ohly <patrick.ohly@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Patrick Ohly [Wed, 30 Nov 2016 09:50:02 +0000 (10:50 +0100)]
pybootchartgui/draw.py: allow moving process chart up and down
Substracting curr_y when determining the hight of the process chart is
wrong because the height is independent of the position where the
chart is about to be drawn. It happens to work at the moment because
curr_y is always 10 when render_processes_chart() gets called. But it
leads to a negative height when other charts are drawn above it, and
then the grid gets drawn on top of those other charts.
Substracting some constant is relevant because otherwise the box is
slightly larger than the process bars. Not sure exactly where that
comes from (text height?); leg_s seems a suitable constant and happens
to be 10, so everything still gets rendered exactly as before.
Signed-off-by: Patrick Ohly <patrick.ohly@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Patrick Ohly [Wed, 30 Nov 2016 09:50:01 +0000 (10:50 +0100)]
buildstats: add system state sampling
/proc/[diskstats|meminfo|stat] get sampled and written to the same
proc_<filename>.log files as during normal bootchat logging. This will
allow rendering the CPU, disk and memory usage charts.
Right now sampling happens once a second, triggered by the heartbeat
event.That produces quite a bit of data for long builds, which will be
addressed in a separate commit by storing the data in a more compact
form.
Signed-off-by: Patrick Ohly <patrick.ohly@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Jair Gonzalez [Wed, 30 Nov 2016 20:43:02 +0000 (14:43 -0600)]
parselogs: Whitelist GPT warnings as the device is fully functional
The warning occurs when the GPT image is not the same size than the
media into which it's being flashed, causing the backup GPT table
not being at the end of the disk. However, this is expected as the
image is created before having the information about the destination
media. The error is harmless, so it will be whitelisted.
Fixes [YOCTO 10481].
Signed-off-by: Jair Gonzalez <jair.de.jesus.gonzalez.plascencia@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
The iwlwifi module of any given kernel has a minimum and maximum
supported firmware version. The kernel begins by attempting to load the
maximum version, and decrements until it is successful. The 4.8 kernel's
maximum supported firmware version is 24, but thus far only 22 has been
released, meaning we get errors for 24 and 23.
Filter out iwlwifi firmware load error messages, as they are not
necessarily indicative of real problems.
Signed-off-by: California Sullivan <california.l.sullivan@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
When creating a patch set with cover letter using the
send-pull-request script, both the "In-Reply-To" and "References"
headers are appended twice in patch 2 and subsequent.
That's because git-format-patch already inserted them and then
git-send-email repeats that. Suppressing mail threading in
git-send-email with --no-thread avoids the problem and is the
right solution because it works regardless whether git-send-email is
called once or twicee.
Repeating these headers is a violation of RFC 2822 and can confuse
mail programs. For example, Patchwork does not detect a patch series
problem when there are these extra headers.
[YOCTO #10718]
Signed-off-by: Patrick Ohly <patrick.ohly@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
The copyright for the software has been transferred to Unicode Inc from IBM,
but the terms are same.
libiculx and libicule are no longer produced as they depend on an external
package icu-le-hb (previous versions had an option of using an internal
implementation which now has been dropped). I have verified that icu
dependencies in oe-core and meta-oe still build.
Signed-off-by: Alexander Kanavin <alexander.kanavin@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Yi Zhao [Mon, 28 Nov 2016 09:55:40 +0000 (17:55 +0800)]
libxml2: Security fix CVE-2016-5131
CVE-2016-5131 libxml2: Use-after-free vulnerability in libxml2 through
2.9.4, as used in Google Chrome before 52.0.2743.82, allows remote
attackers to cause a denial of service or possibly have unspecified
other impact via vectors related to the XPointer range-to function.
Martin Vuille [Sun, 27 Nov 2016 20:02:37 +0000 (15:02 -0500)]
terminal.py: Pass string instead of bytes to ExecutionError to avoid exception
Based on run() in bitbake/lib/bb/process.py, ExecutionError() expects strings
not bytes. Passing bytes results in a "TypeError: Can't convert 'bytes' object
to str implicitly" exception.
Fixes Bug 10729
Signed-off-by: Martin Vuille <jpmv27@yahoo.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Zhixiong Chi [Mon, 28 Nov 2016 08:12:04 +0000 (16:12 +0800)]
tiff: Security fix CVE-2016-9540
tools/tiffcp.c in libtiff 4.0.6 has an out-of-bounds write on tiled
images with odd tile width versus image width. Reported as MSVR 35103,
aka "cpStripToTile heap-buffer-overflow."
Aníbal Limón [Thu, 24 Nov 2016 21:06:04 +0000 (15:06 -0600)]
perl: Upgrade to 5.24.0
Configuration changes,
Simple changes was made to bump version and api version, related to
floating point handling now the configuration needs the inf, mantisa
and nan bytes.
The new version comes with the support of API calls like memmem and
{new,free,use}locale also structure for handle siginfo supported by
glibc and musl.
Finally use64bit{int, all} was disable because the previous
configure_args don't come with them and cases some tests to fail
related to bignum's and shared memory respectively. This doesn't
means that perl couldn't use 64-bit data types, it means that don't
stores by default into a 64 bit that is good for embedded space
purposes.
Modules changes,
Some core modules are now deprecated in order to use the core ones
like version-vpp and version-regex inside module-extutils-makemaker.
For full review see perl-rdepends.inc file.
Patches removed, comes with the upgrade now:
- perl/perl-remove-nm-from-libswanted.patch
- perl/perl-fix-CVE-2015-8607.patch
- perl/perl-fix-CVE-2016-2381.patch
Test,
The upgrade was test using ptest the suite is fixed now.
The pod2man and pod2text installation required now for some tests.
Buildhistory was use to review the changes and only diff changes
related to modules commented above.
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Mark Asselstine [Fri, 25 Nov 2016 04:17:14 +0000 (23:17 -0500)]
systemd.bbclass: don't block on service restart
The current class works fine when a recipe uses SYSTEMD_AUTO_ENABLE
'enable' and has no on device pkg_postinst(), ie when the postinst is
run as part of rootfs creation. However, when there is a component of
pkg_postinst() that is run on device the 'systemctl restart' is run as
part of the run_postinsts.service at boot. This results in the boot
spinning indefinitely with:
[ *** ] A start job is running for Run pending postinsts (7s / no limit)
The issue could potentially be that the packages service has an
'After' clause which comes later in the boot, beyond
run_postinsts.service, creating a chicken before the egg
scenario. Even service files without an 'After' clause cause this
situation however. Despite this not being the cause of the issue this
fix will prevent this scenario from happenning.
Using strace we are able to find that during boot, when
run_postinsts.service is running attempting to start or restart any
service will result in the call get stuck on poll(). Since the
run_postinsts.service does not monitor the outcome of the call to
restart we can work around this by using '--no-block'.
Signed-off-by: Mark Asselstine <mark.asselstine@windriver.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
Patrick Ohly [Thu, 24 Nov 2016 09:51:13 +0000 (10:51 +0100)]
qemuboot.bbclass: do not hook into do_rootfs
Writing qemuboot.conf in write_qemuboot_conf() does not modify the
rootfs and thus conceptually shouldn't be executed as part of rootfs
creation.
Running it as separate task is cleaner and fixes the problem of
missing qemuboot.conf files for meta-swupd virtual images; those
images replace do_rootfs and ROOTFS_POSTPROCESS_COMMANDs don't run at
all.
The task gets added such that it runs roughly at the same time as
before. Probably it doesn't actually need to depend on do_rootfs, but
this way we don't write a useless qemuboot.conf in cases where
do_rootfs fails.
Signed-off-by: Patrick Ohly <patrick.ohly@intel.com> Signed-off-by: Ross Burton <ross.burton@intel.com>
