From: Alexander Kanavin <alex.kanavin@gmail.com>
Date: Wed, 8 Jan 2020 13:27:51 +0000 (+0100)
Subject: ptest: report ptests that couldn't be run at all
X-Git-Tag: uninative-2.8~628
X-Git-Url: https://code.ossystems.io/gitweb?a=commitdiff_plain;h=4b78b6571a3653d7d8e9dab9512bad5d39483988;p=openembedded-core.git

ptest: report ptests that couldn't be run at all

Currently if a ptest does not produce PASS or FAIL, but simply
errors out, this is not caught or reported; I think some ptests
may have silently regressed due to this.

Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
---

diff --git a/meta/lib/oeqa/runtime/cases/ptest.py b/meta/lib/oeqa/runtime/cases/ptest.py
index aef79f62a9..eb284df439 100644
--- a/meta/lib/oeqa/runtime/cases/ptest.py
+++ b/meta/lib/oeqa/runtime/cases/ptest.py
@@ -67,6 +67,11 @@ class PtestRunnerTest(OERuntimeTestCase):
                 extras[testname] = {'status': result}
 
         failed_tests = {}
+
+        for section in sections:
+            if 'exitcode' in sections[section].keys():
+                failed_tests[section] = sections[section]["log"]
+
         for section in results:
             failed_testcases = [ "_".join(test.translate(trans).split()) for test in results[section] if results[section][test] == 'FAILED' ]
             if failed_testcases: