]> code.ossystems Code Review - openembedded-core.git/commitdiff
ptest: report ptests that couldn't be run at all
authorAlexander Kanavin <alex.kanavin@gmail.com>
Wed, 8 Jan 2020 13:27:51 +0000 (14:27 +0100)
committerRichard Purdie <richard.purdie@linuxfoundation.org>
Fri, 10 Jan 2020 20:32:04 +0000 (20:32 +0000)
Currently if a ptest does not produce PASS or FAIL, but simply
errors out, this is not caught or reported; I think some ptests
may have silently regressed due to this.

Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
meta/lib/oeqa/runtime/cases/ptest.py

index aef79f62a982cac3beb3ce7955e0326e480291b2..eb284df439b31c84a2f1682a7d00e41d2ab0682d 100644 (file)
@@ -67,6 +67,11 @@ class PtestRunnerTest(OERuntimeTestCase):
                 extras[testname] = {'status': result}
 
         failed_tests = {}
+
+        for section in sections:
+            if 'exitcode' in sections[section].keys():
+                failed_tests[section] = sections[section]["log"]
+
         for section in results:
             failed_testcases = [ "_".join(test.translate(trans).split()) for test in results[section] if results[section][test] == 'FAILED' ]
             if failed_testcases: