ChuanN-sudo/u-boot
1
0
Fork 0
forked from OERV-BSP/u-boot
Code Pull Requests Activity

test/py: Add a report show test durations

Browse Source 
Execution time varies widely with the existing tests. Provides a way to
produce a summary of the time taken for each test, along with a
histogram.

This is enabled with the --timing flag.

Enable it for sandbox in CI.

Example:

   Duration : Number of tests
   ======== : ========================================
       <1ms :  1
       <8ms :  1
      <20ms : # 20
      <30ms : ######## 127
      <50ms : ######################################## 582
      <75ms : ####### 102
     <100ms : ## 39
     <200ms : ##### 86
     <300ms : # 29
     <500ms : ## 42
     <750ms : # 16
      <1.0s : # 15
      <2.0s : # 23
      <3.0s :  13
      <5.0s :  9
      <7.5s :  1
     <10.0s :  6
     <20.0s :  12

Signed-off-by: Simon Glass <sjg@chromium.org>
Reviewed-by: Tom Rini <trini@konsulko.com>
This commit is contained in:
Simon Glass
2025-01-27 07:52:54 -07:00
committed by Tom Rini
parent 9f5d1863e9
commit 5e46a06950
4 changed files with 124 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

33
doc/develop/py_testing.rst
View File

@@ -246,6 +246,39 @@ Command-line options
sets the directory used to store persistent test data. This is test data that
may be re-used across test runs, such as file-system images.
--timing
shows a histogram of test duration, at the end of the run. The columns are:
Duration
the duration-bucket that this test was in
Total
total time of all tests in this bucket
Number of tests
graph showing the number of tests in this bucket, with the actual number
shown at the end
Example::
Duration : Total | Number of tests
======== : ======= |========================================
<20ms : 418ms |## 23
<30ms : 9.1s |######################################## 347
<40ms : 10.0s |################################# 294
<50ms : 3.1s |####### 69
<75ms : 2.6s |#### 43
<100ms : 1.7s |## 19
<200ms : 3.0s |## 22
<300ms : 1.7s | 7
<400ms : 675ms | 2
<500ms : 2.2s | 5
<750ms : 8.3s |# 13
<1.0s : 1.6s | 2
<2.0s : 9.4s | 7
<3.0s : 2.4s | 1
<7.5s : 6.1s | 1
`pytest` also implements a number of its own command-line options. Commonly used
options are mentioned below. Please see `pytest` documentation for complete
details. Execute `py.test --version` for a brief summary. Note that U-Boot's