EAS Development for Mainline Linux

EAS development for mainline Linux takes place on LKML and Linaro eas-dev mailing lists where proposed patches are discussed with the community. Arm now provides a pre-integrated version of latest EAS patches for mainline, for upstream development use.

EAS mainline is a moving integration branch tracking tip sched/core, mainline release candidate or linux-pm testing and adding the latest versions of EAS related patch sets targeted at the mainline kernel. The patches may already be under discussion on relevant open source mailing lists or waiting here while their dependencies get resolved and merged upstream.

The integration branch comes as is with synthetic test case testing only. The intention is to have a single branch containing the full EAS picture for mainline Linux kernel developers interested in tracking progress. This EAS mainline integration branch is not suitable for product development. For product, please use the AOSP common kernel.

Source code

EAS mainline integration branches are made available regularly on:

        git://linux-arm.org/linux-power.git

The releases are tagged with the date e.g. -20190310 so old integrations are available for comparison

Latest: integration-20200526

Tree: eas/next/integration

Base: eas/next/integration-base

Features:

  1. Schedutil as Energy Model user (v4 on lkml)
  2. Util(ization) update during Idle migration (v1 on lkml)
  3. (Devfreq) devices as Energy Model user (v8 on lkml)
  4. Streamline select_task_rq() & select_task_rq_fair() (v3 on lkml)
  5. Instrument sched domain flags (v2 on lkml)
  6. SCHED_DEADLINE capacity awareness (v3 on lkml)

Features in Linux mainline:

  1. v4.13 - CPU Invariant Engine (CIE)
  2. v4.15 - Frequency Invariant Engine (FIE)
  3. v4.17 - Idle CPU Per-Entity Load-Tracking (PELT) update
  4. v4.17 - Util(ization) Est(imated)
  5. v4.20 - Misfit task, i.e. forcing migration of running tasks that do not fit on the CPU they are currently running on
  6. v4.20 - Runtime scheduler domain flag detection
  7. v5.0   - Per-cpu Energy Model (EM) and Energy Aware Scheduling (EAS)
  8. v5.3   - Tracepoints (PELT and over-utilzation)
  9. v5.3   - Util(ization) clamping (core and per-task interface)
  10. v5.4   - Util(ization) clamping (cgroup interface)
  11. v5.4   - Patch-set 'sched/fair: Reduce complexity of energy calculation'
  12. v5.5   - Thermal/Cpu Cooling as Energy Model (EM) user
  13. v5.7   - Activity Monitor Unit (AMU) support

Platforms we test on:

  1. Arm Juno r0 (arm64)
  2. Arm Juno r2 (arm64)
  3. Hikey960 (arm64) (needs out-of-tree patches  (hikey960_mainline topic))
  4. DB845C (arm64) (needs out-of-tree patch (db845c_mainline topic))
  5. Arm TC2 (arm32)

Next work items:

  1. Pushing Features upstream
  2. 100% test pass rate on all platforms
  • Test Results (integration 20200526) 

    (1) juno-r0:

        testcase                                                                old%   new%  delta%       pvalue fix_iter#
        -------------------------------------------------------------------------------------------------------------------
        OneTaskCPUMigration:test_util_task_migration                           22.8% 100.0%   77.2%     9.60e-87         1

        test/eas_behaviour (LISA-test) in 0:07:44 [BAD]
            EnergyModelWakeMigration:test_slack:          passed    250/250 (100.0%)
            EnergyModelWakeMigration:test_task_placement: undecided 9/250   (3.6%)
            OneSmallTask:test_slack:                      passed    250/250 (100.0%)
            OneSmallTask:test_task_placement:             undecided 19/250  (7.6%)
            RampDown:test_slack:                          passed    250/250 (100.0%)
            RampDown:test_task_placement:                 undecided 1/250   (0.4%)
            RampUp:test_slack:                            passed    250/250 (100.0%)
            RampUp:test_task_placement:                   undecided 1/250   (0.4%)
            ThreeSmallTasks:test_slack:                   passed    250/250 (100.0%)
            ThreeSmallTasks:test_task_placement:          undecided 56/250  (22.4%)
            TwoBigTasks:test_slack:                       passed    250/250 (100.0%)
            TwoBigTasks:test_task_placement:              undecided 48/250  (19.2%)
            TwoBigTasks:test_task_placement:              FAILED    1/250   (0.4%)
            TwoBigThreeSmall:test_slack:                  passed    250/250 (100.0%)
            TwoBigThreeSmall:test_task_placement:         undecided 110/249 (44.2%)
            TwoBigThreeSmall:test_task_placement:         FAILED    1/249   (0.4%)

            Error: 0/14, Failed: 2/14, Undecided: 7/14, Skipped: 0/14, Passed: 7/14

        test/load_tracking (LISA-test) in 0:15:49 [BAD]
            Invariance:iter_invariance_items[cpu=0@450000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@450000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@450000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@450000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@575000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@575000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@575000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@575000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@700000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@700000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@700000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@700000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@775000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@775000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@775000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@775000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@850000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@850000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@850000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@850000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@450000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@450000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@450000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@450000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@625000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@625000]:test_load_correctness:  FAILED 10/250  (4.0%)
            Invariance:iter_invariance_items[cpu=1@625000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@625000]:test_util_correctness:  FAILED 10/250  (4.0%)
            Invariance:iter_invariance_items[cpu=1@800000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@800000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@800000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@800000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@950000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@950000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@950000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@950000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1100000]:test_load_behaviour:   passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1100000]:test_load_correctness: passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1100000]:test_util_behaviour:   passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1100000]:test_util_correctness: passed 250/250 (100.0%)
            Invariance:test_cpu_invariance:                                        passed 250/250 (100.0%)
            Invariance:test_freq_invariance:                                       passed 250/250 (100.0%)
            Invariance:test_load_behaviour:                                        passed 250/250 (100.0%)
            Invariance:test_load_correctness:                                      FAILED 10/250  (4.0%)
            Invariance:test_util_behaviour:                                        passed 250/250 (100.0%)
            Invariance:test_util_correctness:                                      FAILED 10/250  (4.0%)
            NTasksCPUMigration:test_util_task_migration:                           passed 250/250 (100.0%)
            OneTaskCPUMigration:test_util_task_migration:                          FAILED 250/250 (100.0%)
            TwoTasksCPUMigration:test_util_task_migration:                         passed 250/250 (100.0%)

            Error: 0/49, Failed: 5/49, Undecided: 0/49, Skipped: 0/49, Passed: 44/49

        test/misfit (LISA-test) in 0:02:03 [GOOD]
            StaggeredFinishes:test_preempt_time: passed 250/250 (100.0%)
            StaggeredFinishes:test_throughput:   passed 250/250 (100.0%)

            Error: 0/2, Failed: 0/2, Undecided: 0/2, Skipped: 0/2, Passed: 2/2

        test/util_tracking (LISA-test) in 0:02:23 [BAD]
            UtilConvergence:test_activations: FAILED 250/250 (100.0%)
            UtilConvergence:test_means:       FAILED 250/250 (100.0%)

            Error: 0/2, Failed: 2/2, Undecided: 0/2, Skipped: 0/2, Passed: 0/2

        test/other (LISA-test) in 0:04:13 [GOOD]
            CapacitySanity:test_capacity_sanity:     passed 250/250 (100.0%)
            UserspaceSanity:test_performance_sanity: passed 250/250 (100.0%)

            Error: 0/2, Failed: 0/2, Undecided: 0/2, Skipped: 0/2, Passed: 2/2

        test/hotplug (LISA-test) in 0:01:46 [GOOD]
            HotplugTorture:test_cpus_alive:   passed 250/250 (100.0%)
            HotplugTorture:test_target_alive: passed 250/250 (100.0%)

            Error: 0/2, Failed: 0/2, Undecided: 0/2, Skipped: 0/2, Passed: 2/2

    (2) juno-r2:

        testcase                                                                old%   new%  delta%       pvalue fix_iter#
        -------------------------------------------------------------------------------------------------------------------
        Invariance:iter_invariance_items[cpu=0@950000]:test_load_correctness    2.0%  25.6%   23.6%     7.64e-16        11
        Invariance:iter_invariance_items[cpu=0@950000]:test_util_correctness    1.6%  25.6%   24.0%     9.61e-17        11
        Invariance:test_load_correctness                                        6.8%  31.6%   24.8%     8.81e-13         9
        Invariance:test_util_correctness                                        5.2%  30.4%   25.2%     4.53e-14         9
        OneTaskCPUMigration:test_util_task_migration                            9.2%  99.6%   90.4%    5.74e-114         1
        TwoBigThreeSmall:test_task_placement                                   23.0%  34.5%   11.5%     2.29e-02        51

        test/eas_behaviour (LISA-test) in 0:07:35 [BAD]
            EnergyModelWakeMigration:test_slack:          passed    250/250 (100.0%)
            EnergyModelWakeMigration:test_task_placement: undecided 1/250   (0.4%)
            OneSmallTask:test_slack:                      passed    250/250 (100.0%)
            OneSmallTask:test_task_placement:             undecided 11/250  (4.4%)
            RampDown:test_slack:                          passed    250/250 (100.0%)
            RampDown:test_task_placement:                 passed    250/250 (100.0%)
            RampUp:test_slack:                            passed    250/250 (100.0%)
            RampUp:test_task_placement:                   undecided 1/250   (0.4%)
            ThreeSmallTasks:test_slack:                   passed    250/250 (100.0%)
            ThreeSmallTasks:test_task_placement:          undecided 2/250   (0.8%)
            TwoBigTasks:test_slack:                       passed    250/250 (100.0%)
            TwoBigTasks:test_task_placement:              undecided 29/250  (11.6%)
            TwoBigThreeSmall:test_slack:                  passed    250/250 (100.0%)
            TwoBigThreeSmall:test_task_placement:         undecided 81/249  (32.5%)
            TwoBigThreeSmall:test_task_placement:         FAILED    58/249  (23.3%)

            Error: 0/14, Failed: 1/14, Undecided: 6/14, Skipped: 0/14, Passed: 8/14

        test/load_tracking (LISA-test) in 0:11:16 [BAD]
            Invariance:iter_invariance_items[cpu=0@450000]:test_load_behaviour:    undecided 15/250  (6.0%)
            Invariance:iter_invariance_items[cpu=0@450000]:test_load_correctness:  FAILED    1/250   (0.4%)
            Invariance:iter_invariance_items[cpu=0@450000]:test_util_behaviour:    undecided 15/250  (6.0%)
            Invariance:iter_invariance_items[cpu=0@450000]:test_util_correctness:  passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@800000]:test_load_behaviour:    passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@800000]:test_load_correctness:  FAILED    3/250   (1.2%)
            Invariance:iter_invariance_items[cpu=0@800000]:test_util_behaviour:    passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@800000]:test_util_correctness:  passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@950000]:test_load_behaviour:    passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@950000]:test_load_correctness:  FAILED    64/250  (25.6%)
            Invariance:iter_invariance_items[cpu=0@950000]:test_util_behaviour:    passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@950000]:test_util_correctness:  FAILED    64/250  (25.6%)
            Invariance:iter_invariance_items[cpu=1@600000]:test_load_behaviour:    passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@600000]:test_load_correctness:  FAILED    18/250  (7.2%)
            Invariance:iter_invariance_items[cpu=1@600000]:test_util_behaviour:    passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@600000]:test_util_correctness:  FAILED    18/250  (7.2%)
            Invariance:iter_invariance_items[cpu=1@1000000]:test_load_behaviour:   passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1000000]:test_load_correctness: passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1000000]:test_util_behaviour:   passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1000000]:test_util_correctness: passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1200000]:test_load_behaviour:   passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1200000]:test_load_correctness: passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1200000]:test_util_behaviour:   passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1200000]:test_util_correctness: passed    250/250 (100.0%)
            Invariance:test_cpu_invariance:                                        passed    250/250 (100.0%)
            Invariance:test_freq_invariance:                                       passed    250/250 (100.0%)
            Invariance:test_load_behaviour:                                        passed    250/250 (100.0%)
            Invariance:test_load_correctness:                                      FAILED    79/250  (31.6%)
            Invariance:test_util_behaviour:                                        passed    250/250 (100.0%)
            Invariance:test_util_correctness:                                      FAILED    76/250  (30.4%)
            NTasksCPUMigration:test_util_task_migration:                           passed    250/250 (100.0%)
            OneTaskCPUMigration:test_util_task_migration:                          FAILED    249/250 (99.6%)
            TwoTasksCPUMigration:test_util_task_migration:                         passed    250/250 (100.0%)

            Error: 0/33, Failed: 9/33, Undecided: 2/33, Skipped: 0/33, Passed: 22/33

        test/misfit (LISA-test) in 0:02:04 [GOOD]
            StaggeredFinishes:test_preempt_time: passed    250/250 (100.0%)
            StaggeredFinishes:test_throughput:   undecided 11/250  (4.4%)

            Error: 0/2, Failed: 0/2, Undecided: 1/2, Skipped: 0/2, Passed: 1/2

        test/util_tracking (LISA-test) in 0:02:24 [BAD]
            UtilConvergence:test_activations: FAILED 250/250 (100.0%)
            UtilConvergence:test_means:       FAILED 250/250 (100.0%)


            Error: 0/2, Failed: 2/2, Undecided: 0/2, Skipped: 0/2, Passed: 0/2

        test/other (LISA-test) in 0:03:27 [GOOD]
            CapacitySanity:test_capacity_sanity:     passed 250/250 (100.0%)
            UserspaceSanity:test_performance_sanity: passed 250/250 (100.0%)

            Error: 0/2, Failed: 0/2, Undecided: 0/2, Skipped: 0/2, Passed: 2/2

        test/hotplug (LISA-test) in 0:01:49 [GOOD]
            HotplugTorture:test_cpus_alive:   passed 250/250 (100.0%)
            HotplugTorture:test_target_alive: passed 250/250 (100.0%)

            Error: 0/2, Failed: 0/2, Undecided: 0/2, Skipped: 0/2, Passed: 2/2

    (3) hikey960:

        testcase                                                                old%   new%  delta%       pvalue fix_iter#
        -------------------------------------------------------------------------------------------------------------------
        Invariance:iter_invariance_items[cpu=0@1709000]:test_load_correctness   0.8%   4.8%    4.0%     1.18e-02        66
        Invariance:iter_invariance_items[cpu=0@1709000]:test_util_correctness   0.8%   4.8%    4.0%     1.18e-02        66
        Invariance:test_load_correctness                                        2.0%   5.2%    3.2%     5.86e-02       129
        NTasksCPUMigration:test_util_task_migration                             1.6%   0.0%   -1.6%     6.13e-02

        test/eas_behaviour (LISA-test) in 0:08:51 [GOOD]
            EnergyModelWakeMigration:test_slack:          passed 250/250 (100.0%)
            EnergyModelWakeMigration:test_task_placement: passed 250/250 (100.0%)
            OneSmallTask:test_slack:                      passed 250/250 (100.0%)
            OneSmallTask:test_task_placement:             passed 250/250 (100.0%)
            RampDown:test_slack:                          passed 250/250 (100.0%)
            RampDown:test_task_placement:                 passed 250/250 (100.0%)
            RampUp:test_slack:                            passed 250/250 (100.0%)
            RampUp:test_task_placement:                   passed 250/250 (100.0%)
            ThreeSmallTasks:test_slack:                   passed 250/250 (100.0%)
            ThreeSmallTasks:test_task_placement:          passed 250/250 (100.0%)
            TwoBigTasks:test_slack:                       passed 250/250 (100.0%)
            TwoBigTasks:test_task_placement:              passed 250/250 (100.0%)
            TwoBigThreeSmall:test_slack:                  passed 250/250 (100.0%)
            TwoBigThreeSmall:test_task_placement:         passed 250/250 (100.0%)

            Error: 0/14, Failed: 0/14, Undecided: 0/14, Skipped: 0/14, Passed: 14/14

        test/load_tracking (LISA-test) in 0:18:01 [BAD]
            Invariance:iter_invariance_items[cpu=0@533000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@533000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@533000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@533000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@999000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@999000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@999000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@999000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1402000]:test_load_behaviour:   passed 249/249 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1402000]:test_load_correctness: passed 249/249 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1402000]:test_util_behaviour:   passed 249/249 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1402000]:test_util_correctness: passed 249/249 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1709000]:test_load_behaviour:   passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1709000]:test_load_correctness: FAILED 12/250  (4.8%)
            Invariance:iter_invariance_items[cpu=0@1709000]:test_util_behaviour:   passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1709000]:test_util_correctness: FAILED 12/250  (4.8%)
            Invariance:iter_invariance_items[cpu=0@1844000]:test_load_behaviour:   passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1844000]:test_load_correctness: FAILED 1/250   (0.4%)
            Invariance:iter_invariance_items[cpu=0@1844000]:test_util_behaviour:   passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1844000]:test_util_correctness: FAILED 1/250   (0.4%)
            Invariance:iter_invariance_items[cpu=4@903000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@903000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@903000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@903000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@1421000]:test_load_behaviour:   passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@1421000]:test_load_correctness: passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@1421000]:test_util_behaviour:   passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@1421000]:test_util_correctness: passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@1805000]:test_load_behaviour:   passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@1805000]:test_load_correctness: passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@1805000]:test_util_behaviour:   passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@1805000]:test_util_correctness: passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@2112000]:test_load_behaviour:   passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@2112000]:test_load_correctness: passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@2112000]:test_util_behaviour:   passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@2112000]:test_util_correctness: passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@2362000]:test_load_behaviour:   passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@2362000]:test_load_correctness: passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@2362000]:test_util_behaviour:   passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@2362000]:test_util_correctness: passed 250/250 (100.0%)
            Invariance:test_cpu_invariance:                                        passed 250/250 (100.0%)
            Invariance:test_freq_invariance:                                       passed 249/249 (100.0%)
            Invariance:test_load_behaviour:                                        passed 249/249 (100.0%)
            Invariance:test_load_correctness:                                      FAILED 13/249  (5.2%)
            Invariance:test_util_behaviour:                                        passed 249/249 (100.0%)
            Invariance:test_util_correctness:                                      FAILED 13/249  (5.2%)
            NTasksCPUMigration:test_util_task_migration:                           passed 250/250 (100.0%)
            OneTaskCPUMigration:test_util_task_migration:                          FAILED 73/250  (29.2%)
            TwoTasksCPUMigration:test_util_task_migration:                         passed 250/250 (100.0%)

            Error: 0/49, Failed: 7/49, Undecided: 0/49, Skipped: 0/49, Passed: 42/49

        test/misfit (LISA-test) in 0:02:39 [BAD]
            StaggeredFinishes:test_preempt_time: passed 250/250 (100.0%)
            StaggeredFinishes:test_throughput:   FAILED 2/250   (0.8%)

            Error: 0/2, Failed: 1/2, Undecided: 0/2, Skipped: 0/2, Passed: 1/2

        test/util_tracking (LISA-test) in 0:02:57 [BAD]
            UtilConvergence:test_activations: FAILED 250/250 (100.0%)
            UtilConvergence:test_means:       FAILED 250/250 (100.0%)

            Error: 0/2, Failed: 2/2, Undecided: 0/2, Skipped: 0/2, Passed: 0/2

        test/other (LISA-test) in 0:05:46 [GOOD]
            CapacitySanity:test_capacity_sanity:     passed 250/250 (100.0%)
            UserspaceSanity:test_performance_sanity: passed 250/250 (100.0%)

            Error: 0/2, Failed: 0/2, Undecided: 0/2, Skipped: 0/2, Passed: 2/2

    (4) TC2:

        testcase                                                                old%   new%  delta%       pvalue fix_iter#
        -------------------------------------------------------------------------------------------------------------------

        test/eas_behaviour (LISA-test) in 0:08:05 [BAD]
            EnergyModelWakeMigration:test_slack:          passed 250/250 (100.0%)
            EnergyModelWakeMigration:test_task_placement: passed 250/250 (100.0%)
            OneSmallTask:test_slack:                      passed 250/250 (100.0%)
            OneSmallTask:test_task_placement:             passed 250/250 (100.0%)
            RampDown:test_slack:                          passed 250/250 (100.0%)
            RampDown:test_task_placement:                 passed 250/250 (100.0%)
            RampUp:test_slack:                            passed 250/250 (100.0%)
            RampUp:test_task_placement:                   passed 250/250 (100.0%)
            ThreeSmallTasks:test_slack:                   passed 250/250 (100.0%)
            ThreeSmallTasks:test_task_placement:          passed 250/250 (100.0%)
            TwoBigTasks:test_slack:                       passed 250/250 (100.0%)
            TwoBigTasks:test_task_placement:              passed 250/250 (100.0%)
            TwoBigThreeSmall:test_slack:                  passed 250/250 (100.0%)
            TwoBigThreeSmall:test_task_placement:         FAILED 3/250   (1.2%)

            Error: 0/14, Failed: 1/14, Undecided: 0/14, Skipped: 0/14, Passed: 13/14

        test/load_tracking (LISA-test) in 0:25:46 [GOOD]
            Invariance:iter_invariance_items[cpu=0@350000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@350000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@350000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@350000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@400000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@400000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@400000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@400000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@500000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@500000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@500000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@500000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@600000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@600000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@600000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@600000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@700000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@700000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@700000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@700000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@800000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@800000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@800000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@800000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@900000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@900000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@900000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@900000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1000000]:test_load_behaviour:   passed 247/247 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1000000]:test_load_correctness: passed 247/247 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1000000]:test_util_behaviour:   passed 247/247 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1000000]:test_util_correctness: passed 247/247 (100.0%)
            Invariance:iter_invariance_items[cpu=1@500000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@500000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@500000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@500000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@600000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@600000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@600000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@600000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@700000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@700000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@700000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@700000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@800000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@800000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@800000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@800000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@900000]:test_load_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@900000]:test_load_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@900000]:test_util_behaviour:    passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@900000]:test_util_correctness:  passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1000000]:test_load_behaviour:   passed 249/249 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1000000]:test_load_correctness: passed 249/249 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1000000]:test_util_behaviour:   passed 249/249 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1000000]:test_util_correctness: passed 249/249 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1100000]:test_load_behaviour:   passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1100000]:test_load_correctness: passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1100000]:test_util_behaviour:   passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1100000]:test_util_correctness: passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1200000]:test_load_behaviour:   passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1200000]:test_load_correctness: passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1200000]:test_util_behaviour:   passed 250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=1@1200000]:test_util_correctness: passed 250/250 (100.0%)
            Invariance:test_cpu_invariance:                                        passed 247/247 (100.0%)
            Invariance:test_freq_invariance:                                       passed 246/246 (100.0%)
            Invariance:test_load_behaviour:                                        passed 246/246 (100.0%)
            Invariance:test_load_correctness:                                      passed 246/246 (100.0%)
            Invariance:test_util_behaviour:                                        passed 246/246 (100.0%)
            Invariance:test_util_correctness:                                      passed 246/246 (100.0%)
            NTasksCPUMigration:test_util_task_migration:                           passed 250/250 (100.0%)
            OneTaskCPUMigration:test_util_task_migration:                          passed 250/250 (100.0%)
            TwoTasksCPUMigration:test_util_task_migration:                         passed 250/250 (100.0%)

            Error: 0/73, Failed: 0/73, Undecided: 0/73, Skipped: 0/73, Passed: 73/73

        test/misfit (LISA-test) in 0:02:07 [BAD]
            StaggeredFinishes:test_preempt_time: passed 250/250 (100.0%)
            StaggeredFinishes:test_throughput:   FAILED 14/250  (5.6%)

            Error: 0/2, Failed: 1/2, Undecided: 0/2, Skipped: 0/2, Passed: 1/2

        test/util_tracking (LISA-test) in 0:02:25 [BAD]
            UtilConvergence:test_activations: FAILED 250/250 (100.0%)
            UtilConvergence:test_means:       FAILED 250/250 (100.0%)

            Error: 0/2, Failed: 2/2, Undecided: 0/2, Skipped: 0/2, Passed: 0/2

        test/other (LISA-test) in 0:05:40 [GOOD]
            CapacitySanity:test_capacity_sanity:     passed 250/250 (100.0%)
            UserspaceSanity:test_performance_sanity: passed 250/250 (100.0%)

            Error: 0/2, Failed: 0/2, Undecided: 0/2, Skipped: 0/2, Passed: 2/2

    (5) db845c:

        testcase                                                                old%   new%  delta%       pvalue fix_iter#
        -------------------------------------------------------------------------------------------------------------------
        Invariance:iter_invariance_items[cpu=0@1324800]:test_load_correctness  19.5%  12.0%   -7.5%     2.48e-02
        Invariance:iter_invariance_items[cpu=0@1324800]:test_util_correctness  19.5%  11.2%   -8.3%     1.17e-02
        Invariance:iter_invariance_items[cpu=0@1766400]:test_load_correctness   3.8%   0.8%   -3.0%     3.21e-02
        Invariance:iter_invariance_items[cpu=0@1766400]:test_util_correctness   3.8%   0.8%   -3.0%     3.21e-02
        Invariance:iter_invariance_items[cpu=0@300000]:test_load_correctness    2.1%   0.0%   -2.1%     2.64e-02
        Invariance:iter_invariance_items[cpu=4@2649600]:test_load_behaviour     9.7%   0.0%   -9.7%     7.01e-08
        Invariance:iter_invariance_items[cpu=4@2649600]:test_util_behaviour    10.2%   0.0%  -10.2%     3.22e-08
        Invariance:test_cpu_invariance                                          9.7%   0.0%   -9.7%     3.41e-08
        Invariance:test_load_behaviour                                         10.2%   0.0%  -10.2%     1.48e-08
        Invariance:test_util_behaviour                                         10.6%   0.0%  -10.6%     6.79e-09

        test/eas_behaviour (LISA-test) in 0:09:13 [GOOD]
            EnergyModelWakeMigration:test_slack:          passed    250/250 (100.0%)
            EnergyModelWakeMigration:test_task_placement: undecided 3/250   (1.2%)
            OneSmallTask:test_slack:                      passed    250/250 (100.0%)
            OneSmallTask:test_task_placement:             passed    250/250 (100.0%)
            RampDown:test_slack:                          passed    250/250 (100.0%)
            RampDown:test_task_placement:                 undecided 52/250  (20.8%)
            RampUp:test_slack:                            passed    250/250 (100.0%)
            RampUp:test_task_placement:                   undecided 24/250  (9.6%)
            ThreeSmallTasks:test_slack:                   passed    250/250 (100.0%)
            ThreeSmallTasks:test_task_placement:          passed    250/250 (100.0%)
            TwoBigTasks:test_slack:                       passed    250/250 (100.0%)
            TwoBigTasks:test_task_placement:              undecided 177/250 (70.8%)
            TwoBigThreeSmall:test_slack:                  passed    250/250 (100.0%)
            TwoBigThreeSmall:test_task_placement:         passed    250/250 (100.0%)

            Error: 0/14, Failed: 0/14, Undecided: 4/14, Skipped: 0/14, Passed: 10/14

        test/load_tracking (LISA-test) in 0:29:24 [BAD]
            Invariance:iter_invariance_items[cpu=0@300000]:test_load_behaviour:    undecided 5/250   (2.0%)
            Invariance:iter_invariance_items[cpu=0@300000]:test_load_correctness:  passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@300000]:test_util_behaviour:    undecided 5/250   (2.0%)
            Invariance:iter_invariance_items[cpu=0@300000]:test_util_correctness:  passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@576000]:test_load_behaviour:    passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@576000]:test_load_correctness:  FAILED    76/250  (30.4%)
            Invariance:iter_invariance_items[cpu=0@576000]:test_util_behaviour:    passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@576000]:test_util_correctness:  FAILED    78/250  (31.2%)
            Invariance:iter_invariance_items[cpu=0@825600]:test_load_behaviour:    passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@825600]:test_load_correctness:  passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@825600]:test_util_behaviour:    passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@825600]:test_util_correctness:  passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1056000]:test_load_behaviour:   passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1056000]:test_load_correctness: FAILED    3/250   (1.2%)
            Invariance:iter_invariance_items[cpu=0@1056000]:test_util_behaviour:   passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1056000]:test_util_correctness: FAILED    3/250   (1.2%)
            Invariance:iter_invariance_items[cpu=0@1324800]:test_load_behaviour:   passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1324800]:test_load_correctness: FAILED    30/250  (12.0%)
            Invariance:iter_invariance_items[cpu=0@1324800]:test_util_behaviour:   passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1324800]:test_util_correctness: FAILED    28/250  (11.2%)
            Invariance:iter_invariance_items[cpu=0@1516800]:test_load_behaviour:   passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1516800]:test_load_correctness: FAILED    5/250   (2.0%)
            Invariance:iter_invariance_items[cpu=0@1516800]:test_util_behaviour:   passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1516800]:test_util_correctness: FAILED    5/250   (2.0%)
            Invariance:iter_invariance_items[cpu=0@1689600]:test_load_behaviour:   passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1689600]:test_load_correctness: FAILED    8/250   (3.2%)
            Invariance:iter_invariance_items[cpu=0@1689600]:test_util_behaviour:   passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1689600]:test_util_correctness: FAILED    8/250   (3.2%)
            Invariance:iter_invariance_items[cpu=0@1766400]:test_load_behaviour:   passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1766400]:test_load_correctness: FAILED    2/250   (0.8%)
            Invariance:iter_invariance_items[cpu=0@1766400]:test_util_behaviour:   passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=0@1766400]:test_util_correctness: FAILED    2/250   (0.8%)
            Invariance:iter_invariance_items[cpu=4@825600]:test_load_behaviour:    undecided 10/250  (4.0%)
            Invariance:iter_invariance_items[cpu=4@825600]:test_load_correctness:  passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@825600]:test_util_behaviour:    undecided 10/250  (4.0%)
            Invariance:iter_invariance_items[cpu=4@825600]:test_util_correctness:  passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@1056000]:test_load_behaviour:   undecided 11/250  (4.4%)
            Invariance:iter_invariance_items[cpu=4@1056000]:test_load_correctness: passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@1056000]:test_util_behaviour:   undecided 11/250  (4.4%)
            Invariance:iter_invariance_items[cpu=4@1056000]:test_util_correctness: passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@1459200]:test_load_behaviour:   undecided 12/250  (4.8%)
            Invariance:iter_invariance_items[cpu=4@1459200]:test_load_correctness: passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@1459200]:test_util_behaviour:   undecided 12/250  (4.8%)
            Invariance:iter_invariance_items[cpu=4@1459200]:test_util_correctness: passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@1766400]:test_load_behaviour:   undecided 10/250  (4.0%)
            Invariance:iter_invariance_items[cpu=4@1766400]:test_load_correctness: passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@1766400]:test_util_behaviour:   undecided 10/250  (4.0%)
            Invariance:iter_invariance_items[cpu=4@1766400]:test_util_correctness: passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@1996800]:test_load_behaviour:   undecided 9/250   (3.6%)
            Invariance:iter_invariance_items[cpu=4@1996800]:test_load_correctness: passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@1996800]:test_util_behaviour:   undecided 9/250   (3.6%)
            Invariance:iter_invariance_items[cpu=4@1996800]:test_util_correctness: passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@2323200]:test_load_behaviour:   undecided 8/250   (3.2%)
            Invariance:iter_invariance_items[cpu=4@2323200]:test_load_correctness: passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@2323200]:test_util_behaviour:   undecided 8/250   (3.2%)
            Invariance:iter_invariance_items[cpu=4@2323200]:test_util_correctness: passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@2553600]:test_load_behaviour:   undecided 11/250  (4.4%)
            Invariance:iter_invariance_items[cpu=4@2553600]:test_load_correctness: passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@2553600]:test_util_behaviour:   undecided 11/250  (4.4%)
            Invariance:iter_invariance_items[cpu=4@2553600]:test_util_correctness: passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@2649600]:test_load_behaviour:   undecided 10/250  (4.0%)
            Invariance:iter_invariance_items[cpu=4@2649600]:test_load_correctness: passed    250/250 (100.0%)
            Invariance:iter_invariance_items[cpu=4@2649600]:test_util_behaviour:   undecided 10/250  (4.0%)
            Invariance:iter_invariance_items[cpu=4@2649600]:test_util_correctness: passed    250/250 (100.0%)
            Invariance:test_cpu_invariance:                                        passed    250/250 (100.0%)
            Invariance:test_freq_invariance:                                       passed    250/250 (100.0%)
            Invariance:test_load_behaviour:                                        passed    250/250 (100.0%)
            Invariance:test_load_correctness:                                      FAILED    113/250 (45.2%)
            Invariance:test_util_behaviour:                                        passed    250/250 (100.0%)
            Invariance:test_util_correctness:                                      FAILED    112/250 (44.8%)
            NTasksCPUMigration:test_util_task_migration:                           passed    250/250 (100.0%)
            OneTaskCPUMigration:test_util_task_migration:                          FAILED    194/250 (77.6%)
            TwoTasksCPUMigration:test_util_task_migration:                         passed    250/250 (100.0%)

            Error: 0/73, Failed: 15/73, Undecided: 18/73, Skipped: 0/73, Passed: 40/73

        test/misfit (LISA-test) in 0:02:42 [GOOD]
            StaggeredFinishes:test_preempt_time: passed    250/250 (100.0%)
            StaggeredFinishes:test_throughput:   undecided 199/250 (79.6%)

            Error: 0/2, Failed: 0/2, Undecided: 1/2, Skipped: 0/2, Passed: 1/2

        test/util_tracking (LISA-test) in 0:03:02 [BAD]
            UtilConvergence:test_activations: FAILED 2/244   (0.8%)
            UtilConvergence:test_means:       FAILED 250/250 (100.0%)

            Error: 0/2, Failed: 2/2, Undecided: 0/2, Skipped: 0/2, Passed: 0/2

        test/other (LISA-test) in 0:06:07 [BAD]
            CapacitySanity:test_capacity_sanity:     passed 250/250 (100.0%)
            UserspaceSanity:test_performance_sanity: FAILED 17/250  (6.8%)

            Error: 0/2, Failed: 1/2, Undecided: 0/2, Skipped: 0/2, Passed: 1/2

        test/hotplug (LISA-test) in 0:02:23 [GOOD]
            HotplugTorture:test_cpus_alive:   passed 250/250 (100.0%)
            HotplugTorture:test_target_alive: passed 250/250 (100.0%)

            Error: 0/2, Failed: 0/2, Undecided: 0/2, Skipped: 0/2, Passed: 2/2