Mass TC RunAll: 8th iteration

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Mass TC RunAll: 8th iteration

Dmitriy Pavlov
Hi Igniters,

I'm going to trigger mass run all to be executed during weekend. I hope you
don't mind.

I will trigger build 17:00 UTC, 20:00 MSK, 10:00 PST. Should you have
urgent PR to be checked, feel free to reorder it to top.

Sincerely,
Dmitriy Pavlov
Reply | Threaded
Open this post in threaded view
|

Re: Mass TC RunAll: 8th iteration

Dmitriy Pavlov
Hi Igniters,

I’m glad there is positive dynamic during last 3 weeks related to test
failures. Latest weekend mass run-all shows tests 427 failures, suites 24
critical failures (timeout/crash/exitcode/OOME). 3 weeks ago that metrics
were as follows: tests 512 and suites 41.

Please see below for a link to full report

https://cwiki.apache.org/confluence/pages/viewpageattachments.action?pageId=73631266

Thanks very much to Eduard Shangareev, Vitaliy Biryukov, Semen Boikov,
Pavel Kovalenko, Maxim Muzafarov, Alexey Stelmak, Alexey Goncharuk, Anton
Kalashnikov, Ivan Daschinskiy, Sergey Chugunov, Aleksey Plekhanov, Anton
Vinogradov, Mikhail Cherkasov, Amelchev Nikita, Denis Garus, Ivan Fedotov,
Ryabov Dmitrii for their contributions, all other contributors, who was
involved into fixing tests, and to everyone that helped with reviewing and
merging to master.

Sincerely,

Dmitriy Pavlov


пт, 3 авг. 2018 г. в 13:03, Dmitriy Pavlov <[hidden email]>:

> Hi Igniters,
>
> I'm going to trigger mass run all to be executed during weekend. I hope
> you don't mind.
>
> I will trigger build 17:00 UTC, 20:00 MSK, 10:00 PST. Should you have
> urgent PR to be checked, feel free to reorder it to top.
>
> Sincerely,
> Dmitriy Pavlov
>
Reply | Threaded
Open this post in threaded view
|

Re: Mass TC RunAll: 8th iteration

Dmitry Pavlov
Hi Igniters,

For a long time, I did not collect MTCGA reports because now we have a very
convenient statistics page for the Bot ( https://goo.gl/4Tj1mo ).

But today I've decided to check our progress since August. As always you
can find full test report from 30 latest runs here
https://cwiki.apache.org/confluence/pages/viewpageattachments.action?pageId=73631266



The current snapshot of the latest 30 run-all shows 1158 test failures,  29
suites critical failures (timeout/crash/exit code/OOME). Suites failures
have almost the same rate, while tests failures were doubled.

Sincerely,
Dmitriy Pavlov


пн, 6 авг. 2018 г. в 15:28, Dmitriy Pavlov <[hidden email]>:

> Hi Igniters,
>
> I’m glad there is positive dynamic during last 3 weeks related to test
> failures. Latest weekend mass run-all shows tests 427 failures, suites 24
> critical failures (timeout/crash/exitcode/OOME). 3 weeks ago that metrics
> were as follows: tests 512 and suites 41.
>
> Please see below for a link to full report
>
>
> https://cwiki.apache.org/confluence/pages/viewpageattachments.action?pageId=73631266
>
> Thanks very much to Eduard Shangareev, Vitaliy Biryukov, Semen Boikov,
> Pavel Kovalenko, Maxim Muzafarov, Alexey Stelmak, Alexey Goncharuk, Anton
> Kalashnikov, Ivan Daschinskiy, Sergey Chugunov, Aleksey Plekhanov, Anton
> Vinogradov, Mikhail Cherkasov, Amelchev Nikita, Denis Garus, Ivan Fedotov,
> Ryabov Dmitrii for their contributions, all other contributors, who was
> involved into fixing tests, and to everyone that helped with reviewing and
> merging to master.
>
> Sincerely,
>
> Dmitriy Pavlov
>
>
> пт, 3 авг. 2018 г. в 13:03, Dmitriy Pavlov <[hidden email]>:
>
>> Hi Igniters,
>>
>> I'm going to trigger mass run all to be executed during weekend. I hope
>> you don't mind.
>>
>> I will trigger build 17:00 UTC, 20:00 MSK, 10:00 PST. Should you have
>> urgent PR to be checked, feel free to reorder it to top.
>>
>> Sincerely,
>> Dmitriy Pavlov
>>
>