[jira] [Created] (IGNITE-9640) [TC Bot] Determine repetitive failure types by analyzing build log

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (IGNITE-9640) [TC Bot] Determine repetitive failure types by analyzing build log

Anton Vinogradov (Jira)
Andrey Kuznetsov created IGNITE-9640:
----------------------------------------

             Summary: [TC Bot] Determine repetitive failure types by analyzing build log
                 Key: IGNITE-9640
                 URL: https://issues.apache.org/jira/browse/IGNITE-9640
             Project: Ignite
          Issue Type: Task
            Reporter: Andrey Kuznetsov


When someone is analyzing flaky test failure, it's important to distinguish between newly created failure and pre-existing one. In the latter case, the bot should not attract contributor's attention to the test.

In more detail, TC build log fragments starts with identical substrings for identical failures very often, e.g.

{noformat}
junit.framework.AssertionFailedError
    at org.apache.ignite.internal.GridVersionSelfTest.testVersions(GridVersionSelfTest.java:54)
{noformat}




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)