Re: Conflicting cross-version suffixes in: org.scalatest:scalatest, com.twitter:chill, org.apache.spark:spark-unsafe, org.apache.spark:spark-tags

[Valentin Kulichenko]

+dev list

Igniters,

I'm looking at this and it seems to be a bug. We have this dependency in
spark-2.10 module POM:

<dependency>
    <groupId>org.json4s</groupId>
    <artifactId>json4s-core_2.11</artifactId>
    <version>3.5.0</version>
</dependency>

Would replacing it with json4s-core_2.10 be enough to fix?

-Val

On Thu, Oct 5, 2017 at 5:16 PM, manuelmourato <[hidden email]>
wrote:

> Hey,
>  I tried using  vkulichenko approach with scala 2.10 dependencies:
>
> name := "App"
>
> version := "1.0"
>
> scalaVersion := "2.10.6"
>
>
> libraryDependencies += "org.apache.spark" % "spark-core_2.10" % "2.2.0" %
> "provided"
> libraryDependencies += "org.apache.spark" % "spark-streaming_2.10" %
> "2.2.0"
> % "provided"
> libraryDependencies += "org.apache.spark" % "spark-sql_2.10" % "2.2.0" %
> "provided"
> libraryDependencies += "org.apache.spark" % "spark-mllib_2.10" % "2.2.0" %
> "provided"
> libraryDependencies += "org.xerial.snappy" % "snappy-java" % "1.1.4"
> libraryDependencies += "org.apache.spark" % "spark-streaming-kafka-0-8_2.
> 10"
> % "2.2.0" % "provided"
> libraryDependencies += "org.apache.ignite" % "ignite-spark_2.10" % "2.2.0"
> libraryDependencies += "org.apache.ignite" % "ignite-spring" % "2.2.0"
>
> But I still got a cross-version suffixes error, this time for the following
> dependencies:
>
> [error]    org.json4s:json4s-ast _2.10, _2.11
> [error]    org.json4s:json4s-core _2.10, _2.11
> java.lang.RuntimeException: Conflicting cross-version suffixes in:
> org.json4s:json4s-ast, org.json4s:json4s-core
>
> Any ideas on how to solve this?
>
> -ManuelMourato
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>

[dmagda]

Nikolay I. please chime in as the one who actively works with Ignite Spark integration.

—
Denis

> On Oct 5, 2017, at 5:47 PM, Valentin Kulichenko <[hidden email]> wrote:
>
> +dev list
>
> Igniters,
>
> I'm looking at this and it seems to be a bug. We have this dependency in spark-2.10 module POM:
>
> <dependency>
>     <groupId>org.json4s</groupId>
>     <artifactId>json4s-core_2.11</artifactId>
>     <version>3.5.0</version>
> </dependency>
>
> Would replacing it with json4s-core_2.10 be enough to fix?
>
> -Val
>
> On Thu, Oct 5, 2017 at 5:16 PM, manuelmourato <[hidden email] <mailto:[hidden email]>> wrote:
> Hey,
>  I tried using  vkulichenko approach with scala 2.10 dependencies:
>
> name := "App"
>
> version := "1.0"
>
> scalaVersion := "2.10.6"
>
>
> libraryDependencies += "org.apache.spark" % "spark-core_2.10" % "2.2.0" %
> "provided"
> libraryDependencies += "org.apache.spark" % "spark-streaming_2.10" % "2.2.0"
> % "provided"
> libraryDependencies += "org.apache.spark" % "spark-sql_2.10" % "2.2.0" %
> "provided"
> libraryDependencies += "org.apache.spark" % "spark-mllib_2.10" % "2.2.0" %
> "provided"
> libraryDependencies += "org.xerial.snappy" % "snappy-java" % "1.1.4"
> libraryDependencies += "org.apache.spark" % "spark-streaming-kafka-0-8_2.10"
> % "2.2.0" % "provided"
> libraryDependencies += "org.apache.ignite" % "ignite-spark_2.10" % "2.2.0"
> libraryDependencies += "org.apache.ignite" % "ignite-spring" % "2.2.0"
>
> But I still got a cross-version suffixes error, this time for the following
> dependencies:
>
> [error]    org.json4s:json4s-ast _2.10, _2.11
> [error]    org.json4s:json4s-core _2.10, _2.11
> java.lang.RuntimeException: Conflicting cross-version suffixes in:
> org.json4s:json4s-ast, org.json4s:json4s-core
>
> Any ideas on how to solve this?
>
> -ManuelMourato
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/ <http://apache-ignite-users.70518.x6.nabble.com/>
>

[Denis Mekhanikov]

Igniters,

I noticed a problem in POM files of *ignite-spark* and *ignite-spark_2.10*
 modules.

*ignite-spark* is targeted to be used by Scala 2.11, while
*ignite-spark_2.10* is made for Scala 2.10.
*But, **ignite-spark* has *spark-unsafe_2.10* as a dependency, and
*ignite-spark_2.10* depends on *json4s-core_2.11*.
It results in that when you add *ignite-spark *module as a dependency to
your SBT project, it stops compiling with the following error:
Modules were resolved with conflicting cross-version suffixes

Nikolay Izhikov, Valentin Kulichenko, can you comment on this? Is it some
kind of a hack, or these dependencies are just specified by mistake?
There is a ticket for this issue:
https://issues.apache.org/jira/browse/IGNITE-6369

Denis

пт, 6 окт. 2017 г. в 16:44, manuelmourato <[hidden email]>:

> Hi, thank you for taking an interest in this bug.
> I managed to compile my project successfully by taking Val's suggestion,
> changing this:
>
> <dependency>
>     <groupId>org.json4s</groupId>
>     <artifactId>json4s-core_2.10</artifactId>
>     <version>3.5.0</version>
> </dependency>
>
> I noticed that I couldn't compile using ignite version 2.3, I had to
> downgrade to 2.2, otherwise this error would show up:
>
> [ERROR] Failed to execute goal on project ignite-spark_2.10: Could not
> resolve dependencies for project
> org.apache.ignite:ignite-spark_2.10:jar:2.3.0-SNAPSHOT: The following
> artifacts could not be resolved:
> org.apache.ignite:ignite-core:jar:2.3.0-SNAPSHOT,
> org.apache.ignite:ignite-core:jar:tests:2.3.0-SNAPSHOT,
> org.apache.ignite:ignite-indexing:jar:2.3.0-SNAPSHOT: Could not find
> artifact org.apache.ignite:ignite-core:jar:2.3.0-SNAPSHOT in
> h2database.com
> (http://h2database.com/m2-repo) -> [Help 1]
>
> Maybe it's worth taking a look.
> Cheers.
>
> --ManuelMourato
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>

[Nikolay Izhikov]

Hello, Denis.

I know about this issue.
I can try to fix it.

But, seems that ticket assigned to you, currently.
Let me know if you need some kind of help.



2017-11-08 18:17 GMT+03:00 Николай Ижиков <[hidden email]>:

> Привет.
>
> Я знаю об этой проблеме. Натолкнулся на неё при реализации Spark DataFrame
> API для Ignite.
> Могу попробовать починить, но баг сейчас на тебе и в In Progress.
>
> Ты его чинишь?
>
>
> 2017-11-08 17:49 GMT+03:00 Denis Mekhanikov <[hidden email]>:
>
>> Igniters,
>>
>> I noticed a problem in POM files of *ignite-spark* and *ignite-spark_2.10*
>>  modules.
>>
>> *ignite-spark* is targeted to be used by Scala 2.11, while
>> *ignite-spark_2.10* is made for Scala 2.10.
>> *But, **ignite-spark* has *spark-unsafe_2.10* as a dependency, and
>> *ignite-spark_2.10* depends on *json4s-core_2.11*.
>> It results in that when you add *ignite-spark *module as a dependency to
>> your SBT project, it stops compiling with the following error:
>> Modules were resolved with conflicting cross-version suffixes
>>
>> Nikolay Izhikov, Valentin Kulichenko, can you comment on this? Is it some
>> kind of a hack, or these dependencies are just specified by mistake?
>> There is a ticket for this issue:
>> https://issues.apache.org/jira/browse/IGNITE-6369
>>
>> Denis
>>
>> пт, 6 окт. 2017 г. в 16:44, manuelmourato <[hidden email]>:
>>
>> > Hi, thank you for taking an interest in this bug.
>> > I managed to compile my project successfully by taking Val's suggestion,
>> > changing this:
>> >
>> > <dependency>
>> >     <groupId>org.json4s</groupId>
>> >     <artifactId>json4s-core_2.10</artifactId>
>> >     <version>3.5.0</version>
>> > </dependency>
>> >
>> > I noticed that I couldn't compile using ignite version 2.3, I had to
>> > downgrade to 2.2, otherwise this error would show up:
>> >
>> > [ERROR] Failed to execute goal on project ignite-spark_2.10: Could not
>> > resolve dependencies for project
>> > org.apache.ignite:ignite-spark_2.10:jar:2.3.0-SNAPSHOT: The following
>> > artifacts could not be resolved:
>> > org.apache.ignite:ignite-core:jar:2.3.0-SNAPSHOT,
>> > org.apache.ignite:ignite-core:jar:tests:2.3.0-SNAPSHOT,
>> > org.apache.ignite:ignite-indexing:jar:2.3.0-SNAPSHOT: Could not find
>> > artifact org.apache.ignite:ignite-core:jar:2.3.0-SNAPSHOT in
>> > h2database.com
>> > (http://h2database.com/m2-repo) -> [Help 1]
>> >
>> > Maybe it's worth taking a look.
>> > Cheers.
>> >
>> > --ManuelMourato
>> >
>> >
>> >
>> > --
>> > Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>> >
>>
>
>
>
> --
> Nikolay Izhikov
> [hidden email]
>

--
Nikolay Izhikov
[hidden email]