hive not working with ignite igfs

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

hive not working with ignite igfs

pawanpawar
Hi all, when I try to run the hive cmd I got this error.

pawanpawar@cloud:~$ hive
Exception in thread "main" java.lang.RuntimeException: java.io.IOException: Failed to get file status [path=/tmp/hive]
        at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:444)
        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:672)
        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: java.io.IOException: Failed to get file status [path=/tmp/hive]
        at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsUtils.cast(HadoopIgfsUtils.java:132)
        at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:327)
        at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.info(HadoopIgfsWrapper.java:120)
        at org.apache.ignite.hadoop.fs.v1.IgniteHadoopFileSystem.getFileStatus(IgniteHadoopFileSystem.java:989)
        at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1400)
        at org.apache.hadoop.hive.ql.session.SessionState.createRootHDFSDir(SessionState.java:520)
        at org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:478)
        at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:430)
        ... 8 more
Caused by: class org.apache.ignite.IgniteCheckedException: Failed to get file status [path=/tmp/hive]
        at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7005)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:166)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc.info(HadoopIgfsOutProc.java:209)
        at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:123)
        at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:120)
        at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:310)
        ... 14 more
Caused by: class org.apache.ignite.igfs.IgfsException: Failed to get file status [path=/tmp/hive]
        at org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:294)
        at org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:303)
        at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:509)
        at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:503)
        at org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:54)
        at org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:28)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:262)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListeners(GridFutureAdapter.java:250)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:380)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:346)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:323)
        at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsIpcIo$ReaderThread.run(HadoopIgfsIpcIo.java:575)
Reply | Threaded
Open this post in threaded view
|

Re: hive not working with ignite igfs

Vladimir Ozerov
Hi,

Please provide your XML configuration and IGFS URI you use.

Vladimir.

On Thu, Mar 31, 2016 at 1:07 PM, pawanpawar <[hidden email]> wrote:

> Hi all, when I try to run the hive cmd I got this error.
>
> pawanpawar@cloud:~$ hive
> Exception in thread "main" java.lang.RuntimeException: java.io.IOException:
> Failed to get file status [path=/tmp/hive]
>         at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:444)
>         at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:672)
>         at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:497)
>         at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
>         at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
> Caused by: java.io.IOException: Failed to get file status [path=/tmp/hive]
>         at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsUtils.cast(HadoopIgfsUtils.java:132)
>         at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:327)
>         at
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.info
> (HadoopIgfsWrapper.java:120)
>         at
>
> org.apache.ignite.hadoop.fs.v1.IgniteHadoopFileSystem.getFileStatus(IgniteHadoopFileSystem.java:989)
>         at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1400)
>         at
>
> org.apache.hadoop.hive.ql.session.SessionState.createRootHDFSDir(SessionState.java:520)
>         at
>
> org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:478)
>         at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:430)
>         ... 8 more
> Caused by: class org.apache.ignite.IgniteCheckedException: Failed to get
> file status [path=/tmp/hive]
>         at
> org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7005)
>         at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:166)
>         at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
>         at
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc.info
> (HadoopIgfsOutProc.java:209)
>         at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:123)
>         at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:120)
>         at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:310)
>         ... 14 more
> Caused by: class org.apache.ignite.igfs.IgfsException: Failed to get file
> status [path=/tmp/hive]
>         at
>
> org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:294)
>         at
>
> org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:303)
>         at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:509)
>         at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:503)
>         at
>
> org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:54)
>         at
>
> org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:28)
>         at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:262)
>         at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListeners(GridFutureAdapter.java:250)
>         at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:380)
>         at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:346)
>         at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:323)
>         at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsIpcIo$ReaderThread.run(HadoopIgfsIpcIo.java:575)
>
>
>
>
> --
> View this message in context:
> http://apache-ignite-developers.2346864.n4.nabble.com/hive-not-working-with-ignite-igfs-tp8190.html
> Sent from the Apache Ignite Developers mailing list archive at Nabble.com.
>
Reply | Threaded
Open this post in threaded view
|

Re: hive not working with ignite igfs

pawanpawar
Thanks for your reply I am sending my all conf files, please check attachment, I am using igfs://igfs@192.168.1.5:10500

On Fri, Apr 1, 2016 at 12:06 PM, Vladimir Ozerov <[hidden email]> wrote:
Hi,

Please provide your XML configuration and IGFS URI you use.

Vladimir.

On Thu, Mar 31, 2016 at 1:07 PM, pawanpawar <[hidden email]> wrote:

> Hi all, when I try to run the hive cmd I got this error.
>
> pawanpawar@cloud:~$ hive
> Exception in thread "main" java.lang.RuntimeException: java.io.IOException:
> Failed to get file status [path=/tmp/hive]
>         at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:444)
>         at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:672)
>         at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:497)
>         at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
>         at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
> Caused by: java.io.IOException: Failed to get file status [path=/tmp/hive]
>         at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsUtils.cast(HadoopIgfsUtils.java:132)
>         at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:327)
>         at
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.info
> (HadoopIgfsWrapper.java:120)
>         at
>
> org.apache.ignite.hadoop.fs.v1.IgniteHadoopFileSystem.getFileStatus(IgniteHadoopFileSystem.java:989)
>         at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1400)
>         at
>
> org.apache.hadoop.hive.ql.session.SessionState.createRootHDFSDir(SessionState.java:520)
>         at
>
> org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:478)
>         at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:430)
>         ... 8 more
> Caused by: class org.apache.ignite.IgniteCheckedException: Failed to get
> file status [path=/tmp/hive]
>         at
> org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7005)
>         at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:166)
>         at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
>         at
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc.info
> (HadoopIgfsOutProc.java:209)
>         at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:123)
>         at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:120)
>         at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:310)
>         ... 14 more
> Caused by: class org.apache.ignite.igfs.IgfsException: Failed to get file
> status [path=/tmp/hive]
>         at
>
> org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:294)
>         at
>
> org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:303)
>         at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:509)
>         at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:503)
>         at
>
> org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:54)
>         at
>
> org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:28)
>         at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:262)
>         at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListeners(GridFutureAdapter.java:250)
>         at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:380)
>         at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:346)
>         at
>
> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:323)
>         at
>
> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsIpcIo$ReaderThread.run(HadoopIgfsIpcIo.java:575)
>
>
>
>
> --
> View this message in context:
> http://apache-ignite-developers.2346864.n4.nabble.com/hive-not-working-with-ignite-igfs-tp8190.html
> Sent from the Apache Ignite Developers mailing list archive at Nabble.com.
>



--
Thanks & Regards
Pawan Pawar
Mobile: +91 9993585256
Skype: pawarskype

core-site.xml (2K) Download Attachment
mapred-site.xml (3K) Download Attachment
default-config.xml (11K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: hive not working with ignite igfs

Vladimir Ozerov
Hi,

I do not see any apparent errors in configs. Could you please provide logs
from Ignite server?

Vladimir.

On Fri, Apr 1, 2016 at 10:03 AM, Pawan Pawar <[hidden email]> wrote:

> Thanks for your reply I am sending my all conf files, please check
> attachment, I am using igfs://igfs@192.168.1.5:10500
>
> On Fri, Apr 1, 2016 at 12:06 PM, Vladimir Ozerov <[hidden email]>
> wrote:
>
>> Hi,
>>
>> Please provide your XML configuration and IGFS URI you use.
>>
>> Vladimir.
>>
>> On Thu, Mar 31, 2016 at 1:07 PM, pawanpawar <[hidden email]> wrote:
>>
>> > Hi all, when I try to run the hive cmd I got this error.
>> >
>> > pawanpawar@cloud:~$ hive
>> > Exception in thread "main" java.lang.RuntimeException:
>> java.io.IOException:
>> > Failed to get file status [path=/tmp/hive]
>> >         at
>> >
>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:444)
>> >         at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:672)
>> >         at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> >
>> >
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> >         at
>> >
>> >
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> >         at java.lang.reflect.Method.invoke(Method.java:497)
>> >         at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
>> >         at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
>> > Caused by: java.io.IOException: Failed to get file status
>> [path=/tmp/hive]
>> >         at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsUtils.cast(HadoopIgfsUtils.java:132)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:327)
>> >         at
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.info
>> > (HadoopIgfsWrapper.java:120)
>> >         at
>> >
>> >
>> org.apache.ignite.hadoop.fs.v1.IgniteHadoopFileSystem.getFileStatus(IgniteHadoopFileSystem.java:989)
>> >         at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1400)
>> >         at
>> >
>> >
>> org.apache.hadoop.hive.ql.session.SessionState.createRootHDFSDir(SessionState.java:520)
>> >         at
>> >
>> >
>> org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:478)
>> >         at
>> >
>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:430)
>> >         ... 8 more
>> > Caused by: class org.apache.ignite.IgniteCheckedException: Failed to get
>> > file status [path=/tmp/hive]
>> >         at
>> > org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7005)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:166)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
>> >         at
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc.info
>> > (HadoopIgfsOutProc.java:209)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:123)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:120)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:310)
>> >         ... 14 more
>> > Caused by: class org.apache.ignite.igfs.IgfsException: Failed to get
>> file
>> > status [path=/tmp/hive]
>> >         at
>> >
>> >
>> org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:294)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:303)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:509)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:503)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:54)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:28)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:262)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListeners(GridFutureAdapter.java:250)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:380)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:346)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:323)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsIpcIo$ReaderThread.run(HadoopIgfsIpcIo.java:575)
>> >
>> >
>> >
>> >
>> > --
>> > View this message in context:
>> >
>> http://apache-ignite-developers.2346864.n4.nabble.com/hive-not-working-with-ignite-igfs-tp8190.html
>> > Sent from the Apache Ignite Developers mailing list archive at
>> Nabble.com.
>> >
>>
>
>
>
> --
> *Thanks & Regards*
> *Pawan Pawar*
> *Mobile: +91 9993585256*
> *Email: [hidden email] <[hidden email]>*
> *Skype: pawarskype*
>
Reply | Threaded
Open this post in threaded view
|

Re: hive not working with ignite igfs

pawanpawar
Hi Thanks, I am sending my ignite server log and also sending hadoop logs.

On Fri, Apr 1, 2016 at 5:34 PM, Vladimir Ozerov <[hidden email]> wrote:
Hi,

I do not see any apparent errors in configs. Could you please provide logs
from Ignite server?

Vladimir.

On Fri, Apr 1, 2016 at 10:03 AM, Pawan Pawar <[hidden email]> wrote:

> Thanks for your reply I am sending my all conf files, please check
> attachment, I am using igfs://igfs@192.168.1.5:10500
>
> On Fri, Apr 1, 2016 at 12:06 PM, Vladimir Ozerov <[hidden email]>
> wrote:
>
>> Hi,
>>
>> Please provide your XML configuration and IGFS URI you use.
>>
>> Vladimir.
>>
>> On Thu, Mar 31, 2016 at 1:07 PM, pawanpawar <[hidden email]> wrote:
>>
>> > Hi all, when I try to run the hive cmd I got this error.
>> >
>> > pawanpawar@cloud:~$ hive
>> > Exception in thread "main" java.lang.RuntimeException:
>> java.io.IOException:
>> > Failed to get file status [path=/tmp/hive]
>> >         at
>> >
>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:444)
>> >         at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:672)
>> >         at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> >
>> >
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> >         at
>> >
>> >
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> >         at java.lang.reflect.Method.invoke(Method.java:497)
>> >         at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
>> >         at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
>> > Caused by: java.io.IOException: Failed to get file status
>> [path=/tmp/hive]
>> >         at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsUtils.cast(HadoopIgfsUtils.java:132)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:327)
>> >         at
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.info
>> > (HadoopIgfsWrapper.java:120)
>> >         at
>> >
>> >
>> org.apache.ignite.hadoop.fs.v1.IgniteHadoopFileSystem.getFileStatus(IgniteHadoopFileSystem.java:989)
>> >         at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1400)
>> >         at
>> >
>> >
>> org.apache.hadoop.hive.ql.session.SessionState.createRootHDFSDir(SessionState.java:520)
>> >         at
>> >
>> >
>> org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:478)
>> >         at
>> >
>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:430)
>> >         ... 8 more
>> > Caused by: class org.apache.ignite.IgniteCheckedException: Failed to get
>> > file status [path=/tmp/hive]
>> >         at
>> > org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7005)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:166)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
>> >         at
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc.info
>> > (HadoopIgfsOutProc.java:209)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:123)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:120)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:310)
>> >         ... 14 more
>> > Caused by: class org.apache.ignite.igfs.IgfsException: Failed to get
>> file
>> > status [path=/tmp/hive]
>> >         at
>> >
>> >
>> org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:294)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:303)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:509)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:503)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:54)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:28)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:262)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListeners(GridFutureAdapter.java:250)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:380)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:346)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:323)
>> >         at
>> >
>> >
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsIpcIo$ReaderThread.run(HadoopIgfsIpcIo.java:575)
>> >
>> >
>> >
>> >
>> > --
>> > View this message in context:
>> >
>> http://apache-ignite-developers.2346864.n4.nabble.com/hive-not-working-with-ignite-igfs-tp8190.html
>> > Sent from the Apache Ignite Developers mailing list archive at
>> Nabble.com.
>> >
>>
>
>
>
> --
> *Thanks & Regards*
> *Pawan Pawar*
> *Mobile: +91 9993585256*
> *Email: [hidden email] <[hidden email]>*
> *Skype: pawarskype*
>



--
Thanks & Regards
Pawan Pawar
Mobile: +91 9993585256
Skype: pawarskype

ignite-8f3654ef.log (10K) Download Attachment
hadoop-pawanpawar-datanode-cloud.log (32K) Download Attachment
hadoop-pawanpawar-namenode-cloud.log (48K) Download Attachment
hadoop-pawanpawar-secondarynamenode-cloud.log (28K) Download Attachment
yarn-pawanpawar-nodemanager-cloud.log (39K) Download Attachment
yarn-pawanpawar-resourcemanager-cloud.log (48K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: hive not working with ignite igfs

Vladimir Ozerov
Pawan,

I think it makes sense to try reverting "fs.defaultFS" property back to
original value:

<property>
    <name>fs.defaultFS</name>
    <value>hdfs://192.168.1.5:9000</value>
</property>


Hadoop ecosystem is know to be pretty sensitive to the value of this
property and often cannot work when the value is somehing ither than HDFS
URI. Once you revert it, you should access IGFS using fully-qualified names
- "igfs://igfs@192.168.1.5/path/to/your/file" instead of
"/path/to/your/file".

I think that at first it makes sense to ensure that IGFS is able to
communicate with HDFS. E.g. through "hadoop fs" command line. And once it
works fine, go further with Hive.

Vladimir

On Fri, Apr 1, 2016 at 3:58 PM, Pawan Pawar <[hidden email]> wrote:

> Hi Thanks, I am sending my ignite server log and also sending hadoop logs.
>
> On Fri, Apr 1, 2016 at 5:34 PM, Vladimir Ozerov <[hidden email]>
> wrote:
>
>> Hi,
>>
>> I do not see any apparent errors in configs. Could you please provide logs
>> from Ignite server?
>>
>> Vladimir.
>>
>> On Fri, Apr 1, 2016 at 10:03 AM, Pawan Pawar <[hidden email]>
>> wrote:
>>
>> > Thanks for your reply I am sending my all conf files, please check
>> > attachment, I am using igfs://igfs@192.168.1.5:10500
>> >
>> > On Fri, Apr 1, 2016 at 12:06 PM, Vladimir Ozerov <[hidden email]>
>> > wrote:
>> >
>> >> Hi,
>> >>
>> >> Please provide your XML configuration and IGFS URI you use.
>> >>
>> >> Vladimir.
>> >>
>> >> On Thu, Mar 31, 2016 at 1:07 PM, pawanpawar <[hidden email]>
>> wrote:
>> >>
>> >> > Hi all, when I try to run the hive cmd I got this error.
>> >> >
>> >> > pawanpawar@cloud:~$ hive
>> >> > Exception in thread "main" java.lang.RuntimeException:
>> >> java.io.IOException:
>> >> > Failed to get file status [path=/tmp/hive]
>> >> >         at
>> >> >
>> >>
>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:444)
>> >> >         at
>> org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:672)
>> >> >         at
>> org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616)
>> >> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
>> Method)
>> >> >         at
>> >> >
>> >> >
>> >>
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> >> >         at
>> >> >
>> >> >
>> >>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> >> >         at java.lang.reflect.Method.invoke(Method.java:497)
>> >> >         at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
>> >> >         at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
>> >> > Caused by: java.io.IOException: Failed to get file status
>> >> [path=/tmp/hive]
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsUtils.cast(HadoopIgfsUtils.java:132)
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:327)
>> >> >         at
>> >> >
>> >>
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.info
>> >> > (HadoopIgfsWrapper.java:120)
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.hadoop.fs.v1.IgniteHadoopFileSystem.getFileStatus(IgniteHadoopFileSystem.java:989)
>> >> >         at
>> org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1400)
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.hadoop.hive.ql.session.SessionState.createRootHDFSDir(SessionState.java:520)
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:478)
>> >> >         at
>> >> >
>> >>
>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:430)
>> >> >         ... 8 more
>> >> > Caused by: class org.apache.ignite.IgniteCheckedException: Failed to
>> get
>> >> > file status [path=/tmp/hive]
>> >> >         at
>> >> >
>> org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7005)
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:166)
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
>> >> >         at
>> >> >
>> >>
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc.info
>> >> > (HadoopIgfsOutProc.java:209)
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:123)
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper$2.apply(HadoopIgfsWrapper.java:120)
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:310)
>> >> >         ... 14 more
>> >> > Caused by: class org.apache.ignite.igfs.IgfsException: Failed to get
>> >> file
>> >> > status [path=/tmp/hive]
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:294)
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.igfs.common.IgfsControlResponse.throwError(IgfsControlResponse.java:303)
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:509)
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc$1.apply(HadoopIgfsOutProc.java:503)
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:54)
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:28)
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:262)
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListeners(GridFutureAdapter.java:250)
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:380)
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:346)
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:323)
>> >> >         at
>> >> >
>> >> >
>> >>
>> org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsIpcIo$ReaderThread.run(HadoopIgfsIpcIo.java:575)
>> >> >
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > View this message in context:
>> >> >
>> >>
>> http://apache-ignite-developers.2346864.n4.nabble.com/hive-not-working-with-ignite-igfs-tp8190.html
>> >> > Sent from the Apache Ignite Developers mailing list archive at
>> >> Nabble.com.
>> >> >
>> >>
>> >
>> >
>> >
>> > --
>> > *Thanks & Regards*
>> > *Pawan Pawar*
>> > *Mobile: +91 9993585256*
>> > *Email: [hidden email] <[hidden email]>*
>> > *Skype: pawarskype*
>> >
>>
>
>
>
> --
> *Thanks & Regards*
> *Pawan Pawar*
> *Mobile: +91 9993585256*
> *Email: [hidden email] <[hidden email]>*
> *Skype: pawarskype*
>