After setting streamer and ignite,getting NULL
Locked
12
12
After setting streamer and ignite,getting NULL
 
|
Hi Gian/Vishal/Lalit,
You guys have worked on Streamer integration with Ignite. I am working on Storm-ignite integration. I am setting up setStreamer() and setIgnite() in Test class and sending this object to setBolt() method. When i try to read via gettreamer() and getIgnite() i am getting NULL. I am trying to find out why is it happening but No Luck. If any one of you find some time and look into the code and help me to resolve this. It would be great. Git : https://github.com/chandresh-pancholi/ignite Module : storm -- Chandresh Pancholi Senior Software Engineer Flipkart.com Email-id:[hidden email] Contact:08951803660 |
Re: After setting streamer and ignite,getting NULL
|
|
Please take look here..
https://cwiki.apache.org/confluence/display/IGNITE/Streamers+Implementation+Guidelines 2015-09-21 14:54 GMT+02:00 chandresh pancholi < [hidden email]>: > Hi Gian/Vishal/Lalit, > > You guys have worked on Streamer integration with Ignite. I am working on > Storm-ignite integration. > > I am setting up setStreamer() and setIgnite() in Test class and sending > this object to setBolt() method. > > When i try to read via gettreamer() and getIgnite() i am getting NULL. I am > trying to find out why is it happening but No Luck. > > If any one of you find some time and look into the code and help me to > resolve this. It would be great. > > Git : https://github.com/chandresh-pancholi/ignite > Module : storm > > -- > Chandresh Pancholi > Senior Software Engineer > Flipkart.com > Email-id:[hidden email] > Contact:08951803660 > |
|
In reply to this post by chandresh pancholi
Hi Chandresh,
See test suite class here, its based on annotations https://github.com/sylentprayer/ignite/blob/ignite-530/modules/twitter/src/test/java/org/apache/ignite/stream/twitter/IgniteTwitterStreamerTestSuite.java No code required in class body. On Mon, Sep 21, 2015 at 6:24 PM, chandresh pancholi < [hidden email]> wrote: > Hi Gian/Vishal/Lalit, > > You guys have worked on Streamer integration with Ignite. I am working on > Storm-ignite integration. > > I am setting up setStreamer() and setIgnite() in Test class and sending > this object to setBolt() method. > > When i try to read via gettreamer() and getIgnite() i am getting NULL. I am > trying to find out why is it happening but No Luck. > > If any one of you find some time and look into the code and help me to > resolve this. It would be great. > > Git : https://github.com/chandresh-pancholi/ignite > Module : storm > > -- > Chandresh Pancholi > Senior Software Engineer > Flipkart.com > Email-id:[hidden email] > Contact:08951803660 > |
Re: After setting streamer and ignite,getting NULL
|
|
Problem here is with Storm. Its making streamer object null once it goes
into submit topology. On Mon, Sep 21, 2015 at 7:13 PM, Lalit Kumar Jha <[hidden email]> wrote: > Hi Chandresh, > > See test suite class here, its based on annotations > > https://github.com/sylentprayer/ignite/blob/ignite-530/modules/twitter/src/test/java/org/apache/ignite/stream/twitter/IgniteTwitterStreamerTestSuite.java > > No code required in class body. > > On Mon, Sep 21, 2015 at 6:24 PM, chandresh pancholi < > [hidden email]> wrote: > > > Hi Gian/Vishal/Lalit, > > > > You guys have worked on Streamer integration with Ignite. I am working on > > Storm-ignite integration. > > > > I am setting up setStreamer() and setIgnite() in Test class and sending > > this object to setBolt() method. > > > > When i try to read via gettreamer() and getIgnite() i am getting NULL. I > am > > trying to find out why is it happening but No Luck. > > > > If any one of you find some time and look into the code and help me to > > resolve this. It would be great. > > > > Git : https://github.com/chandresh-pancholi/ignite > > Module : storm > > > > -- > > Chandresh Pancholi > > Senior Software Engineer > > Flipkart.com > > Email-id:[hidden email] > > Contact:08951803660 > > > -- Chandresh Pancholi Senior Software Engineer Flipkart.com Email-id:[hidden email] Contact:08951803660 |
Re: After setting streamer and ignite,getting NULL
|
|
Did you figure it out? Something related to your storm integration?
Vishal Sent from my iPhone > On Sep 22, 2015, at 4:50 AM, chandresh pancholi <[hidden email]> wrote: > > Problem here is with Storm. Its making streamer object null once it goes > into submit topology. > > On Mon, Sep 21, 2015 at 7:13 PM, Lalit Kumar Jha <[hidden email]> > wrote: > >> Hi Chandresh, >> >> See test suite class here, its based on annotations >> >> https://github.com/sylentprayer/ignite/blob/ignite-530/modules/twitter/src/test/java/org/apache/ignite/stream/twitter/IgniteTwitterStreamerTestSuite.java >> >> No code required in class body. >> >> On Mon, Sep 21, 2015 at 6:24 PM, chandresh pancholi < >> [hidden email]> wrote: >> >>> Hi Gian/Vishal/Lalit, >>> >>> You guys have worked on Streamer integration with Ignite. I am working on >>> Storm-ignite integration. >>> >>> I am setting up setStreamer() and setIgnite() in Test class and sending >>> this object to setBolt() method. >>> >>> When i try to read via gettreamer() and getIgnite() i am getting NULL. I >> am >>> trying to find out why is it happening but No Luck. >>> >>> If any one of you find some time and look into the code and help me to >>> resolve this. It would be great. >>> >>> Git : https://github.com/chandresh-pancholi/ignite >>> Module : storm >>> >>> -- >>> Chandresh Pancholi >>> Senior Software Engineer >>> Flipkart.com >>> Email-id:[hidden email] >>> Contact:08951803660 > > > > -- > Chandresh Pancholi > Senior Software Engineer > Flipkart.com > Email-id:[hidden email] > Contact:08951803660 |
Re: After setting streamer and ignite,getting NULL
|
|
Not yet.
Still doing brainstorming why StormStreamer object is getting NULLL in-spite setting up ignite and streamer instances. On Tue, Sep 22, 2015 at 7:22 PM, Vishal Garg <[hidden email]> wrote: > Did you figure it out? Something related to your storm integration? > Vishal > > Sent from my iPhone > > > On Sep 22, 2015, at 4:50 AM, chandresh pancholi < > [hidden email]> wrote: > > > > Problem here is with Storm. Its making streamer object null once it goes > > into submit topology. > > > > On Mon, Sep 21, 2015 at 7:13 PM, Lalit Kumar Jha <[hidden email]> > > wrote: > > > >> Hi Chandresh, > >> > >> See test suite class here, its based on annotations > >> > >> > https://github.com/sylentprayer/ignite/blob/ignite-530/modules/twitter/src/test/java/org/apache/ignite/stream/twitter/IgniteTwitterStreamerTestSuite.java > >> > >> No code required in class body. > >> > >> On Mon, Sep 21, 2015 at 6:24 PM, chandresh pancholi < > >> [hidden email]> wrote: > >> > >>> Hi Gian/Vishal/Lalit, > >>> > >>> You guys have worked on Streamer integration with Ignite. I am working > on > >>> Storm-ignite integration. > >>> > >>> I am setting up setStreamer() and setIgnite() in Test class and sending > >>> this object to setBolt() method. > >>> > >>> When i try to read via gettreamer() and getIgnite() i am getting NULL. > I > >> am > >>> trying to find out why is it happening but No Luck. > >>> > >>> If any one of you find some time and look into the code and help me to > >>> resolve this. It would be great. > >>> > >>> Git : https://github.com/chandresh-pancholi/ignite > >>> Module : storm > >>> > >>> -- > >>> Chandresh Pancholi > >>> Senior Software Engineer > >>> Flipkart.com > >>> Email-id:[hidden email] > >>> Contact:08951803660 > > > > > > > > -- > > Chandresh Pancholi > > Senior Software Engineer > > Flipkart.com > > Email-id:[hidden email] > > Contact:08951803660 > -- Chandresh Pancholi Senior Software Engineer Flipkart.com Email-id:[hidden email] Contact:08951803660 |
Re: After setting streamer and ignite,getting NULL
|
|
Chandresh,
I'm trying to analize problem. Could you please provide more details and explain step-by-step how can I reproduce problem? On Tue, Sep 22, 2015 at 11:06 PM, chandresh pancholi < [hidden email]> wrote: > Not yet. > Still doing brainstorming why StormStreamer object is getting NULLL > in-spite setting up ignite and streamer instances. > > On Tue, Sep 22, 2015 at 7:22 PM, Vishal Garg <[hidden email]> wrote: > > > Did you figure it out? Something related to your storm integration? > > Vishal > > > > Sent from my iPhone > > > > > On Sep 22, 2015, at 4:50 AM, chandresh pancholi < > > [hidden email]> wrote: > > > > > > Problem here is with Storm. Its making streamer object null once it > goes > > > into submit topology. > > > > > > On Mon, Sep 21, 2015 at 7:13 PM, Lalit Kumar Jha <[hidden email] > > > > > wrote: > > > > > >> Hi Chandresh, > > >> > > >> See test suite class here, its based on annotations > > >> > > >> > > > https://github.com/sylentprayer/ignite/blob/ignite-530/modules/twitter/src/test/java/org/apache/ignite/stream/twitter/IgniteTwitterStreamerTestSuite.java > > >> > > >> No code required in class body. > > >> > > >> On Mon, Sep 21, 2015 at 6:24 PM, chandresh pancholi < > > >> [hidden email]> wrote: > > >> > > >>> Hi Gian/Vishal/Lalit, > > >>> > > >>> You guys have worked on Streamer integration with Ignite. I am > working > > on > > >>> Storm-ignite integration. > > >>> > > >>> I am setting up setStreamer() and setIgnite() in Test class and > sending > > >>> this object to setBolt() method. > > >>> > > >>> When i try to read via gettreamer() and getIgnite() i am getting > NULL. > > I > > >> am > > >>> trying to find out why is it happening but No Luck. > > >>> > > >>> If any one of you find some time and look into the code and help me > to > > >>> resolve this. It would be great. > > >>> > > >>> Git : https://github.com/chandresh-pancholi/ignite > > >>> Module : storm > > >>> > > >>> -- > > >>> Chandresh Pancholi > > >>> Senior Software Engineer > > >>> Flipkart.com > > >>> Email-id:[hidden email] > > >>> Contact:08951803660 > > > > > > > > > > > > -- > > > Chandresh Pancholi > > > Senior Software Engineer > > > Flipkart.com > > > Email-id:[hidden email] > > > Contact:08951803660 > > > > > > -- > Chandresh Pancholi > Senior Software Engineer > Flipkart.com > Email-id:[hidden email] > Contact:08951803660 > |
Re: After setting streamer and ignite,getting NULL
|
|
Anton,
Clone this repo https://github.com/chandresh-pancholi/ignite and run this class https://github.com/chandresh-pancholi/ignite/blob/master/modules/storm/src/test/java/org/apache/ignite/stream/storm/IgniteStormStreamerSelfTestSuite.java You will get the Error saying "Oouch,Argument is Null" for getStreamer(). On Wed, Sep 23, 2015 at 9:46 PM, Anton Vinogradov <[hidden email]> wrote: > Chandresh, > I'm trying to analize problem. > Could you please provide more details and explain step-by-step how can I > reproduce problem? > > On Tue, Sep 22, 2015 at 11:06 PM, chandresh pancholi < > [hidden email]> wrote: > > > Not yet. > > Still doing brainstorming why StormStreamer object is getting NULLL > > in-spite setting up ignite and streamer instances. > > > > On Tue, Sep 22, 2015 at 7:22 PM, Vishal Garg <[hidden email]> wrote: > > > > > Did you figure it out? Something related to your storm integration? > > > Vishal > > > > > > Sent from my iPhone > > > > > > > On Sep 22, 2015, at 4:50 AM, chandresh pancholi < > > > [hidden email]> wrote: > > > > > > > > Problem here is with Storm. Its making streamer object null once it > > goes > > > > into submit topology. > > > > > > > > On Mon, Sep 21, 2015 at 7:13 PM, Lalit Kumar Jha < > [hidden email] > > > > > > > wrote: > > > > > > > >> Hi Chandresh, > > > >> > > > >> See test suite class here, its based on annotations > > > >> > > > >> > > > > > > https://github.com/sylentprayer/ignite/blob/ignite-530/modules/twitter/src/test/java/org/apache/ignite/stream/twitter/IgniteTwitterStreamerTestSuite.java > > > >> > > > >> No code required in class body. > > > >> > > > >> On Mon, Sep 21, 2015 at 6:24 PM, chandresh pancholi < > > > >> [hidden email]> wrote: > > > >> > > > >>> Hi Gian/Vishal/Lalit, > > > >>> > > > >>> You guys have worked on Streamer integration with Ignite. I am > > working > > > on > > > >>> Storm-ignite integration. > > > >>> > > > >>> I am setting up setStreamer() and setIgnite() in Test class and > > sending > > > >>> this object to setBolt() method. > > > >>> > > > >>> When i try to read via gettreamer() and getIgnite() i am getting > > NULL. > > > I > > > >> am > > > >>> trying to find out why is it happening but No Luck. > > > >>> > > > >>> If any one of you find some time and look into the code and help me > > to > > > >>> resolve this. It would be great. > > > >>> > > > >>> Git : https://github.com/chandresh-pancholi/ignite > > > >>> Module : storm > > > >>> > > > >>> -- > > > >>> Chandresh Pancholi > > > >>> Senior Software Engineer > > > >>> Flipkart.com > > > >>> Email-id:[hidden email] > > > >>> Contact:08951803660 > > > > > > > > > > > > > > > > -- > > > > Chandresh Pancholi > > > > Senior Software Engineer > > > > Flipkart.com > > > > Email-id:[hidden email] > > > > Contact:08951803660 > > > > > > > > > > > -- > > Chandresh Pancholi > > Senior Software Engineer > > Flipkart.com > > Email-id:[hidden email] > > Contact:08951803660 > > > -- Chandresh Pancholi Senior Software Engineer Flipkart.com Email-id:[hidden email] Contact:08951803660 |
Re: After setting streamer and ignite,getting NULL
|
|
Chandresh,
I will launch the unit test later this week , if the problem persists. I think that you should instantiate Ignite through the start() method of Ignition class and retrieve the Ignite cache specifying a name for the default cache. You should provide a name also for data streamer, not passing null. Could you do this and run again the unit test ? Thank you, Regards, Gianfranco 2015-09-24 5:40 GMT+02:00 chandresh pancholi <[hidden email] >: > Anton, > > Clone this repo https://github.com/chandresh-pancholi/ignite and run this > class > > https://github.com/chandresh-pancholi/ignite/blob/master/modules/storm/src/test/java/org/apache/ignite/stream/storm/IgniteStormStreamerSelfTestSuite.java > > You will get the Error saying "Oouch,Argument is Null" for getStreamer(). > > On Wed, Sep 23, 2015 at 9:46 PM, Anton Vinogradov < > [hidden email]> > wrote: > > > Chandresh, > > I'm trying to analize problem. > > Could you please provide more details and explain step-by-step how can I > > reproduce problem? > > > > On Tue, Sep 22, 2015 at 11:06 PM, chandresh pancholi < > > [hidden email]> wrote: > > > > > Not yet. > > > Still doing brainstorming why StormStreamer object is getting NULLL > > > in-spite setting up ignite and streamer instances. > > > > > > On Tue, Sep 22, 2015 at 7:22 PM, Vishal Garg <[hidden email]> > wrote: > > > > > > > Did you figure it out? Something related to your storm integration? > > > > Vishal > > > > > > > > Sent from my iPhone > > > > > > > > > On Sep 22, 2015, at 4:50 AM, chandresh pancholi < > > > > [hidden email]> wrote: > > > > > > > > > > Problem here is with Storm. Its making streamer object null once it > > > goes > > > > > into submit topology. > > > > > > > > > > On Mon, Sep 21, 2015 at 7:13 PM, Lalit Kumar Jha < > > [hidden email] > > > > > > > > > wrote: > > > > > > > > > >> Hi Chandresh, > > > > >> > > > > >> See test suite class here, its based on annotations > > > > >> > > > > >> > > > > > > > > > > https://github.com/sylentprayer/ignite/blob/ignite-530/modules/twitter/src/test/java/org/apache/ignite/stream/twitter/IgniteTwitterStreamerTestSuite.java > > > > >> > > > > >> No code required in class body. > > > > >> > > > > >> On Mon, Sep 21, 2015 at 6:24 PM, chandresh pancholi < > > > > >> [hidden email]> wrote: > > > > >> > > > > >>> Hi Gian/Vishal/Lalit, > > > > >>> > > > > >>> You guys have worked on Streamer integration with Ignite. I am > > > working > > > > on > > > > >>> Storm-ignite integration. > > > > >>> > > > > >>> I am setting up setStreamer() and setIgnite() in Test class and > > > sending > > > > >>> this object to setBolt() method. > > > > >>> > > > > >>> When i try to read via gettreamer() and getIgnite() i am getting > > > NULL. > > > > I > > > > >> am > > > > >>> trying to find out why is it happening but No Luck. > > > > >>> > > > > >>> If any one of you find some time and look into the code and help > me > > > to > > > > >>> resolve this. It would be great. > > > > >>> > > > > >>> Git : https://github.com/chandresh-pancholi/ignite > > > > >>> Module : storm > > > > >>> > > > > >>> -- > > > > >>> Chandresh Pancholi > > > > >>> Senior Software Engineer > > > > >>> Flipkart.com > > > > >>> Email-id:[hidden email] > > > > >>> Contact:08951803660 > > > > > > > > > > > > > > > > > > > > -- > > > > > Chandresh Pancholi > > > > > Senior Software Engineer > > > > > Flipkart.com > > > > > Email-id:[hidden email] > > > > > Contact:08951803660 > > > > > > > > > > > > > > > > -- > > > Chandresh Pancholi > > > Senior Software Engineer > > > Flipkart.com > > > Email-id:[hidden email] > > > Contact:08951803660 > > > > > > > > > -- > Chandresh Pancholi > Senior Software Engineer > Flipkart.com > Email-id:[hidden email] > Contact:08951803660 > |
Re: After setting streamer and ignite,getting NULL
|
|
Chandresh,
As far as understand IBolt implementation should setup all external connections at .prepare() method. So, better way is to get existing Ignite instance or create new at .prepare() method. On Thu, Sep 24, 2015 at 10:55 AM, Gianfranco Murador < [hidden email]> wrote: > Chandresh, > I will launch the unit test later this week , if the problem persists. I > think that you should instantiate Ignite through the start() method of > Ignition class > and retrieve the Ignite cache specifying a name for the default cache. You > should provide a name also for data streamer, not passing null. > Could you do this and run again the unit test ? > Thank you, > Regards, > Gianfranco > > > 2015-09-24 5:40 GMT+02:00 chandresh pancholi < > [hidden email] > >: > > > Anton, > > > > Clone this repo https://github.com/chandresh-pancholi/ignite and run > this > > class > > > > > https://github.com/chandresh-pancholi/ignite/blob/master/modules/storm/src/test/java/org/apache/ignite/stream/storm/IgniteStormStreamerSelfTestSuite.java > > > > You will get the Error saying "Oouch,Argument is Null" for getStreamer(). > > > > On Wed, Sep 23, 2015 at 9:46 PM, Anton Vinogradov < > > [hidden email]> > > wrote: > > > > > Chandresh, > > > I'm trying to analize problem. > > > Could you please provide more details and explain step-by-step how can > I > > > reproduce problem? > > > > > > On Tue, Sep 22, 2015 at 11:06 PM, chandresh pancholi < > > > [hidden email]> wrote: > > > > > > > Not yet. > > > > Still doing brainstorming why StormStreamer object is getting NULLL > > > > in-spite setting up ignite and streamer instances. > > > > > > > > On Tue, Sep 22, 2015 at 7:22 PM, Vishal Garg <[hidden email]> > > wrote: > > > > > > > > > Did you figure it out? Something related to your storm integration? > > > > > Vishal > > > > > > > > > > Sent from my iPhone > > > > > > > > > > > On Sep 22, 2015, at 4:50 AM, chandresh pancholi < > > > > > [hidden email]> wrote: > > > > > > > > > > > > Problem here is with Storm. Its making streamer object null once > it > > > > goes > > > > > > into submit topology. > > > > > > > > > > > > On Mon, Sep 21, 2015 at 7:13 PM, Lalit Kumar Jha < > > > [hidden email] > > > > > > > > > > > wrote: > > > > > > > > > > > >> Hi Chandresh, > > > > > >> > > > > > >> See test suite class here, its based on annotations > > > > > >> > > > > > >> > > > > > > > > > > > > > > > https://github.com/sylentprayer/ignite/blob/ignite-530/modules/twitter/src/test/java/org/apache/ignite/stream/twitter/IgniteTwitterStreamerTestSuite.java > > > > > >> > > > > > >> No code required in class body. > > > > > >> > > > > > >> On Mon, Sep 21, 2015 at 6:24 PM, chandresh pancholi < > > > > > >> [hidden email]> wrote: > > > > > >> > > > > > >>> Hi Gian/Vishal/Lalit, > > > > > >>> > > > > > >>> You guys have worked on Streamer integration with Ignite. I am > > > > working > > > > > on > > > > > >>> Storm-ignite integration. > > > > > >>> > > > > > >>> I am setting up setStreamer() and setIgnite() in Test class and > > > > sending > > > > > >>> this object to setBolt() method. > > > > > >>> > > > > > >>> When i try to read via gettreamer() and getIgnite() i am > getting > > > > NULL. > > > > > I > > > > > >> am > > > > > >>> trying to find out why is it happening but No Luck. > > > > > >>> > > > > > >>> If any one of you find some time and look into the code and > help > > me > > > > to > > > > > >>> resolve this. It would be great. > > > > > >>> > > > > > >>> Git : https://github.com/chandresh-pancholi/ignite > > > > > >>> Module : storm > > > > > >>> > > > > > >>> -- > > > > > >>> Chandresh Pancholi > > > > > >>> Senior Software Engineer > > > > > >>> Flipkart.com > > > > > >>> Email-id:[hidden email] > > > > > >>> Contact:08951803660 > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > Chandresh Pancholi > > > > > > Senior Software Engineer > > > > > > Flipkart.com > > > > > > Email-id:[hidden email] > > > > > > Contact:08951803660 > > > > > > > > > > > > > > > > > > > > > -- > > > > Chandresh Pancholi > > > > Senior Software Engineer > > > > Flipkart.com > > > > Email-id:[hidden email] > > > > Contact:08951803660 > > > > > > > > > > > > > > > -- > > Chandresh Pancholi > > Senior Software Engineer > > Flipkart.com > > Email-id:[hidden email] > > Contact:08951803660 > > > |
Re: After setting streamer and ignite,getting NULL
|
|
Gian,
I have followed instructions given by you. I instantiate IgniteDateStreamer and ignite in prepare() method of bolt. but getting "*Cache doesn't exist*". Code snippet from stormStreamer class in prepare() method StormStreamer<String, String, String> stormStreamer = null; Ignite ignite = Ignition.start(); System.out.println(" ignite ====== "+ignite.toString()); try(IgniteDataStreamer<String, String> stmr = ignite.dataStreamer("cache-0")) { stormStreamer = new StormStreamer<>(); IgniteCache<String, String> cache = ignite.cache("cache-0"); stmr.allowOverwrite(true); /* Set ignite instance */ stormStreamer.setIgnite(ignite); /* Set streamer instance */ stormStreamer.setStreamer(stmr); /* set thread count */ setThreads(5); } On Thu, Sep 24, 2015 at 4:19 PM, Anton Vinogradov <[hidden email]> wrote: > Chandresh, > As far as understand IBolt implementation should setup all external > connections at .prepare() method. > So, better way is to get existing Ignite instance or create new at > .prepare() > method. > > > On Thu, Sep 24, 2015 at 10:55 AM, Gianfranco Murador < > [hidden email]> wrote: > > > Chandresh, > > I will launch the unit test later this week , if the problem persists. I > > think that you should instantiate Ignite through the start() method of > > Ignition class > > and retrieve the Ignite cache specifying a name for the default cache. > You > > should provide a name also for data streamer, not passing null. > > Could you do this and run again the unit test ? > > Thank you, > > Regards, > > Gianfranco > > > > > > 2015-09-24 5:40 GMT+02:00 chandresh pancholi < > > [hidden email] > > >: > > > > > Anton, > > > > > > Clone this repo https://github.com/chandresh-pancholi/ignite and run > > this > > > class > > > > > > > > > https://github.com/chandresh-pancholi/ignite/blob/master/modules/storm/src/test/java/org/apache/ignite/stream/storm/IgniteStormStreamerSelfTestSuite.java > > > > > > You will get the Error saying "Oouch,Argument is Null" for > getStreamer(). > > > > > > On Wed, Sep 23, 2015 at 9:46 PM, Anton Vinogradov < > > > [hidden email]> > > > wrote: > > > > > > > Chandresh, > > > > I'm trying to analize problem. > > > > Could you please provide more details and explain step-by-step how > can > > I > > > > reproduce problem? > > > > > > > > On Tue, Sep 22, 2015 at 11:06 PM, chandresh pancholi < > > > > [hidden email]> wrote: > > > > > > > > > Not yet. > > > > > Still doing brainstorming why StormStreamer object is getting NULLL > > > > > in-spite setting up ignite and streamer instances. > > > > > > > > > > On Tue, Sep 22, 2015 at 7:22 PM, Vishal Garg <[hidden email]> > > > wrote: > > > > > > > > > > > Did you figure it out? Something related to your storm > integration? > > > > > > Vishal > > > > > > > > > > > > Sent from my iPhone > > > > > > > > > > > > > On Sep 22, 2015, at 4:50 AM, chandresh pancholi < > > > > > > [hidden email]> wrote: > > > > > > > > > > > > > > Problem here is with Storm. Its making streamer object null > once > > it > > > > > goes > > > > > > > into submit topology. > > > > > > > > > > > > > > On Mon, Sep 21, 2015 at 7:13 PM, Lalit Kumar Jha < > > > > [hidden email] > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > >> Hi Chandresh, > > > > > > >> > > > > > > >> See test suite class here, its based on annotations > > > > > > >> > > > > > > >> > > > > > > > > > > > > > > > > > > > > > https://github.com/sylentprayer/ignite/blob/ignite-530/modules/twitter/src/test/java/org/apache/ignite/stream/twitter/IgniteTwitterStreamerTestSuite.java > > > > > > >> > > > > > > >> No code required in class body. > > > > > > >> > > > > > > >> On Mon, Sep 21, 2015 at 6:24 PM, chandresh pancholi < > > > > > > >> [hidden email]> wrote: > > > > > > >> > > > > > > >>> Hi Gian/Vishal/Lalit, > > > > > > >>> > > > > > > >>> You guys have worked on Streamer integration with Ignite. I > am > > > > > working > > > > > > on > > > > > > >>> Storm-ignite integration. > > > > > > >>> > > > > > > >>> I am setting up setStreamer() and setIgnite() in Test class > and > > > > > sending > > > > > > >>> this object to setBolt() method. > > > > > > >>> > > > > > > >>> When i try to read via gettreamer() and getIgnite() i am > > getting > > > > > NULL. > > > > > > I > > > > > > >> am > > > > > > >>> trying to find out why is it happening but No Luck. > > > > > > >>> > > > > > > >>> If any one of you find some time and look into the code and > > help > > > me > > > > > to > > > > > > >>> resolve this. It would be great. > > > > > > >>> > > > > > > >>> Git : https://github.com/chandresh-pancholi/ignite > > > > > > >>> Module : storm > > > > > > >>> > > > > > > >>> -- > > > > > > >>> Chandresh Pancholi > > > > > > >>> Senior Software Engineer > > > > > > >>> Flipkart.com > > > > > > >>> Email-id:[hidden email] > > > > > > >>> Contact:08951803660 > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > Chandresh Pancholi > > > > > > > Senior Software Engineer > > > > > > > Flipkart.com > > > > > > > Email-id:[hidden email] > > > > > > > Contact:08951803660 > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > Chandresh Pancholi > > > > > Senior Software Engineer > > > > > Flipkart.com > > > > > Email-id:[hidden email] > > > > > Contact:08951803660 > > > > > > > > > > > > > > > > > > > > > -- > > > Chandresh Pancholi > > > Senior Software Engineer > > > Flipkart.com > > > Email-id:[hidden email] > > > Contact:08951803660 > > > > > > -- Chandresh Pancholi Senior Software Engineer Flipkart.com Email-id:[hidden email] Contact:08951803660 |
Re: After setting streamer and ignite,getting NULL
|
|
Chan,
I've fixed some issue, please take a look here: https://github.com/murador/ignite/blob/IGNITE-429/modules/storm/src/test/java/org/apache/ignite/stream/storm/StormIgniteStreamerSelfTest.java 2015-09-26 8:29 GMT+02:00 chandresh pancholi <[hidden email] >: > Gian, > > I have followed instructions given by you. I instantiate IgniteDateStreamer > and ignite in prepare() method of bolt. but getting "*Cache doesn't > exist*". > > Code snippet from stormStreamer class in prepare() method > > StormStreamer<String, String, String> stormStreamer = null; > > Ignite ignite = Ignition.start(); > > System.out.println(" ignite ====== "+ignite.toString()); > > try(IgniteDataStreamer<String, String> stmr = > ignite.dataStreamer("cache-0")) { > > stormStreamer = new StormStreamer<>(); > > IgniteCache<String, String> cache = ignite.cache("cache-0"); > > stmr.allowOverwrite(true); > > /* Set ignite instance */ > stormStreamer.setIgnite(ignite); > > /* Set streamer instance */ > stormStreamer.setStreamer(stmr); > > /* set thread count */ > setThreads(5); > > } > > > > On Thu, Sep 24, 2015 at 4:19 PM, Anton Vinogradov < > [hidden email]> > wrote: > > > Chandresh, > > As far as understand IBolt implementation should setup all external > > connections at .prepare() method. > > So, better way is to get existing Ignite instance or create new at > > .prepare() > > method. > > > > > > On Thu, Sep 24, 2015 at 10:55 AM, Gianfranco Murador < > > [hidden email]> wrote: > > > > > Chandresh, > > > I will launch the unit test later this week , if the problem persists. > I > > > think that you should instantiate Ignite through the start() method of > > > Ignition class > > > and retrieve the Ignite cache specifying a name for the default cache. > > You > > > should provide a name also for data streamer, not passing null. > > > Could you do this and run again the unit test ? > > > Thank you, > > > Regards, > > > Gianfranco > > > > > > > > > 2015-09-24 5:40 GMT+02:00 chandresh pancholi < > > > [hidden email] > > > >: > > > > > > > Anton, > > > > > > > > Clone this repo https://github.com/chandresh-pancholi/ignite and run > > > this > > > > class > > > > > > > > > > > > > > https://github.com/chandresh-pancholi/ignite/blob/master/modules/storm/src/test/java/org/apache/ignite/stream/storm/IgniteStormStreamerSelfTestSuite.java > > > > > > > > You will get the Error saying "Oouch,Argument is Null" for > > getStreamer(). > > > > > > > > On Wed, Sep 23, 2015 at 9:46 PM, Anton Vinogradov < > > > > [hidden email]> > > > > wrote: > > > > > > > > > Chandresh, > > > > > I'm trying to analize problem. > > > > > Could you please provide more details and explain step-by-step how > > can > > > I > > > > > reproduce problem? > > > > > > > > > > On Tue, Sep 22, 2015 at 11:06 PM, chandresh pancholi < > > > > > [hidden email]> wrote: > > > > > > > > > > > Not yet. > > > > > > Still doing brainstorming why StormStreamer object is getting > NULLL > > > > > > in-spite setting up ignite and streamer instances. > > > > > > > > > > > > On Tue, Sep 22, 2015 at 7:22 PM, Vishal Garg <[hidden email] > > > > > > wrote: > > > > > > > > > > > > > Did you figure it out? Something related to your storm > > integration? > > > > > > > Vishal > > > > > > > > > > > > > > Sent from my iPhone > > > > > > > > > > > > > > > On Sep 22, 2015, at 4:50 AM, chandresh pancholi < > > > > > > > [hidden email]> wrote: > > > > > > > > > > > > > > > > Problem here is with Storm. Its making streamer object null > > once > > > it > > > > > > goes > > > > > > > > into submit topology. > > > > > > > > > > > > > > > > On Mon, Sep 21, 2015 at 7:13 PM, Lalit Kumar Jha < > > > > > [hidden email] > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > >> Hi Chandresh, > > > > > > > >> > > > > > > > >> See test suite class here, its based on annotations > > > > > > > >> > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://github.com/sylentprayer/ignite/blob/ignite-530/modules/twitter/src/test/java/org/apache/ignite/stream/twitter/IgniteTwitterStreamerTestSuite.java > > > > > > > >> > > > > > > > >> No code required in class body. > > > > > > > >> > > > > > > > >> On Mon, Sep 21, 2015 at 6:24 PM, chandresh pancholi < > > > > > > > >> [hidden email]> wrote: > > > > > > > >> > > > > > > > >>> Hi Gian/Vishal/Lalit, > > > > > > > >>> > > > > > > > >>> You guys have worked on Streamer integration with Ignite. I > > am > > > > > > working > > > > > > > on > > > > > > > >>> Storm-ignite integration. > > > > > > > >>> > > > > > > > >>> I am setting up setStreamer() and setIgnite() in Test class > > and > > > > > > sending > > > > > > > >>> this object to setBolt() method. > > > > > > > >>> > > > > > > > >>> When i try to read via gettreamer() and getIgnite() i am > > > getting > > > > > > NULL. > > > > > > > I > > > > > > > >> am > > > > > > > >>> trying to find out why is it happening but No Luck. > > > > > > > >>> > > > > > > > >>> If any one of you find some time and look into the code and > > > help > > > > me > > > > > > to > > > > > > > >>> resolve this. It would be great. > > > > > > > >>> > > > > > > > >>> Git : https://github.com/chandresh-pancholi/ignite > > > > > > > >>> Module : storm > > > > > > > >>> > > > > > > > >>> -- > > > > > > > >>> Chandresh Pancholi > > > > > > > >>> Senior Software Engineer > > > > > > > >>> Flipkart.com > > > > > > > >>> Email-id:[hidden email] > > > > > > > >>> Contact:08951803660 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > Chandresh Pancholi > > > > > > > > Senior Software Engineer > > > > > > > > Flipkart.com > > > > > > > > Email-id:[hidden email] > > > > > > > > Contact:08951803660 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > Chandresh Pancholi > > > > > > Senior Software Engineer > > > > > > Flipkart.com > > > > > > Email-id:[hidden email] > > > > > > Contact:08951803660 > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > Chandresh Pancholi > > > > Senior Software Engineer > > > > Flipkart.com > > > > Email-id:[hidden email] > > > > Contact:08951803660 > > > > > > > > > > > > > -- > Chandresh Pancholi > Senior Software Engineer > Flipkart.com > Email-id:[hidden email] > Contact:08951803660 > |
Re: After setting streamer and ignite,getting NULL
|
|
Gian,
Its still giving "Ouch! Argument cannot be null: streamer" On Sat, Sep 26, 2015 at 7:24 PM, Gianfranco Murador < [hidden email]> wrote: > Chan, > I've fixed some issue, please take a look here: > > https://github.com/murador/ignite/blob/IGNITE-429/modules/storm/src/test/java/org/apache/ignite/stream/storm/StormIgniteStreamerSelfTest.java > > 2015-09-26 8:29 GMT+02:00 chandresh pancholi < > [hidden email] > >: > > > Gian, > > > > I have followed instructions given by you. I instantiate > IgniteDateStreamer > > and ignite in prepare() method of bolt. but getting "*Cache doesn't > > exist*". > > > > Code snippet from stormStreamer class in prepare() method > > > > StormStreamer<String, String, String> stormStreamer = null; > > > > Ignite ignite = Ignition.start(); > > > > System.out.println(" ignite ====== "+ignite.toString()); > > > > try(IgniteDataStreamer<String, String> stmr = > > ignite.dataStreamer("cache-0")) { > > > > stormStreamer = new StormStreamer<>(); > > > > IgniteCache<String, String> cache = ignite.cache("cache-0"); > > > > stmr.allowOverwrite(true); > > > > /* Set ignite instance */ > > stormStreamer.setIgnite(ignite); > > > > /* Set streamer instance */ > > stormStreamer.setStreamer(stmr); > > > > /* set thread count */ > > setThreads(5); > > > > } > > > > > > > > On Thu, Sep 24, 2015 at 4:19 PM, Anton Vinogradov < > > [hidden email]> > > wrote: > > > > > Chandresh, > > > As far as understand IBolt implementation should setup all external > > > connections at .prepare() method. > > > So, better way is to get existing Ignite instance or create new at > > > .prepare() > > > method. > > > > > > > > > On Thu, Sep 24, 2015 at 10:55 AM, Gianfranco Murador < > > > [hidden email]> wrote: > > > > > > > Chandresh, > > > > I will launch the unit test later this week , if the problem > persists. > > I > > > > think that you should instantiate Ignite through the start() method > of > > > > Ignition class > > > > and retrieve the Ignite cache specifying a name for the default > cache. > > > You > > > > should provide a name also for data streamer, not passing null. > > > > Could you do this and run again the unit test ? > > > > Thank you, > > > > Regards, > > > > Gianfranco > > > > > > > > > > > > 2015-09-24 5:40 GMT+02:00 chandresh pancholi < > > > > [hidden email] > > > > >: > > > > > > > > > Anton, > > > > > > > > > > Clone this repo https://github.com/chandresh-pancholi/ignite and > run > > > > this > > > > > class > > > > > > > > > > > > > > > > > > > > https://github.com/chandresh-pancholi/ignite/blob/master/modules/storm/src/test/java/org/apache/ignite/stream/storm/IgniteStormStreamerSelfTestSuite.java > > > > > > > > > > You will get the Error saying "Oouch,Argument is Null" for > > > getStreamer(). > > > > > > > > > > On Wed, Sep 23, 2015 at 9:46 PM, Anton Vinogradov < > > > > > [hidden email]> > > > > > wrote: > > > > > > > > > > > Chandresh, > > > > > > I'm trying to analize problem. > > > > > > Could you please provide more details and explain step-by-step > how > > > can > > > > I > > > > > > reproduce problem? > > > > > > > > > > > > On Tue, Sep 22, 2015 at 11:06 PM, chandresh pancholi < > > > > > > [hidden email]> wrote: > > > > > > > > > > > > > Not yet. > > > > > > > Still doing brainstorming why StormStreamer object is getting > > NULLL > > > > > > > in-spite setting up ignite and streamer instances. > > > > > > > > > > > > > > On Tue, Sep 22, 2015 at 7:22 PM, Vishal Garg < > [hidden email] > > > > > > > > wrote: > > > > > > > > > > > > > > > Did you figure it out? Something related to your storm > > > integration? > > > > > > > > Vishal > > > > > > > > > > > > > > > > Sent from my iPhone > > > > > > > > > > > > > > > > > On Sep 22, 2015, at 4:50 AM, chandresh pancholi < > > > > > > > > [hidden email]> wrote: > > > > > > > > > > > > > > > > > > Problem here is with Storm. Its making streamer object null > > > once > > > > it > > > > > > > goes > > > > > > > > > into submit topology. > > > > > > > > > > > > > > > > > > On Mon, Sep 21, 2015 at 7:13 PM, Lalit Kumar Jha < > > > > > > [hidden email] > > > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > >> Hi Chandresh, > > > > > > > > >> > > > > > > > > >> See test suite class here, its based on annotations > > > > > > > > >> > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://github.com/sylentprayer/ignite/blob/ignite-530/modules/twitter/src/test/java/org/apache/ignite/stream/twitter/IgniteTwitterStreamerTestSuite.java > > > > > > > > >> > > > > > > > > >> No code required in class body. > > > > > > > > >> > > > > > > > > >> On Mon, Sep 21, 2015 at 6:24 PM, chandresh pancholi < > > > > > > > > >> [hidden email]> wrote: > > > > > > > > >> > > > > > > > > >>> Hi Gian/Vishal/Lalit, > > > > > > > > >>> > > > > > > > > >>> You guys have worked on Streamer integration with > Ignite. I > > > am > > > > > > > working > > > > > > > > on > > > > > > > > >>> Storm-ignite integration. > > > > > > > > >>> > > > > > > > > >>> I am setting up setStreamer() and setIgnite() in Test > class > > > and > > > > > > > sending > > > > > > > > >>> this object to setBolt() method. > > > > > > > > >>> > > > > > > > > >>> When i try to read via gettreamer() and getIgnite() i am > > > > getting > > > > > > > NULL. > > > > > > > > I > > > > > > > > >> am > > > > > > > > >>> trying to find out why is it happening but No Luck. > > > > > > > > >>> > > > > > > > > >>> If any one of you find some time and look into the code > and > > > > help > > > > > me > > > > > > > to > > > > > > > > >>> resolve this. It would be great. > > > > > > > > >>> > > > > > > > > >>> Git : https://github.com/chandresh-pancholi/ignite > > > > > > > > >>> Module : storm > > > > > > > > >>> > > > > > > > > >>> -- > > > > > > > > >>> Chandresh Pancholi > > > > > > > > >>> Senior Software Engineer > > > > > > > > >>> Flipkart.com > > > > > > > > >>> Email-id:[hidden email] > > > > > > > > >>> Contact:08951803660 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > > Chandresh Pancholi > > > > > > > > > Senior Software Engineer > > > > > > > > > Flipkart.com > > > > > > > > > Email-id:[hidden email] > > > > > > > > > Contact:08951803660 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > Chandresh Pancholi > > > > > > > Senior Software Engineer > > > > > > > Flipkart.com > > > > > > > Email-id:[hidden email] > > > > > > > Contact:08951803660 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > Chandresh Pancholi > > > > > Senior Software Engineer > > > > > Flipkart.com > > > > > Email-id:[hidden email] > > > > > Contact:08951803660 > > > > > > > > > > > > > > > > > > > > -- > > Chandresh Pancholi > > Senior Software Engineer > > Flipkart.com > > Email-id:[hidden email] > > Contact:08951803660 > > > -- Chandresh Pancholi Senior Software Engineer Flipkart.com Email-id:[hidden email] Contact:08951803660 |
Re: After setting streamer and ignite,getting NULL
|
|
Chan,
I can run the test succefully, but sometimes I get this error: Caused by: class org.apache.ignite.spi.IgniteSpiException: Failed to add node to topology because remote node is configured to use loopback address, but local node is not (consider changing 'localAddress' configuration parameter). can you send the log file? Regards, Gianfranco 2015-09-26 17:13 GMT+02:00 chandresh pancholi < [hidden email]>: > Gian, > Its still giving "Ouch! Argument cannot be null: streamer" > > On Sat, Sep 26, 2015 at 7:24 PM, Gianfranco Murador < > [hidden email]> wrote: > > > Chan, > > I've fixed some issue, please take a look here: > > > > > https://github.com/murador/ignite/blob/IGNITE-429/modules/storm/src/test/java/org/apache/ignite/stream/storm/StormIgniteStreamerSelfTest.java > > > > 2015-09-26 8:29 GMT+02:00 chandresh pancholi < > > [hidden email] > > >: > > > > > Gian, > > > > > > I have followed instructions given by you. I instantiate > > IgniteDateStreamer > > > and ignite in prepare() method of bolt. but getting "*Cache doesn't > > > exist*". > > > > > > Code snippet from stormStreamer class in prepare() method > > > > > > StormStreamer<String, String, String> stormStreamer = null; > > > > > > Ignite ignite = Ignition.start(); > > > > > > System.out.println(" ignite ====== "+ignite.toString()); > > > > > > try(IgniteDataStreamer<String, String> stmr = > > > ignite.dataStreamer("cache-0")) { > > > > > > stormStreamer = new StormStreamer<>(); > > > > > > IgniteCache<String, String> cache = ignite.cache("cache-0"); > > > > > > stmr.allowOverwrite(true); > > > > > > /* Set ignite instance */ > > > stormStreamer.setIgnite(ignite); > > > > > > /* Set streamer instance */ > > > stormStreamer.setStreamer(stmr); > > > > > > /* set thread count */ > > > setThreads(5); > > > > > > } > > > > > > > > > > > > On Thu, Sep 24, 2015 at 4:19 PM, Anton Vinogradov < > > > [hidden email]> > > > wrote: > > > > > > > Chandresh, > > > > As far as understand IBolt implementation should setup all external > > > > connections at .prepare() method. > > > > So, better way is to get existing Ignite instance or create new at > > > > .prepare() > > > > method. > > > > > > > > > > > > On Thu, Sep 24, 2015 at 10:55 AM, Gianfranco Murador < > > > > [hidden email]> wrote: > > > > > > > > > Chandresh, > > > > > I will launch the unit test later this week , if the problem > > persists. > > > I > > > > > think that you should instantiate Ignite through the start() method > > of > > > > > Ignition class > > > > > and retrieve the Ignite cache specifying a name for the default > > cache. > > > > You > > > > > should provide a name also for data streamer, not passing null. > > > > > Could you do this and run again the unit test ? > > > > > Thank you, > > > > > Regards, > > > > > Gianfranco > > > > > > > > > > > > > > > 2015-09-24 5:40 GMT+02:00 chandresh pancholi < > > > > > [hidden email] > > > > > >: > > > > > > > > > > > Anton, > > > > > > > > > > > > Clone this repo https://github.com/chandresh-pancholi/ignite and > > run > > > > > this > > > > > > class > > > > > > > > > > > > > > > > > > > > > > > > > > > https://github.com/chandresh-pancholi/ignite/blob/master/modules/storm/src/test/java/org/apache/ignite/stream/storm/IgniteStormStreamerSelfTestSuite.java > > > > > > > > > > > > You will get the Error saying "Oouch,Argument is Null" for > > > > getStreamer(). > > > > > > > > > > > > On Wed, Sep 23, 2015 at 9:46 PM, Anton Vinogradov < > > > > > > [hidden email]> > > > > > > wrote: > > > > > > > > > > > > > Chandresh, > > > > > > > I'm trying to analize problem. > > > > > > > Could you please provide more details and explain step-by-step > > how > > > > can > > > > > I > > > > > > > reproduce problem? > > > > > > > > > > > > > > On Tue, Sep 22, 2015 at 11:06 PM, chandresh pancholi < > > > > > > > [hidden email]> wrote: > > > > > > > > > > > > > > > Not yet. > > > > > > > > Still doing brainstorming why StormStreamer object is getting > > > NULLL > > > > > > > > in-spite setting up ignite and streamer instances. > > > > > > > > > > > > > > > > On Tue, Sep 22, 2015 at 7:22 PM, Vishal Garg < > > [hidden email] > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > Did you figure it out? Something related to your storm > > > > integration? > > > > > > > > > Vishal > > > > > > > > > > > > > > > > > > Sent from my iPhone > > > > > > > > > > > > > > > > > > > On Sep 22, 2015, at 4:50 AM, chandresh pancholi < > > > > > > > > > [hidden email]> wrote: > > > > > > > > > > > > > > > > > > > > Problem here is with Storm. Its making streamer object > null > > > > once > > > > > it > > > > > > > > goes > > > > > > > > > > into submit topology. > > > > > > > > > > > > > > > > > > > > On Mon, Sep 21, 2015 at 7:13 PM, Lalit Kumar Jha < > > > > > > > [hidden email] > > > > > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > >> Hi Chandresh, > > > > > > > > > >> > > > > > > > > > >> See test suite class here, its based on annotations > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://github.com/sylentprayer/ignite/blob/ignite-530/modules/twitter/src/test/java/org/apache/ignite/stream/twitter/IgniteTwitterStreamerTestSuite.java > > > > > > > > > >> > > > > > > > > > >> No code required in class body. > > > > > > > > > >> > > > > > > > > > >> On Mon, Sep 21, 2015 at 6:24 PM, chandresh pancholi < > > > > > > > > > >> [hidden email]> wrote: > > > > > > > > > >> > > > > > > > > > >>> Hi Gian/Vishal/Lalit, > > > > > > > > > >>> > > > > > > > > > >>> You guys have worked on Streamer integration with > > Ignite. I > > > > am > > > > > > > > working > > > > > > > > > on > > > > > > > > > >>> Storm-ignite integration. > > > > > > > > > >>> > > > > > > > > > >>> I am setting up setStreamer() and setIgnite() in Test > > class > > > > and > > > > > > > > sending > > > > > > > > > >>> this object to setBolt() method. > > > > > > > > > >>> > > > > > > > > > >>> When i try to read via gettreamer() and getIgnite() i > am > > > > > getting > > > > > > > > NULL. > > > > > > > > > I > > > > > > > > > >> am > > > > > > > > > >>> trying to find out why is it happening but No Luck. > > > > > > > > > >>> > > > > > > > > > >>> If any one of you find some time and look into the code > > and > > > > > help > > > > > > me > > > > > > > > to > > > > > > > > > >>> resolve this. It would be great. > > > > > > > > > >>> > > > > > > > > > >>> Git : https://github.com/chandresh-pancholi/ignite > > > > > > > > > >>> Module : storm > > > > > > > > > >>> > > > > > > > > > >>> -- > > > > > > > > > >>> Chandresh Pancholi > > > > > > > > > >>> Senior Software Engineer > > > > > > > > > >>> Flipkart.com > > > > > > > > > >>> Email-id:[hidden email] > > > > > > > > > >>> Contact:08951803660 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > > > Chandresh Pancholi > > > > > > > > > > Senior Software Engineer > > > > > > > > > > Flipkart.com > > > > > > > > > > Email-id:[hidden email] > > > > > > > > > > Contact:08951803660 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > Chandresh Pancholi > > > > > > > > Senior Software Engineer > > > > > > > > Flipkart.com > > > > > > > > Email-id:[hidden email] > > > > > > > > Contact:08951803660 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > Chandresh Pancholi > > > > > > Senior Software Engineer > > > > > > Flipkart.com > > > > > > Email-id:[hidden email] > > > > > > Contact:08951803660 > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > Chandresh Pancholi > > > Senior Software Engineer > > > Flipkart.com > > > Email-id:[hidden email] > > > Contact:08951803660 > > > > > > > > > -- > Chandresh Pancholi > Senior Software Engineer > Flipkart.com > Email-id:[hidden email] > Contact:08951803660 > |
Re: After setting streamer and ignite,getting NULL
|
|
Here is the log file. Thanks On Sat, Sep 26, 2015 at 10:40 PM, Gianfranco Murador <[hidden email]> wrote: Chan, |
Re: After setting streamer and ignite,getting NULL
|
|
Chandresh, we're ready to do a pull request. Look here:
https://github.com/murador/ignite/tree/IGNITE-429/modules/storm 2015-09-27 8:49 GMT+02:00 chandresh pancholi <[hidden email] >: > Here is the log file. > > Thanks > > On Sat, Sep 26, 2015 at 10:40 PM, Gianfranco Murador < > [hidden email]> wrote: > >> Chan, >> I can run the test succefully, but sometimes I get this error: >> Caused by: class org.apache.ignite.spi.IgniteSpiException: Failed to add >> node to topology because remote node is configured to use loopback >> address, >> but local node is not (consider changing 'localAddress' configuration >> parameter). >> >> can you send the log file? >> Regards, Gianfranco >> >> >> >> 2015-09-26 17:13 GMT+02:00 chandresh pancholi < >> [hidden email]>: >> >> > Gian, >> > Its still giving "Ouch! Argument cannot be null: streamer" >> > >> > On Sat, Sep 26, 2015 at 7:24 PM, Gianfranco Murador < >> > [hidden email]> wrote: >> > >> > > Chan, >> > > I've fixed some issue, please take a look here: >> > > >> > > >> > >> https://github.com/murador/ignite/blob/IGNITE-429/modules/storm/src/test/java/org/apache/ignite/stream/storm/StormIgniteStreamerSelfTest.java >> > > >> > > 2015-09-26 8:29 GMT+02:00 chandresh pancholi < >> > > [hidden email] >> > > >: >> > > >> > > > Gian, >> > > > >> > > > I have followed instructions given by you. I instantiate >> > > IgniteDateStreamer >> > > > and ignite in prepare() method of bolt. but getting "*Cache doesn't >> > > > exist*". >> > > > >> > > > Code snippet from stormStreamer class in prepare() method >> > > > >> > > > StormStreamer<String, String, String> stormStreamer = null; >> > > > >> > > > Ignite ignite = Ignition.start(); >> > > > >> > > > System.out.println(" ignite ====== "+ignite.toString()); >> > > > >> > > > try(IgniteDataStreamer<String, String> stmr = >> > > > ignite.dataStreamer("cache-0")) { >> > > > >> > > > stormStreamer = new StormStreamer<>(); >> > > > >> > > > IgniteCache<String, String> cache = ignite.cache("cache-0"); >> > > > >> > > > stmr.allowOverwrite(true); >> > > > >> > > > /* Set ignite instance */ >> > > > stormStreamer.setIgnite(ignite); >> > > > >> > > > /* Set streamer instance */ >> > > > stormStreamer.setStreamer(stmr); >> > > > >> > > > /* set thread count */ >> > > > setThreads(5); >> > > > >> > > > } >> > > > >> > > > >> > > > >> > > > On Thu, Sep 24, 2015 at 4:19 PM, Anton Vinogradov < >> > > > [hidden email]> >> > > > wrote: >> > > > >> > > > > Chandresh, >> > > > > As far as understand IBolt implementation should setup all >> external >> > > > > connections at .prepare() method. >> > > > > So, better way is to get existing Ignite instance or create new at >> > > > > .prepare() >> > > > > method. >> > > > > >> > > > > >> > > > > On Thu, Sep 24, 2015 at 10:55 AM, Gianfranco Murador < >> > > > > [hidden email]> wrote: >> > > > > >> > > > > > Chandresh, >> > > > > > I will launch the unit test later this week , if the problem >> > > persists. >> > > > I >> > > > > > think that you should instantiate Ignite through the start() >> method >> > > of >> > > > > > Ignition class >> > > > > > and retrieve the Ignite cache specifying a name for the default >> > > cache. >> > > > > You >> > > > > > should provide a name also for data streamer, not passing null. >> > > > > > Could you do this and run again the unit test ? >> > > > > > Thank you, >> > > > > > Regards, >> > > > > > Gianfranco >> > > > > > >> > > > > > >> > > > > > 2015-09-24 5:40 GMT+02:00 chandresh pancholi < >> > > > > > [hidden email] >> > > > > > >: >> > > > > > >> > > > > > > Anton, >> > > > > > > >> > > > > > > Clone this repo https://github.com/chandresh-pancholi/ignite >> and >> > > run >> > > > > > this >> > > > > > > class >> > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > >> https://github.com/chandresh-pancholi/ignite/blob/master/modules/storm/src/test/java/org/apache/ignite/stream/storm/IgniteStormStreamerSelfTestSuite.java >> > > > > > > >> > > > > > > You will get the Error saying "Oouch,Argument is Null" for >> > > > > getStreamer(). >> > > > > > > >> > > > > > > On Wed, Sep 23, 2015 at 9:46 PM, Anton Vinogradov < >> > > > > > > [hidden email]> >> > > > > > > wrote: >> > > > > > > >> > > > > > > > Chandresh, >> > > > > > > > I'm trying to analize problem. >> > > > > > > > Could you please provide more details and explain >> step-by-step >> > > how >> > > > > can >> > > > > > I >> > > > > > > > reproduce problem? >> > > > > > > > >> > > > > > > > On Tue, Sep 22, 2015 at 11:06 PM, chandresh pancholi < >> > > > > > > > [hidden email]> wrote: >> > > > > > > > >> > > > > > > > > Not yet. >> > > > > > > > > Still doing brainstorming why StormStreamer object is >> getting >> > > > NULLL >> > > > > > > > > in-spite setting up ignite and streamer instances. >> > > > > > > > > >> > > > > > > > > On Tue, Sep 22, 2015 at 7:22 PM, Vishal Garg < >> > > [hidden email] >> > > > > >> > > > > > > wrote: >> > > > > > > > > >> > > > > > > > > > Did you figure it out? Something related to your storm >> > > > > integration? >> > > > > > > > > > Vishal >> > > > > > > > > > >> > > > > > > > > > Sent from my iPhone >> > > > > > > > > > >> > > > > > > > > > > On Sep 22, 2015, at 4:50 AM, chandresh pancholi < >> > > > > > > > > > [hidden email]> wrote: >> > > > > > > > > > > >> > > > > > > > > > > Problem here is with Storm. Its making streamer object >> > null >> > > > > once >> > > > > > it >> > > > > > > > > goes >> > > > > > > > > > > into submit topology. >> > > > > > > > > > > >> > > > > > > > > > > On Mon, Sep 21, 2015 at 7:13 PM, Lalit Kumar Jha < >> > > > > > > > [hidden email] >> > > > > > > > > > >> > > > > > > > > > > wrote: >> > > > > > > > > > > >> > > > > > > > > > >> Hi Chandresh, >> > > > > > > > > > >> >> > > > > > > > > > >> See test suite class here, its based on annotations >> > > > > > > > > > >> >> > > > > > > > > > >> >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > >> https://github.com/sylentprayer/ignite/blob/ignite-530/modules/twitter/src/test/java/org/apache/ignite/stream/twitter/IgniteTwitterStreamerTestSuite.java >> > > > > > > > > > >> >> > > > > > > > > > >> No code required in class body. >> > > > > > > > > > >> >> > > > > > > > > > >> On Mon, Sep 21, 2015 at 6:24 PM, chandresh pancholi < >> > > > > > > > > > >> [hidden email]> wrote: >> > > > > > > > > > >> >> > > > > > > > > > >>> Hi Gian/Vishal/Lalit, >> > > > > > > > > > >>> >> > > > > > > > > > >>> You guys have worked on Streamer integration with >> > > Ignite. I >> > > > > am >> > > > > > > > > working >> > > > > > > > > > on >> > > > > > > > > > >>> Storm-ignite integration. >> > > > > > > > > > >>> >> > > > > > > > > > >>> I am setting up setStreamer() and setIgnite() in >> Test >> > > class >> > > > > and >> > > > > > > > > sending >> > > > > > > > > > >>> this object to setBolt() method. >> > > > > > > > > > >>> >> > > > > > > > > > >>> When i try to read via gettreamer() and getIgnite() >> i >> > am >> > > > > > getting >> > > > > > > > > NULL. >> > > > > > > > > > I >> > > > > > > > > > >> am >> > > > > > > > > > >>> trying to find out why is it happening but No Luck. >> > > > > > > > > > >>> >> > > > > > > > > > >>> If any one of you find some time and look into the >> code >> > > and >> > > > > > help >> > > > > > > me >> > > > > > > > > to >> > > > > > > > > > >>> resolve this. It would be great. >> > > > > > > > > > >>> >> > > > > > > > > > >>> Git : https://github.com/chandresh-pancholi/ignite >> > > > > > > > > > >>> Module : storm >> > > > > > > > > > >>> >> > > > > > > > > > >>> -- >> > > > > > > > > > >>> Chandresh Pancholi >> > > > > > > > > > >>> Senior Software Engineer >> > > > > > > > > > >>> Flipkart.com >> > > > > > > > > > >>> Email-id:[hidden email] >> > > > > > > > > > >>> Contact:08951803660 >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > -- >> > > > > > > > > > > Chandresh Pancholi >> > > > > > > > > > > Senior Software Engineer >> > > > > > > > > > > Flipkart.com >> > > > > > > > > > > Email-id:[hidden email] >> > > > > > > > > > > Contact:08951803660 >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > > -- >> > > > > > > > > Chandresh Pancholi >> > > > > > > > > Senior Software Engineer >> > > > > > > > > Flipkart.com >> > > > > > > > > Email-id:[hidden email] >> > > > > > > > > Contact:08951803660 >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > -- >> > > > > > > Chandresh Pancholi >> > > > > > > Senior Software Engineer >> > > > > > > Flipkart.com >> > > > > > > Email-id:[hidden email] >> > > > > > > Contact:08951803660 >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > >> > > > >> > > > -- >> > > > Chandresh Pancholi >> > > > Senior Software Engineer >> > > > Flipkart.com >> > > > Email-id:[hidden email] >> > > > Contact:08951803660 >> > > > >> > > >> > >> > >> > >> > -- >> > Chandresh Pancholi >> > Senior Software Engineer >> > Flipkart.com >> > Email-id:[hidden email] >> > Contact:08951803660 >> > >> > > > > -- > Chandresh Pancholi > Senior Software Engineer > Flipkart.com > Email-id:[hidden email] > Contact:08951803660 > |
Re: After setting streamer and ignite,getting NULL
|
|
Gian,
I have checked the code. It looks good. Just one little change make it 20 sec. /* Topology will run for 10sec */ Utils.sleep(20000); On Sun, Sep 27, 2015 at 4:30 PM, Gianfranco Murador < [hidden email]> wrote: > Chandresh, we're ready to do a pull request. Look here: > https://github.com/murador/ignite/tree/IGNITE-429/modules/storm > > 2015-09-27 8:49 GMT+02:00 chandresh pancholi < > [hidden email] > >: > > > Here is the log file. > > > > Thanks > > > > On Sat, Sep 26, 2015 at 10:40 PM, Gianfranco Murador < > > [hidden email]> wrote: > > > >> Chan, > >> I can run the test succefully, but sometimes I get this error: > >> Caused by: class org.apache.ignite.spi.IgniteSpiException: Failed to add > >> node to topology because remote node is configured to use loopback > >> address, > >> but local node is not (consider changing 'localAddress' configuration > >> parameter). > >> > >> can you send the log file? > >> Regards, Gianfranco > >> > >> > >> > >> 2015-09-26 17:13 GMT+02:00 chandresh pancholi < > >> [hidden email]>: > >> > >> > Gian, > >> > Its still giving "Ouch! Argument cannot be null: streamer" > >> > > >> > On Sat, Sep 26, 2015 at 7:24 PM, Gianfranco Murador < > >> > [hidden email]> wrote: > >> > > >> > > Chan, > >> > > I've fixed some issue, please take a look here: > >> > > > >> > > > >> > > >> > https://github.com/murador/ignite/blob/IGNITE-429/modules/storm/src/test/java/org/apache/ignite/stream/storm/StormIgniteStreamerSelfTest.java > >> > > > >> > > 2015-09-26 8:29 GMT+02:00 chandresh pancholi < > >> > > [hidden email] > >> > > >: > >> > > > >> > > > Gian, > >> > > > > >> > > > I have followed instructions given by you. I instantiate > >> > > IgniteDateStreamer > >> > > > and ignite in prepare() method of bolt. but getting "*Cache > doesn't > >> > > > exist*". > >> > > > > >> > > > Code snippet from stormStreamer class in prepare() method > >> > > > > >> > > > StormStreamer<String, String, String> stormStreamer = null; > >> > > > > >> > > > Ignite ignite = Ignition.start(); > >> > > > > >> > > > System.out.println(" ignite ====== "+ignite.toString()); > >> > > > > >> > > > try(IgniteDataStreamer<String, String> stmr = > >> > > > ignite.dataStreamer("cache-0")) { > >> > > > > >> > > > stormStreamer = new StormStreamer<>(); > >> > > > > >> > > > IgniteCache<String, String> cache = ignite.cache("cache-0"); > >> > > > > >> > > > stmr.allowOverwrite(true); > >> > > > > >> > > > /* Set ignite instance */ > >> > > > stormStreamer.setIgnite(ignite); > >> > > > > >> > > > /* Set streamer instance */ > >> > > > stormStreamer.setStreamer(stmr); > >> > > > > >> > > > /* set thread count */ > >> > > > setThreads(5); > >> > > > > >> > > > } > >> > > > > >> > > > > >> > > > > >> > > > On Thu, Sep 24, 2015 at 4:19 PM, Anton Vinogradov < > >> > > > [hidden email]> > >> > > > wrote: > >> > > > > >> > > > > Chandresh, > >> > > > > As far as understand IBolt implementation should setup all > >> external > >> > > > > connections at .prepare() method. > >> > > > > So, better way is to get existing Ignite instance or create new > at > >> > > > > .prepare() > >> > > > > method. > >> > > > > > >> > > > > > >> > > > > On Thu, Sep 24, 2015 at 10:55 AM, Gianfranco Murador < > >> > > > > [hidden email]> wrote: > >> > > > > > >> > > > > > Chandresh, > >> > > > > > I will launch the unit test later this week , if the problem > >> > > persists. > >> > > > I > >> > > > > > think that you should instantiate Ignite through the start() > >> method > >> > > of > >> > > > > > Ignition class > >> > > > > > and retrieve the Ignite cache specifying a name for the > default > >> > > cache. > >> > > > > You > >> > > > > > should provide a name also for data streamer, not passing > null. > >> > > > > > Could you do this and run again the unit test ? > >> > > > > > Thank you, > >> > > > > > Regards, > >> > > > > > Gianfranco > >> > > > > > > >> > > > > > > >> > > > > > 2015-09-24 5:40 GMT+02:00 chandresh pancholi < > >> > > > > > [hidden email] > >> > > > > > >: > >> > > > > > > >> > > > > > > Anton, > >> > > > > > > > >> > > > > > > Clone this repo > https://github.com/chandresh-pancholi/ignite > >> and > >> > > run > >> > > > > > this > >> > > > > > > class > >> > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > https://github.com/chandresh-pancholi/ignite/blob/master/modules/storm/src/test/java/org/apache/ignite/stream/storm/IgniteStormStreamerSelfTestSuite.java > >> > > > > > > > >> > > > > > > You will get the Error saying "Oouch,Argument is Null" for > >> > > > > getStreamer(). > >> > > > > > > > >> > > > > > > On Wed, Sep 23, 2015 at 9:46 PM, Anton Vinogradov < > >> > > > > > > [hidden email]> > >> > > > > > > wrote: > >> > > > > > > > >> > > > > > > > Chandresh, > >> > > > > > > > I'm trying to analize problem. > >> > > > > > > > Could you please provide more details and explain > >> step-by-step > >> > > how > >> > > > > can > >> > > > > > I > >> > > > > > > > reproduce problem? > >> > > > > > > > > >> > > > > > > > On Tue, Sep 22, 2015 at 11:06 PM, chandresh pancholi < > >> > > > > > > > [hidden email]> wrote: > >> > > > > > > > > >> > > > > > > > > Not yet. > >> > > > > > > > > Still doing brainstorming why StormStreamer object is > >> getting > >> > > > NULLL > >> > > > > > > > > in-spite setting up ignite and streamer instances. > >> > > > > > > > > > >> > > > > > > > > On Tue, Sep 22, 2015 at 7:22 PM, Vishal Garg < > >> > > [hidden email] > >> > > > > > >> > > > > > > wrote: > >> > > > > > > > > > >> > > > > > > > > > Did you figure it out? Something related to your storm > >> > > > > integration? > >> > > > > > > > > > Vishal > >> > > > > > > > > > > >> > > > > > > > > > Sent from my iPhone > >> > > > > > > > > > > >> > > > > > > > > > > On Sep 22, 2015, at 4:50 AM, chandresh pancholi < > >> > > > > > > > > > [hidden email]> wrote: > >> > > > > > > > > > > > >> > > > > > > > > > > Problem here is with Storm. Its making streamer > object > >> > null > >> > > > > once > >> > > > > > it > >> > > > > > > > > goes > >> > > > > > > > > > > into submit topology. > >> > > > > > > > > > > > >> > > > > > > > > > > On Mon, Sep 21, 2015 at 7:13 PM, Lalit Kumar Jha < > >> > > > > > > > [hidden email] > >> > > > > > > > > > > >> > > > > > > > > > > wrote: > >> > > > > > > > > > > > >> > > > > > > > > > >> Hi Chandresh, > >> > > > > > > > > > >> > >> > > > > > > > > > >> See test suite class here, its based on annotations > >> > > > > > > > > > >> > >> > > > > > > > > > >> > >> > > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > https://github.com/sylentprayer/ignite/blob/ignite-530/modules/twitter/src/test/java/org/apache/ignite/stream/twitter/IgniteTwitterStreamerTestSuite.java > >> > > > > > > > > > >> > >> > > > > > > > > > >> No code required in class body. > >> > > > > > > > > > >> > >> > > > > > > > > > >> On Mon, Sep 21, 2015 at 6:24 PM, chandresh > pancholi < > >> > > > > > > > > > >> [hidden email]> wrote: > >> > > > > > > > > > >> > >> > > > > > > > > > >>> Hi Gian/Vishal/Lalit, > >> > > > > > > > > > >>> > >> > > > > > > > > > >>> You guys have worked on Streamer integration with > >> > > Ignite. I > >> > > > > am > >> > > > > > > > > working > >> > > > > > > > > > on > >> > > > > > > > > > >>> Storm-ignite integration. > >> > > > > > > > > > >>> > >> > > > > > > > > > >>> I am setting up setStreamer() and setIgnite() in > >> Test > >> > > class > >> > > > > and > >> > > > > > > > > sending > >> > > > > > > > > > >>> this object to setBolt() method. > >> > > > > > > > > > >>> > >> > > > > > > > > > >>> When i try to read via gettreamer() and > getIgnite() > >> i > >> > am > >> > > > > > getting > >> > > > > > > > > NULL. > >> > > > > > > > > > I > >> > > > > > > > > > >> am > >> > > > > > > > > > >>> trying to find out why is it happening but No > Luck. > >> > > > > > > > > > >>> > >> > > > > > > > > > >>> If any one of you find some time and look into the > >> code > >> > > and > >> > > > > > help > >> > > > > > > me > >> > > > > > > > > to > >> > > > > > > > > > >>> resolve this. It would be great. > >> > > > > > > > > > >>> > >> > > > > > > > > > >>> Git : > https://github.com/chandresh-pancholi/ignite > >> > > > > > > > > > >>> Module : storm > >> > > > > > > > > > >>> > >> > > > > > > > > > >>> -- > >> > > > > > > > > > >>> Chandresh Pancholi > >> > > > > > > > > > >>> Senior Software Engineer > >> > > > > > > > > > >>> Flipkart.com > >> > > > > > > > > > >>> Email-id:[hidden email] > >> > > > > > > > > > >>> Contact:08951803660 > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > -- > >> > > > > > > > > > > Chandresh Pancholi > >> > > > > > > > > > > Senior Software Engineer > >> > > > > > > > > > > Flipkart.com > >> > > > > > > > > > > Email-id:[hidden email] > >> > > > > > > > > > > Contact:08951803660 > >> > > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > -- > >> > > > > > > > > Chandresh Pancholi > >> > > > > > > > > Senior Software Engineer > >> > > > > > > > > Flipkart.com > >> > > > > > > > > Email-id:[hidden email] > >> > > > > > > > > Contact:08951803660 > >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > -- > >> > > > > > > Chandresh Pancholi > >> > > > > > > Senior Software Engineer > >> > > > > > > Flipkart.com > >> > > > > > > Email-id:[hidden email] > >> > > > > > > Contact:08951803660 > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > > >> > > > > >> > > > -- > >> > > > Chandresh Pancholi > >> > > > Senior Software Engineer > >> > > > Flipkart.com > >> > > > Email-id:[hidden email] > >> > > > Contact:08951803660 > >> > > > > >> > > > >> > > >> > > >> > > >> > -- > >> > Chandresh Pancholi > >> > Senior Software Engineer > >> > Flipkart.com > >> > Email-id:[hidden email] > >> > Contact:08951803660 > >> > > >> > > > > > > > > -- > > Chandresh Pancholi > > Senior Software Engineer > > Flipkart.com > > Email-id:[hidden email] > > Contact:08951803660 > > > -- Chandresh Pancholi Senior Software Engineer Flipkart.com Email-id:[hidden email] Contact:08951803660 |
Re: After setting streamer and ignite,getting NULL
|
On Sun, Sep 27, 2015 at 1:36 PM, chandresh pancholi <
[hidden email]> wrote: > Gian, > I have checked the code. It looks good. > Just one little change make it 20 sec. > > /* Topology will run for 10sec */ > Utils.sleep(20000); > Hm... Can someone explain what is this sleep() for? > > > > On Sun, Sep 27, 2015 at 4:30 PM, Gianfranco Murador < > [hidden email]> wrote: > > > Chandresh, we're ready to do a pull request. Look here: > > https://github.com/murador/ignite/tree/IGNITE-429/modules/storm > > > > 2015-09-27 8:49 GMT+02:00 chandresh pancholi < > > [hidden email] > > >: > > > > > Here is the log file. > > > > > > Thanks > > > > > > On Sat, Sep 26, 2015 at 10:40 PM, Gianfranco Murador < > > > [hidden email]> wrote: > > > > > >> Chan, > > >> I can run the test succefully, but sometimes I get this error: > > >> Caused by: class org.apache.ignite.spi.IgniteSpiException: Failed to > add > > >> node to topology because remote node is configured to use loopback > > >> address, > > >> but local node is not (consider changing 'localAddress' configuration > > >> parameter). > > >> > > >> can you send the log file? > > >> Regards, Gianfranco > > >> > > >> > > >> > > >> 2015-09-26 17:13 GMT+02:00 chandresh pancholi < > > >> [hidden email]>: > > >> > > >> > Gian, > > >> > Its still giving "Ouch! Argument cannot be null: streamer" > > >> > > > >> > On Sat, Sep 26, 2015 at 7:24 PM, Gianfranco Murador < > > >> > [hidden email]> wrote: > > >> > > > >> > > Chan, > > >> > > I've fixed some issue, please take a look here: > > >> > > > > >> > > > > >> > > > >> > > > https://github.com/murador/ignite/blob/IGNITE-429/modules/storm/src/test/java/org/apache/ignite/stream/storm/StormIgniteStreamerSelfTest.java > > >> > > > > >> > > 2015-09-26 8:29 GMT+02:00 chandresh pancholi < > > >> > > [hidden email] > > >> > > >: > > >> > > > > >> > > > Gian, > > >> > > > > > >> > > > I have followed instructions given by you. I instantiate > > >> > > IgniteDateStreamer > > >> > > > and ignite in prepare() method of bolt. but getting "*Cache > > doesn't > > >> > > > exist*". > > >> > > > > > >> > > > Code snippet from stormStreamer class in prepare() method > > >> > > > > > >> > > > StormStreamer<String, String, String> stormStreamer = null; > > >> > > > > > >> > > > Ignite ignite = Ignition.start(); > > >> > > > > > >> > > > System.out.println(" ignite ====== "+ignite.toString()); > > >> > > > > > >> > > > try(IgniteDataStreamer<String, String> stmr = > > >> > > > ignite.dataStreamer("cache-0")) { > > >> > > > > > >> > > > stormStreamer = new StormStreamer<>(); > > >> > > > > > >> > > > IgniteCache<String, String> cache = ignite.cache("cache-0"); > > >> > > > > > >> > > > stmr.allowOverwrite(true); > > >> > > > > > >> > > > /* Set ignite instance */ > > >> > > > stormStreamer.setIgnite(ignite); > > >> > > > > > >> > > > /* Set streamer instance */ > > >> > > > stormStreamer.setStreamer(stmr); > > >> > > > > > >> > > > /* set thread count */ > > >> > > > setThreads(5); > > >> > > > > > >> > > > } > > >> > > > > > >> > > > > > >> > > > > > >> > > > On Thu, Sep 24, 2015 at 4:19 PM, Anton Vinogradov < > > >> > > > [hidden email]> > > >> > > > wrote: > > >> > > > > > >> > > > > Chandresh, > > >> > > > > As far as understand IBolt implementation should setup all > > >> external > > >> > > > > connections at .prepare() method. > > >> > > > > So, better way is to get existing Ignite instance or create > new > > at > > >> > > > > .prepare() > > >> > > > > method. > > >> > > > > > > >> > > > > > > >> > > > > On Thu, Sep 24, 2015 at 10:55 AM, Gianfranco Murador < > > >> > > > > [hidden email]> wrote: > > >> > > > > > > >> > > > > > Chandresh, > > >> > > > > > I will launch the unit test later this week , if the problem > > >> > > persists. > > >> > > > I > > >> > > > > > think that you should instantiate Ignite through the start() > > >> method > > >> > > of > > >> > > > > > Ignition class > > >> > > > > > and retrieve the Ignite cache specifying a name for the > > default > > >> > > cache. > > >> > > > > You > > >> > > > > > should provide a name also for data streamer, not passing > > null. > > >> > > > > > Could you do this and run again the unit test ? > > >> > > > > > Thank you, > > >> > > > > > Regards, > > >> > > > > > Gianfranco > > >> > > > > > > > >> > > > > > > > >> > > > > > 2015-09-24 5:40 GMT+02:00 chandresh pancholi < > > >> > > > > > [hidden email] > > >> > > > > > >: > > >> > > > > > > > >> > > > > > > Anton, > > >> > > > > > > > > >> > > > > > > Clone this repo > > https://github.com/chandresh-pancholi/ignite > > >> and > > >> > > run > > >> > > > > > this > > >> > > > > > > class > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > https://github.com/chandresh-pancholi/ignite/blob/master/modules/storm/src/test/java/org/apache/ignite/stream/storm/IgniteStormStreamerSelfTestSuite.java > > >> > > > > > > > > >> > > > > > > You will get the Error saying "Oouch,Argument is Null" for > > >> > > > > getStreamer(). > > >> > > > > > > > > >> > > > > > > On Wed, Sep 23, 2015 at 9:46 PM, Anton Vinogradov < > > >> > > > > > > [hidden email]> > > >> > > > > > > wrote: > > >> > > > > > > > > >> > > > > > > > Chandresh, > > >> > > > > > > > I'm trying to analize problem. > > >> > > > > > > > Could you please provide more details and explain > > >> step-by-step > > >> > > how > > >> > > > > can > > >> > > > > > I > > >> > > > > > > > reproduce problem? > > >> > > > > > > > > > >> > > > > > > > On Tue, Sep 22, 2015 at 11:06 PM, chandresh pancholi < > > >> > > > > > > > [hidden email]> wrote: > > >> > > > > > > > > > >> > > > > > > > > Not yet. > > >> > > > > > > > > Still doing brainstorming why StormStreamer object is > > >> getting > > >> > > > NULLL > > >> > > > > > > > > in-spite setting up ignite and streamer instances. > > >> > > > > > > > > > > >> > > > > > > > > On Tue, Sep 22, 2015 at 7:22 PM, Vishal Garg < > > >> > > [hidden email] > > >> > > > > > > >> > > > > > > wrote: > > >> > > > > > > > > > > >> > > > > > > > > > Did you figure it out? Something related to your > storm > > >> > > > > integration? > > >> > > > > > > > > > Vishal > > >> > > > > > > > > > > > >> > > > > > > > > > Sent from my iPhone > > >> > > > > > > > > > > > >> > > > > > > > > > > On Sep 22, 2015, at 4:50 AM, chandresh pancholi < > > >> > > > > > > > > > [hidden email]> wrote: > > >> > > > > > > > > > > > > >> > > > > > > > > > > Problem here is with Storm. Its making streamer > > object > > >> > null > > >> > > > > once > > >> > > > > > it > > >> > > > > > > > > goes > > >> > > > > > > > > > > into submit topology. > > >> > > > > > > > > > > > > >> > > > > > > > > > > On Mon, Sep 21, 2015 at 7:13 PM, Lalit Kumar Jha < > > >> > > > > > > > [hidden email] > > >> > > > > > > > > > > > >> > > > > > > > > > > wrote: > > >> > > > > > > > > > > > > >> > > > > > > > > > >> Hi Chandresh, > > >> > > > > > > > > > >> > > >> > > > > > > > > > >> See test suite class here, its based on > annotations > > >> > > > > > > > > > >> > > >> > > > > > > > > > >> > > >> > > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > https://github.com/sylentprayer/ignite/blob/ignite-530/modules/twitter/src/test/java/org/apache/ignite/stream/twitter/IgniteTwitterStreamerTestSuite.java > > >> > > > > > > > > > >> > > >> > > > > > > > > > >> No code required in class body. > > >> > > > > > > > > > >> > > >> > > > > > > > > > >> On Mon, Sep 21, 2015 at 6:24 PM, chandresh > > pancholi < > > >> > > > > > > > > > >> [hidden email]> wrote: > > >> > > > > > > > > > >> > > >> > > > > > > > > > >>> Hi Gian/Vishal/Lalit, > > >> > > > > > > > > > >>> > > >> > > > > > > > > > >>> You guys have worked on Streamer integration > with > > >> > > Ignite. I > > >> > > > > am > > >> > > > > > > > > working > > >> > > > > > > > > > on > > >> > > > > > > > > > >>> Storm-ignite integration. > > >> > > > > > > > > > >>> > > >> > > > > > > > > > >>> I am setting up setStreamer() and setIgnite() in > > >> Test > > >> > > class > > >> > > > > and > > >> > > > > > > > > sending > > >> > > > > > > > > > >>> this object to setBolt() method. > > >> > > > > > > > > > >>> > > >> > > > > > > > > > >>> When i try to read via gettreamer() and > > getIgnite() > > >> i > > >> > am > > >> > > > > > getting > > >> > > > > > > > > NULL. > > >> > > > > > > > > > I > > >> > > > > > > > > > >> am > > >> > > > > > > > > > >>> trying to find out why is it happening but No > > Luck. > > >> > > > > > > > > > >>> > > >> > > > > > > > > > >>> If any one of you find some time and look into > the > > >> code > > >> > > and > > >> > > > > > help > > >> > > > > > > me > > >> > > > > > > > > to > > >> > > > > > > > > > >>> resolve this. It would be great. > > >> > > > > > > > > > >>> > > >> > > > > > > > > > >>> Git : > > https://github.com/chandresh-pancholi/ignite > > >> > > > > > > > > > >>> Module : storm > > >> > > > > > > > > > >>> > > >> > > > > > > > > > >>> -- > > >> > > > > > > > > > >>> Chandresh Pancholi > > >> > > > > > > > > > >>> Senior Software Engineer > > >> > > > > > > > > > >>> Flipkart.com > > >> > > > > > > > > > >>> Email-id:[hidden email] > > >> > > > > > > > > > >>> Contact:08951803660 > > >> > > > > > > > > > > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > > >> > > > > > > > > > > -- > > >> > > > > > > > > > > Chandresh Pancholi > > >> > > > > > > > > > > Senior Software Engineer > > >> > > > > > > > > > > Flipkart.com > > >> > > > > > > > > > > Email-id:[hidden email] > > >> > > > > > > > > > > Contact:08951803660 > > >> > > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > -- > > >> > > > > > > > > Chandresh Pancholi > > >> > > > > > > > > Senior Software Engineer > > >> > > > > > > > > Flipkart.com > > >> > > > > > > > > Email-id:[hidden email] > > >> > > > > > > > > Contact:08951803660 > > >> > > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > -- > > >> > > > > > > Chandresh Pancholi > > >> > > > > > > Senior Software Engineer > > >> > > > > > > Flipkart.com > > >> > > > > > > Email-id:[hidden email] > > >> > > > > > > Contact:08951803660 > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > > >> > > > > > >> > > > -- > > >> > > > Chandresh Pancholi > > >> > > > Senior Software Engineer > > >> > > > Flipkart.com > > >> > > > Email-id:[hidden email] > > >> > > > Contact:08951803660 > > >> > > > > > >> > > > > >> > > > >> > > > >> > > > >> > -- > > >> > Chandresh Pancholi > > >> > Senior Software Engineer > > >> > Flipkart.com > > >> > Email-id:[hidden email] > > >> > Contact:08951803660 > > >> > > > >> > > > > > > > > > > > > -- > > > Chandresh Pancholi > > > Senior Software Engineer > > > Flipkart.com > > > Email-id:[hidden email] > > > Contact:08951803660 > > > > > > > > > -- > Chandresh Pancholi > Senior Software Engineer > Flipkart.com > Email-id:[hidden email] > Contact:08951803660 > |
Re: After setting streamer and ignite,getting NULL
|
|
Dmitriy,
In storm, topologies run continuously but in our Unit test we are running them only for 20sec. and this the way to do it in Storm. On Mon, Sep 28, 2015 at 2:08 AM, Dmitriy Setrakyan <[hidden email]> wrote: > On Sun, Sep 27, 2015 at 1:36 PM, chandresh pancholi < > [hidden email]> wrote: > > > Gian, > > I have checked the code. It looks good. > > Just one little change make it 20 sec. > > > > /* Topology will run for 10sec */ > > Utils.sleep(20000); > > > > Hm... Can someone explain what is this sleep() for? > > > > > > > > > > On Sun, Sep 27, 2015 at 4:30 PM, Gianfranco Murador < > > [hidden email]> wrote: > > > > > Chandresh, we're ready to do a pull request. Look here: > > > https://github.com/murador/ignite/tree/IGNITE-429/modules/storm > > > > > > 2015-09-27 8:49 GMT+02:00 chandresh pancholi < > > > [hidden email] > > > >: > > > > > > > Here is the log file. > > > > > > > > Thanks > > > > > > > > On Sat, Sep 26, 2015 at 10:40 PM, Gianfranco Murador < > > > > [hidden email]> wrote: > > > > > > > >> Chan, > > > >> I can run the test succefully, but sometimes I get this error: > > > >> Caused by: class org.apache.ignite.spi.IgniteSpiException: Failed to > > add > > > >> node to topology because remote node is configured to use loopback > > > >> address, > > > >> but local node is not (consider changing 'localAddress' > configuration > > > >> parameter). > > > >> > > > >> can you send the log file? > > > >> Regards, Gianfranco > > > >> > > > >> > > > >> > > > >> 2015-09-26 17:13 GMT+02:00 chandresh pancholi < > > > >> [hidden email]>: > > > >> > > > >> > Gian, > > > >> > Its still giving "Ouch! Argument cannot be null: streamer" > > > >> > > > > >> > On Sat, Sep 26, 2015 at 7:24 PM, Gianfranco Murador < > > > >> > [hidden email]> wrote: > > > >> > > > > >> > > Chan, > > > >> > > I've fixed some issue, please take a look here: > > > >> > > > > > >> > > > > > >> > > > > >> > > > > > > https://github.com/murador/ignite/blob/IGNITE-429/modules/storm/src/test/java/org/apache/ignite/stream/storm/StormIgniteStreamerSelfTest.java > > > >> > > > > > >> > > 2015-09-26 8:29 GMT+02:00 chandresh pancholi < > > > >> > > [hidden email] > > > >> > > >: > > > >> > > > > > >> > > > Gian, > > > >> > > > > > > >> > > > I have followed instructions given by you. I instantiate > > > >> > > IgniteDateStreamer > > > >> > > > and ignite in prepare() method of bolt. but getting "*Cache > > > doesn't > > > >> > > > exist*". > > > >> > > > > > > >> > > > Code snippet from stormStreamer class in prepare() method > > > >> > > > > > > >> > > > StormStreamer<String, String, String> stormStreamer = null; > > > >> > > > > > > >> > > > Ignite ignite = Ignition.start(); > > > >> > > > > > > >> > > > System.out.println(" ignite ====== "+ignite.toString()); > > > >> > > > > > > >> > > > try(IgniteDataStreamer<String, String> stmr = > > > >> > > > ignite.dataStreamer("cache-0")) { > > > >> > > > > > > >> > > > stormStreamer = new StormStreamer<>(); > > > >> > > > > > > >> > > > IgniteCache<String, String> cache = > ignite.cache("cache-0"); > > > >> > > > > > > >> > > > stmr.allowOverwrite(true); > > > >> > > > > > > >> > > > /* Set ignite instance */ > > > >> > > > stormStreamer.setIgnite(ignite); > > > >> > > > > > > >> > > > /* Set streamer instance */ > > > >> > > > stormStreamer.setStreamer(stmr); > > > >> > > > > > > >> > > > /* set thread count */ > > > >> > > > setThreads(5); > > > >> > > > > > > >> > > > } > > > >> > > > > > > >> > > > > > > >> > > > > > > >> > > > On Thu, Sep 24, 2015 at 4:19 PM, Anton Vinogradov < > > > >> > > > [hidden email]> > > > >> > > > wrote: > > > >> > > > > > > >> > > > > Chandresh, > > > >> > > > > As far as understand IBolt implementation should setup all > > > >> external > > > >> > > > > connections at .prepare() method. > > > >> > > > > So, better way is to get existing Ignite instance or create > > new > > > at > > > >> > > > > .prepare() > > > >> > > > > method. > > > >> > > > > > > > >> > > > > > > > >> > > > > On Thu, Sep 24, 2015 at 10:55 AM, Gianfranco Murador < > > > >> > > > > [hidden email]> wrote: > > > >> > > > > > > > >> > > > > > Chandresh, > > > >> > > > > > I will launch the unit test later this week , if the > problem > > > >> > > persists. > > > >> > > > I > > > >> > > > > > think that you should instantiate Ignite through the > start() > > > >> method > > > >> > > of > > > >> > > > > > Ignition class > > > >> > > > > > and retrieve the Ignite cache specifying a name for the > > > default > > > >> > > cache. > > > >> > > > > You > > > >> > > > > > should provide a name also for data streamer, not passing > > > null. > > > >> > > > > > Could you do this and run again the unit test ? > > > >> > > > > > Thank you, > > > >> > > > > > Regards, > > > >> > > > > > Gianfranco > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > 2015-09-24 5:40 GMT+02:00 chandresh pancholi < > > > >> > > > > > [hidden email] > > > >> > > > > > >: > > > >> > > > > > > > > >> > > > > > > Anton, > > > >> > > > > > > > > > >> > > > > > > Clone this repo > > > https://github.com/chandresh-pancholi/ignite > > > >> and > > > >> > > run > > > >> > > > > > this > > > >> > > > > > > class > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > > > > https://github.com/chandresh-pancholi/ignite/blob/master/modules/storm/src/test/java/org/apache/ignite/stream/storm/IgniteStormStreamerSelfTestSuite.java > > > >> > > > > > > > > > >> > > > > > > You will get the Error saying "Oouch,Argument is Null" > for > > > >> > > > > getStreamer(). > > > >> > > > > > > > > > >> > > > > > > On Wed, Sep 23, 2015 at 9:46 PM, Anton Vinogradov < > > > >> > > > > > > [hidden email]> > > > >> > > > > > > wrote: > > > >> > > > > > > > > > >> > > > > > > > Chandresh, > > > >> > > > > > > > I'm trying to analize problem. > > > >> > > > > > > > Could you please provide more details and explain > > > >> step-by-step > > > >> > > how > > > >> > > > > can > > > >> > > > > > I > > > >> > > > > > > > reproduce problem? > > > >> > > > > > > > > > > >> > > > > > > > On Tue, Sep 22, 2015 at 11:06 PM, chandresh pancholi < > > > >> > > > > > > > [hidden email]> wrote: > > > >> > > > > > > > > > > >> > > > > > > > > Not yet. > > > >> > > > > > > > > Still doing brainstorming why StormStreamer object > is > > > >> getting > > > >> > > > NULLL > > > >> > > > > > > > > in-spite setting up ignite and streamer instances. > > > >> > > > > > > > > > > > >> > > > > > > > > On Tue, Sep 22, 2015 at 7:22 PM, Vishal Garg < > > > >> > > [hidden email] > > > >> > > > > > > > >> > > > > > > wrote: > > > >> > > > > > > > > > > > >> > > > > > > > > > Did you figure it out? Something related to your > > storm > > > >> > > > > integration? > > > >> > > > > > > > > > Vishal > > > >> > > > > > > > > > > > > >> > > > > > > > > > Sent from my iPhone > > > >> > > > > > > > > > > > > >> > > > > > > > > > > On Sep 22, 2015, at 4:50 AM, chandresh pancholi > < > > > >> > > > > > > > > > [hidden email]> wrote: > > > >> > > > > > > > > > > > > > >> > > > > > > > > > > Problem here is with Storm. Its making streamer > > > object > > > >> > null > > > >> > > > > once > > > >> > > > > > it > > > >> > > > > > > > > goes > > > >> > > > > > > > > > > into submit topology. > > > >> > > > > > > > > > > > > > >> > > > > > > > > > > On Mon, Sep 21, 2015 at 7:13 PM, Lalit Kumar > Jha < > > > >> > > > > > > > [hidden email] > > > >> > > > > > > > > > > > > >> > > > > > > > > > > wrote: > > > >> > > > > > > > > > > > > > >> > > > > > > > > > >> Hi Chandresh, > > > >> > > > > > > > > > >> > > > >> > > > > > > > > > >> See test suite class here, its based on > > annotations > > > >> > > > > > > > > > >> > > > >> > > > > > > > > > >> > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > > > > https://github.com/sylentprayer/ignite/blob/ignite-530/modules/twitter/src/test/java/org/apache/ignite/stream/twitter/IgniteTwitterStreamerTestSuite.java > > > >> > > > > > > > > > >> > > > >> > > > > > > > > > >> No code required in class body. > > > >> > > > > > > > > > >> > > > >> > > > > > > > > > >> On Mon, Sep 21, 2015 at 6:24 PM, chandresh > > > pancholi < > > > >> > > > > > > > > > >> [hidden email]> wrote: > > > >> > > > > > > > > > >> > > > >> > > > > > > > > > >>> Hi Gian/Vishal/Lalit, > > > >> > > > > > > > > > >>> > > > >> > > > > > > > > > >>> You guys have worked on Streamer integration > > with > > > >> > > Ignite. I > > > >> > > > > am > > > >> > > > > > > > > working > > > >> > > > > > > > > > on > > > >> > > > > > > > > > >>> Storm-ignite integration. > > > >> > > > > > > > > > >>> > > > >> > > > > > > > > > >>> I am setting up setStreamer() and setIgnite() > in > > > >> Test > > > >> > > class > > > >> > > > > and > > > >> > > > > > > > > sending > > > >> > > > > > > > > > >>> this object to setBolt() method. > > > >> > > > > > > > > > >>> > > > >> > > > > > > > > > >>> When i try to read via gettreamer() and > > > getIgnite() > > > >> i > > > >> > am > > > >> > > > > > getting > > > >> > > > > > > > > NULL. > > > >> > > > > > > > > > I > > > >> > > > > > > > > > >> am > > > >> > > > > > > > > > >>> trying to find out why is it happening but No > > > Luck. > > > >> > > > > > > > > > >>> > > > >> > > > > > > > > > >>> If any one of you find some time and look into > > the > > > >> code > > > >> > > and > > > >> > > > > > help > > > >> > > > > > > me > > > >> > > > > > > > > to > > > >> > > > > > > > > > >>> resolve this. It would be great. > > > >> > > > > > > > > > >>> > > > >> > > > > > > > > > >>> Git : > > > https://github.com/chandresh-pancholi/ignite > > > >> > > > > > > > > > >>> Module : storm > > > >> > > > > > > > > > >>> > > > >> > > > > > > > > > >>> -- > > > >> > > > > > > > > > >>> Chandresh Pancholi > > > >> > > > > > > > > > >>> Senior Software Engineer > > > >> > > > > > > > > > >>> Flipkart.com > > > >> > > > > > > > > > >>> Email-id:[hidden email] > > > >> > > > > > > > > > >>> Contact:08951803660 > > > >> > > > > > > > > > > > > > >> > > > > > > > > > > > > > >> > > > > > > > > > > > > > >> > > > > > > > > > > -- > > > >> > > > > > > > > > > Chandresh Pancholi > > > >> > > > > > > > > > > Senior Software Engineer > > > >> > > > > > > > > > > Flipkart.com > > > >> > > > > > > > > > > Email-id:[hidden email] > > > >> > > > > > > > > > > Contact:08951803660 > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > -- > > > >> > > > > > > > > Chandresh Pancholi > > > >> > > > > > > > > Senior Software Engineer > > > >> > > > > > > > > Flipkart.com > > > >> > > > > > > > > Email-id:[hidden email] > > > >> > > > > > > > > Contact:08951803660 > > > >> > > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > -- > > > >> > > > > > > Chandresh Pancholi > > > >> > > > > > > Senior Software Engineer > > > >> > > > > > > Flipkart.com > > > >> > > > > > > Email-id:[hidden email] > > > >> > > > > > > Contact:08951803660 > > > >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > >> > > > -- > > > >> > > > Chandresh Pancholi > > > >> > > > Senior Software Engineer > > > >> > > > Flipkart.com > > > >> > > > Email-id:[hidden email] > > > >> > > > Contact:08951803660 > > > >> > > > > > > >> > > > > > >> > > > > >> > > > > >> > > > > >> > -- > > > >> > Chandresh Pancholi > > > >> > Senior Software Engineer > > > >> > Flipkart.com > > > >> > Email-id:[hidden email] > > > >> > Contact:08951803660 > > > >> > > > > >> > > > > > > > > > > > > > > > > -- > > > > Chandresh Pancholi > > > > Senior Software Engineer > > > > Flipkart.com > > > > Email-id:[hidden email] > > > > Contact:08951803660 > > > > > > > > > > > > > > > -- > > Chandresh Pancholi > > Senior Software Engineer > > Flipkart.com > > Email-id:[hidden email] > > Contact:08951803660 > > > -- Chandresh Pancholi Senior Software Engineer Flipkart.com Email-id:[hidden email] Contact:08951803660 |
Re: After setting streamer and ignite,getting NULL
|
|
On Sun, Sep 27, 2015 at 1:43 PM, chandresh pancholi <
[hidden email]> wrote: > Dmitriy, > In storm, topologies run continuously but in our Unit test we are running > them only for 20sec. and this the way to do it in Storm. > I generally would avoid any sleep() calls at all. If every test in our TeamCity will run for 20 sec, it will take several days for a single run to complete. Can we try to find a way, maybe by listening to some events, to start and stop all necessary topologies only for the duration of the test? > > > On Mon, Sep 28, 2015 at 2:08 AM, Dmitriy Setrakyan <[hidden email]> > wrote: > > > On Sun, Sep 27, 2015 at 1:36 PM, chandresh pancholi < > > [hidden email]> wrote: > > > > > Gian, > > > I have checked the code. It looks good. > > > Just one little change make it 20 sec. > > > > > > /* Topology will run for 10sec */ > > > Utils.sleep(20000); > > > > > > > Hm... Can someone explain what is this sleep() for? > > > > > > > > > > > > > > > > On Sun, Sep 27, 2015 at 4:30 PM, Gianfranco Murador < > > > [hidden email]> wrote: > > > > > > > Chandresh, we're ready to do a pull request. Look here: > > > > https://github.com/murador/ignite/tree/IGNITE-429/modules/storm > > > > > > > > 2015-09-27 8:49 GMT+02:00 chandresh pancholi < > > > > [hidden email] > > > > >: > > > > > > > > > Here is the log file. > > > > > > > > > > Thanks > > > > > > > > > > On Sat, Sep 26, 2015 at 10:40 PM, Gianfranco Murador < > > > > > [hidden email]> wrote: > > > > > > > > > >> Chan, > > > > >> I can run the test succefully, but sometimes I get this error: > > > > >> Caused by: class org.apache.ignite.spi.IgniteSpiException: Failed > to > > > add > > > > >> node to topology because remote node is configured to use loopback > > > > >> address, > > > > >> but local node is not (consider changing 'localAddress' > > configuration > > > > >> parameter). > > > > >> > > > > >> can you send the log file? > > > > >> Regards, Gianfranco > > > > >> > > > > >> > > > > >> > > > > >> 2015-09-26 17:13 GMT+02:00 chandresh pancholi < > > > > >> [hidden email]>: > > > > >> > > > > >> > Gian, > > > > >> > Its still giving "Ouch! Argument cannot be null: streamer" > > > > >> > > > > > >> > On Sat, Sep 26, 2015 at 7:24 PM, Gianfranco Murador < > > > > >> > [hidden email]> wrote: > > > > >> > > > > > >> > > Chan, > > > > >> > > I've fixed some issue, please take a look here: > > > > >> > > > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > https://github.com/murador/ignite/blob/IGNITE-429/modules/storm/src/test/java/org/apache/ignite/stream/storm/StormIgniteStreamerSelfTest.java > > > > >> > > > > > > >> > > 2015-09-26 8:29 GMT+02:00 chandresh pancholi < > > > > >> > > [hidden email] > > > > >> > > >: > > > > >> > > > > > > >> > > > Gian, > > > > >> > > > > > > > >> > > > I have followed instructions given by you. I instantiate > > > > >> > > IgniteDateStreamer > > > > >> > > > and ignite in prepare() method of bolt. but getting "*Cache > > > > doesn't > > > > >> > > > exist*". > > > > >> > > > > > > > >> > > > Code snippet from stormStreamer class in prepare() method > > > > >> > > > > > > > >> > > > StormStreamer<String, String, String> stormStreamer = null; > > > > >> > > > > > > > >> > > > Ignite ignite = Ignition.start(); > > > > >> > > > > > > > >> > > > System.out.println(" ignite ====== "+ignite.toString()); > > > > >> > > > > > > > >> > > > try(IgniteDataStreamer<String, String> stmr = > > > > >> > > > ignite.dataStreamer("cache-0")) { > > > > >> > > > > > > > >> > > > stormStreamer = new StormStreamer<>(); > > > > >> > > > > > > > >> > > > IgniteCache<String, String> cache = > > ignite.cache("cache-0"); > > > > >> > > > > > > > >> > > > stmr.allowOverwrite(true); > > > > >> > > > > > > > >> > > > /* Set ignite instance */ > > > > >> > > > stormStreamer.setIgnite(ignite); > > > > >> > > > > > > > >> > > > /* Set streamer instance */ > > > > >> > > > stormStreamer.setStreamer(stmr); > > > > >> > > > > > > > >> > > > /* set thread count */ > > > > >> > > > setThreads(5); > > > > >> > > > > > > > >> > > > } > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > On Thu, Sep 24, 2015 at 4:19 PM, Anton Vinogradov < > > > > >> > > > [hidden email]> > > > > >> > > > wrote: > > > > >> > > > > > > > >> > > > > Chandresh, > > > > >> > > > > As far as understand IBolt implementation should setup all > > > > >> external > > > > >> > > > > connections at .prepare() method. > > > > >> > > > > So, better way is to get existing Ignite instance or > create > > > new > > > > at > > > > >> > > > > .prepare() > > > > >> > > > > method. > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > On Thu, Sep 24, 2015 at 10:55 AM, Gianfranco Murador < > > > > >> > > > > [hidden email]> wrote: > > > > >> > > > > > > > > >> > > > > > Chandresh, > > > > >> > > > > > I will launch the unit test later this week , if the > > problem > > > > >> > > persists. > > > > >> > > > I > > > > >> > > > > > think that you should instantiate Ignite through the > > start() > > > > >> method > > > > >> > > of > > > > >> > > > > > Ignition class > > > > >> > > > > > and retrieve the Ignite cache specifying a name for the > > > > default > > > > >> > > cache. > > > > >> > > > > You > > > > >> > > > > > should provide a name also for data streamer, not > passing > > > > null. > > > > >> > > > > > Could you do this and run again the unit test ? > > > > >> > > > > > Thank you, > > > > >> > > > > > Regards, > > > > >> > > > > > Gianfranco > > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > 2015-09-24 5:40 GMT+02:00 chandresh pancholi < > > > > >> > > > > > [hidden email] > > > > >> > > > > > >: > > > > >> > > > > > > > > > >> > > > > > > Anton, > > > > >> > > > > > > > > > > >> > > > > > > Clone this repo > > > > https://github.com/chandresh-pancholi/ignite > > > > >> and > > > > >> > > run > > > > >> > > > > > this > > > > >> > > > > > > class > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > https://github.com/chandresh-pancholi/ignite/blob/master/modules/storm/src/test/java/org/apache/ignite/stream/storm/IgniteStormStreamerSelfTestSuite.java > > > > >> > > > > > > > > > > >> > > > > > > You will get the Error saying "Oouch,Argument is Null" > > for > > > > >> > > > > getStreamer(). > > > > >> > > > > > > > > > > >> > > > > > > On Wed, Sep 23, 2015 at 9:46 PM, Anton Vinogradov < > > > > >> > > > > > > [hidden email]> > > > > >> > > > > > > wrote: > > > > >> > > > > > > > > > > >> > > > > > > > Chandresh, > > > > >> > > > > > > > I'm trying to analize problem. > > > > >> > > > > > > > Could you please provide more details and explain > > > > >> step-by-step > > > > >> > > how > > > > >> > > > > can > > > > >> > > > > > I > > > > >> > > > > > > > reproduce problem? > > > > >> > > > > > > > > > > > >> > > > > > > > On Tue, Sep 22, 2015 at 11:06 PM, chandresh > pancholi < > > > > >> > > > > > > > [hidden email]> wrote: > > > > >> > > > > > > > > > > > >> > > > > > > > > Not yet. > > > > >> > > > > > > > > Still doing brainstorming why StormStreamer object > > is > > > > >> getting > > > > >> > > > NULLL > > > > >> > > > > > > > > in-spite setting up ignite and streamer instances. > > > > >> > > > > > > > > > > > > >> > > > > > > > > On Tue, Sep 22, 2015 at 7:22 PM, Vishal Garg < > > > > >> > > [hidden email] > > > > >> > > > > > > > > >> > > > > > > wrote: > > > > >> > > > > > > > > > > > > >> > > > > > > > > > Did you figure it out? Something related to your > > > storm > > > > >> > > > > integration? > > > > >> > > > > > > > > > Vishal > > > > >> > > > > > > > > > > > > > >> > > > > > > > > > Sent from my iPhone > > > > >> > > > > > > > > > > > > > >> > > > > > > > > > > On Sep 22, 2015, at 4:50 AM, chandresh > pancholi > > < > > > > >> > > > > > > > > > [hidden email]> wrote: > > > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > Problem here is with Storm. Its making > streamer > > > > object > > > > >> > null > > > > >> > > > > once > > > > >> > > > > > it > > > > >> > > > > > > > > goes > > > > >> > > > > > > > > > > into submit topology. > > > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > On Mon, Sep 21, 2015 at 7:13 PM, Lalit Kumar > > Jha < > > > > >> > > > > > > > [hidden email] > > > > >> > > > > > > > > > > > > > >> > > > > > > > > > > wrote: > > > > >> > > > > > > > > > > > > > > >> > > > > > > > > > >> Hi Chandresh, > > > > >> > > > > > > > > > >> > > > > >> > > > > > > > > > >> See test suite class here, its based on > > > annotations > > > > >> > > > > > > > > > >> > > > > >> > > > > > > > > > >> > > > > >> > > > > > > > > > > > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > https://github.com/sylentprayer/ignite/blob/ignite-530/modules/twitter/src/test/java/org/apache/ignite/stream/twitter/IgniteTwitterStreamerTestSuite.java > > > > >> > > > > > > > > > >> > > > > >> > > > > > > > > > >> No code required in class body. > > > > >> > > > > > > > > > >> > > > > >> > > > > > > > > > >> On Mon, Sep 21, 2015 at 6:24 PM, chandresh > > > > pancholi < > > > > >> > > > > > > > > > >> [hidden email]> wrote: > > > > >> > > > > > > > > > >> > > > > >> > > > > > > > > > >>> Hi Gian/Vishal/Lalit, > > > > >> > > > > > > > > > >>> > > > > >> > > > > > > > > > >>> You guys have worked on Streamer integration > > > with > > > > >> > > Ignite. I > > > > >> > > > > am > > > > >> > > > > > > > > working > > > > >> > > > > > > > > > on > > > > >> > > > > > > > > > >>> Storm-ignite integration. > > > > >> > > > > > > > > > >>> > > > > >> > > > > > > > > > >>> I am setting up setStreamer() and > setIgnite() > > in > > > > >> Test > > > > >> > > class > > > > >> > > > > and > > > > >> > > > > > > > > sending > > > > >> > > > > > > > > > >>> this object to setBolt() method. > > > > >> > > > > > > > > > >>> > > > > >> > > > > > > > > > >>> When i try to read via gettreamer() and > > > > getIgnite() > > > > >> i > > > > >> > am > > > > >> > > > > > getting > > > > >> > > > > > > > > NULL. > > > > >> > > > > > > > > > I > > > > >> > > > > > > > > > >> am > > > > >> > > > > > > > > > >>> trying to find out why is it happening but > No > > > > Luck. > > > > >> > > > > > > > > > >>> > > > > >> > > > > > > > > > >>> If any one of you find some time and look > into > > > the > > > > >> code > > > > >> > > and > > > > >> > > > > > help > > > > >> > > > > > > me > > > > >> > > > > > > > > to > > > > >> > > > > > > > > > >>> resolve this. It would be great. > > > > >> > > > > > > > > > >>> > > > > >> > > > > > > > > > >>> Git : > > > > https://github.com/chandresh-pancholi/ignite > > > > >> > > > > > > > > > >>> Module : storm > > > > >> > > > > > > > > > >>> > > > > >> > > > > > > > > > >>> -- > > > > >> > > > > > > > > > >>> Chandresh Pancholi > > > > >> > > > > > > > > > >>> Senior Software Engineer > > > > >> > > > > > > > > > >>> Flipkart.com > > > > >> > > > > > > > > > >>> Email-id:[hidden email] > > > > >> > > > > > > > > > >>> Contact:08951803660 > > > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > -- > > > > >> > > > > > > > > > > Chandresh Pancholi > > > > >> > > > > > > > > > > Senior Software Engineer > > > > >> > > > > > > > > > > Flipkart.com > > > > >> > > > > > > > > > > Email-id:[hidden email] > > > > >> > > > > > > > > > > Contact:08951803660 > > > > >> > > > > > > > > > > > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > > >> > > > > > > > > -- > > > > >> > > > > > > > > Chandresh Pancholi > > > > >> > > > > > > > > Senior Software Engineer > > > > >> > > > > > > > > Flipkart.com > > > > >> > > > > > > > > Email-id:[hidden email] > > > > >> > > > > > > > > Contact:08951803660 > > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > -- > > > > >> > > > > > > Chandresh Pancholi > > > > >> > > > > > > Senior Software Engineer > > > > >> > > > > > > Flipkart.com > > > > >> > > > > > > Email-id:[hidden email] > > > > >> > > > > > > Contact:08951803660 > > > > >> > > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > -- > > > > >> > > > Chandresh Pancholi > > > > >> > > > Senior Software Engineer > > > > >> > > > Flipkart.com > > > > >> > > > Email-id:[hidden email] > > > > >> > > > Contact:08951803660 > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > > >> > > > > > >> > -- > > > > >> > Chandresh Pancholi > > > > >> > Senior Software Engineer > > > > >> > Flipkart.com > > > > >> > Email-id:[hidden email] > > > > >> > Contact:08951803660 > > > > >> > > > > > >> > > > > > > > > > > > > > > > > > > > > -- > > > > > Chandresh Pancholi > > > > > Senior Software Engineer > > > > > Flipkart.com > > > > > Email-id:[hidden email] > > > > > Contact:08951803660 > > > > > > > > > > > > > > > > > > > > > -- > > > Chandresh Pancholi > > > Senior Software Engineer > > > Flipkart.com > > > Email-id:[hidden email] > > > Contact:08951803660 > > > > > > > > > -- > Chandresh Pancholi > Senior Software Engineer > Flipkart.com > Email-id:[hidden email] > Contact:08951803660 > |
«
Return to Apache Ignite Developers - Legacy Mail Archive
|
1 view|%1 views
| Free forum by Nabble | Edit this page |