Started working on IGNITE-429

classic Classic list List threaded Threaded
9 messages Options
Reply | Threaded
Open this post in threaded view
|

Started working on IGNITE-429

chandresh pancholi
Hi,

I have started working on  https://issues.apache.org/jira/browse/IGNITE-429.
It would be great  If anyone could provide inputs or suggestion on how to
proceed.

--
Chandresh Pancholi
Senior Software Engineer
Flipkart.com
Email-id:[hidden email]
Contact:08951803660
Reply | Threaded
Open this post in threaded view
|

Re: Started working on IGNITE-429

dsetrakyan
Hi Chandresh,

Great to hear that you are starting to work on the Storm integration.
Please take a look at how Kafka integration is done - you should be able to
borrow a lot from it.

https://github.com/apache/incubator-ignite/tree/master/modules/kafka

Once you get familiar, please send additional questions here.

D.

On Tue, Aug 4, 2015 at 12:00 AM, chandresh pancholi <
[hidden email]> wrote:

> Hi,
>
> I have started working on
> https://issues.apache.org/jira/browse/IGNITE-429.
> It would be great  If anyone could provide inputs or suggestion on how to
> proceed.
>
> --
> Chandresh Pancholi
> Senior Software Engineer
> Flipkart.com
> Email-id:[hidden email]
> Contact:08951803660
>
Reply | Threaded
Open this post in threaded view
|

Re: Started working on IGNITE-429

chandresh pancholi
I am planning to include this feature in semester project.
Please let me know if we have other feature related to Integration of
ignite with apache storm.I will include those feature in project and try to
finish as early as possible.

I have other query related to this JIRA issue will ask next time.

Thanks

On Tue, Aug 4, 2015 at 12:49 PM, Dmitriy Setrakyan <[hidden email]>
wrote:

> Hi Chandresh,
>
> Great to hear that you are starting to work on the Storm integration.
> Please take a look at how Kafka integration is done - you should be able to
> borrow a lot from it.
>
> https://github.com/apache/incubator-ignite/tree/master/modules/kafka
>
> Once you get familiar, please send additional questions here.
>
> D.
>
> On Tue, Aug 4, 2015 at 12:00 AM, chandresh pancholi <
> [hidden email]> wrote:
>
> > Hi,
> >
> > I have started working on
> > https://issues.apache.org/jira/browse/IGNITE-429.
> > It would be great  If anyone could provide inputs or suggestion on how to
> > proceed.
> >
> > --
> > Chandresh Pancholi
> > Senior Software Engineer
> > Flipkart.com
> > Email-id:[hidden email]
> > Contact:08951803660
> >
>



--
Chandresh Pancholi
Senior Software Engineer
Flipkart.com
Email-id:[hidden email]
Contact:08951803660
Reply | Threaded
Open this post in threaded view
|

Re: Started working on IGNITE-429

dsetrakyan
Hi Chandresh,

My comments are inline.

D.

On Wed, Aug 5, 2015 at 8:11 AM, chandresh pancholi <
[hidden email]> wrote:

> I am planning to include this feature in semester project.
> Please let me know if we have other feature related to Integration of
> ignite with apache storm.I will include those feature in project and try to
> finish as early as possible.
>

At this moment, I can't think of any other integration work we would need
with Storm.

I have other query related to this JIRA issue will ask next time.
>

Please do. You can either send your questions here, or post them in the
Jira ticket.


> Thanks
>
> On Tue, Aug 4, 2015 at 12:49 PM, Dmitriy Setrakyan <[hidden email]>
> wrote:
>
> > Hi Chandresh,
> >
> > Great to hear that you are starting to work on the Storm integration.
> > Please take a look at how Kafka integration is done - you should be able
> to
> > borrow a lot from it.
> >
> > https://github.com/apache/incubator-ignite/tree/master/modules/kafka
> >
> > Once you get familiar, please send additional questions here.
> >
> > D.
> >
> > On Tue, Aug 4, 2015 at 12:00 AM, chandresh pancholi <
> > [hidden email]> wrote:
> >
> > > Hi,
> > >
> > > I have started working on
> > > https://issues.apache.org/jira/browse/IGNITE-429.
> > > It would be great  If anyone could provide inputs or suggestion on how
> to
> > > proceed.
> > >
> > > --
> > > Chandresh Pancholi
> > > Senior Software Engineer
> > > Flipkart.com
> > > Email-id:[hidden email]
> > > Contact:08951803660
> > >
> >
>
>
>
> --
> Chandresh Pancholi
> Senior Software Engineer
> Flipkart.com
> Email-id:[hidden email]
> Contact:08951803660
>
Reply | Threaded
Open this post in threaded view
|

Re: Started working on IGNITE-429

chandresh pancholi
Hi Igniters,

I am working on IGNITE-429.To implement it  I will create a storm topology
which reads input streams in spouts and bolts put data stream in ignite
cache.

let me know if this is the right approach.

Thanks

On Thu, Aug 6, 2015 at 5:19 AM, Dmitriy Setrakyan <[hidden email]>
wrote:

> Hi Chandresh,
>
> My comments are inline.
>
> D.
>
> On Wed, Aug 5, 2015 at 8:11 AM, chandresh pancholi <
> [hidden email]> wrote:
>
> > I am planning to include this feature in semester project.
> > Please let me know if we have other feature related to Integration of
> > ignite with apache storm.I will include those feature in project and try
> to
> > finish as early as possible.
> >
>
> At this moment, I can't think of any other integration work we would need
> with Storm.
>
> I have other query related to this JIRA issue will ask next time.
> >
>
> Please do. You can either send your questions here, or post them in the
> Jira ticket.
>
>
> > Thanks
> >
> > On Tue, Aug 4, 2015 at 12:49 PM, Dmitriy Setrakyan <
> [hidden email]>
> > wrote:
> >
> > > Hi Chandresh,
> > >
> > > Great to hear that you are starting to work on the Storm integration.
> > > Please take a look at how Kafka integration is done - you should be
> able
> > to
> > > borrow a lot from it.
> > >
> > > https://github.com/apache/incubator-ignite/tree/master/modules/kafka
> > >
> > > Once you get familiar, please send additional questions here.
> > >
> > > D.
> > >
> > > On Tue, Aug 4, 2015 at 12:00 AM, chandresh pancholi <
> > > [hidden email]> wrote:
> > >
> > > > Hi,
> > > >
> > > > I have started working on
> > > > https://issues.apache.org/jira/browse/IGNITE-429.
> > > > It would be great  If anyone could provide inputs or suggestion on
> how
> > to
> > > > proceed.
> > > >
> > > > --
> > > > Chandresh Pancholi
> > > > Senior Software Engineer
> > > > Flipkart.com
> > > > Email-id:[hidden email]
> > > > Contact:08951803660
> > > >
> > >
> >
> >
> >
> > --
> > Chandresh Pancholi
> > Senior Software Engineer
> > Flipkart.com
> > Email-id:[hidden email]
> > Contact:08951803660
> >
>



--
Chandresh Pancholi
Senior Software Engineer
Flipkart.com
Email-id:[hidden email]
Contact:08951803660
Reply | Threaded
Open this post in threaded view
|

Re: Started working on IGNITE-429

Gianfranco Murador
Hello Chandresh,
I think it's the only way to implement an integration with Storm . I had
thought about creating a class that implements the IgniteStormStreamer
interface and IRichBolt interface , be careful to minimize the dependencies
with the jar that you'll  just need to create a bolt in Storm . Let me know
if you need help, I have studied the problem very well.
Regards,
 Gianfranco

2015-08-08 9:10 GMT+02:00 chandresh pancholi <[hidden email]
>:

> Hi Igniters,
>
> I am working on IGNITE-429.To implement it  I will create a storm topology
> which reads input streams in spouts and bolts put data stream in ignite
> cache.
>
> let me know if this is the right approach.
>
> Thanks
>
> On Thu, Aug 6, 2015 at 5:19 AM, Dmitriy Setrakyan <[hidden email]>
> wrote:
>
> > Hi Chandresh,
> >
> > My comments are inline.
> >
> > D.
> >
> > On Wed, Aug 5, 2015 at 8:11 AM, chandresh pancholi <
> > [hidden email]> wrote:
> >
> > > I am planning to include this feature in semester project.
> > > Please let me know if we have other feature related to Integration of
> > > ignite with apache storm.I will include those feature in project and
> try
> > to
> > > finish as early as possible.
> > >
> >
> > At this moment, I can't think of any other integration work we would need
> > with Storm.
> >
> > I have other query related to this JIRA issue will ask next time.
> > >
> >
> > Please do. You can either send your questions here, or post them in the
> > Jira ticket.
> >
> >
> > > Thanks
> > >
> > > On Tue, Aug 4, 2015 at 12:49 PM, Dmitriy Setrakyan <
> > [hidden email]>
> > > wrote:
> > >
> > > > Hi Chandresh,
> > > >
> > > > Great to hear that you are starting to work on the Storm integration.
> > > > Please take a look at how Kafka integration is done - you should be
> > able
> > > to
> > > > borrow a lot from it.
> > > >
> > > > https://github.com/apache/incubator-ignite/tree/master/modules/kafka
> > > >
> > > > Once you get familiar, please send additional questions here.
> > > >
> > > > D.
> > > >
> > > > On Tue, Aug 4, 2015 at 12:00 AM, chandresh pancholi <
> > > > [hidden email]> wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > I have started working on
> > > > > https://issues.apache.org/jira/browse/IGNITE-429.
> > > > > It would be great  If anyone could provide inputs or suggestion on
> > how
> > > to
> > > > > proceed.
> > > > >
> > > > > --
> > > > > Chandresh Pancholi
> > > > > Senior Software Engineer
> > > > > Flipkart.com
> > > > > Email-id:[hidden email]
> > > > > Contact:08951803660
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Chandresh Pancholi
> > > Senior Software Engineer
> > > Flipkart.com
> > > Email-id:[hidden email]
> > > Contact:08951803660
> > >
> >
>
>
>
> --
> Chandresh Pancholi
> Senior Software Engineer
> Flipkart.com
> Email-id:[hidden email]
> Contact:08951803660
>
Reply | Threaded
Open this post in threaded view
|

Re: Started working on IGNITE-429

Gianfranco Murador
 [EDIT : the interface is IgniteDataStreamer

2015-08-08 18:29 GMT+02:00 Gianfranco Murador <[hidden email]>
:

> Hello Chandresh,
> I think it's the only way to implement an integration with Storm . I had
> thought about creating a class that implements the IgniteStormStreamer
> interface and IRichBolt interface , be careful to minimize the dependencies
> with the jar that you'll  just need to create a bolt in Storm . Let me know
> if you need help, I have studied the problem very well.
> Regards,
>  Gianfranco
>
> 2015-08-08 9:10 GMT+02:00 chandresh pancholi <
> [hidden email]>:
>
>> Hi Igniters,
>>
>> I am working on IGNITE-429.To implement it  I will create a storm topology
>> which reads input streams in spouts and bolts put data stream in ignite
>> cache.
>>
>> let me know if this is the right approach.
>>
>> Thanks
>>
>> On Thu, Aug 6, 2015 at 5:19 AM, Dmitriy Setrakyan <[hidden email]>
>> wrote:
>>
>> > Hi Chandresh,
>> >
>> > My comments are inline.
>> >
>> > D.
>> >
>> > On Wed, Aug 5, 2015 at 8:11 AM, chandresh pancholi <
>> > [hidden email]> wrote:
>> >
>> > > I am planning to include this feature in semester project.
>> > > Please let me know if we have other feature related to Integration of
>> > > ignite with apache storm.I will include those feature in project and
>> try
>> > to
>> > > finish as early as possible.
>> > >
>> >
>> > At this moment, I can't think of any other integration work we would
>> need
>> > with Storm.
>> >
>> > I have other query related to this JIRA issue will ask next time.
>> > >
>> >
>> > Please do. You can either send your questions here, or post them in the
>> > Jira ticket.
>> >
>> >
>> > > Thanks
>> > >
>> > > On Tue, Aug 4, 2015 at 12:49 PM, Dmitriy Setrakyan <
>> > [hidden email]>
>> > > wrote:
>> > >
>> > > > Hi Chandresh,
>> > > >
>> > > > Great to hear that you are starting to work on the Storm
>> integration.
>> > > > Please take a look at how Kafka integration is done - you should be
>> > able
>> > > to
>> > > > borrow a lot from it.
>> > > >
>> > > >
>> https://github.com/apache/incubator-ignite/tree/master/modules/kafka
>> > > >
>> > > > Once you get familiar, please send additional questions here.
>> > > >
>> > > > D.
>> > > >
>> > > > On Tue, Aug 4, 2015 at 12:00 AM, chandresh pancholi <
>> > > > [hidden email]> wrote:
>> > > >
>> > > > > Hi,
>> > > > >
>> > > > > I have started working on
>> > > > > https://issues.apache.org/jira/browse/IGNITE-429.
>> > > > > It would be great  If anyone could provide inputs or suggestion on
>> > how
>> > > to
>> > > > > proceed.
>> > > > >
>> > > > > --
>> > > > > Chandresh Pancholi
>> > > > > Senior Software Engineer
>> > > > > Flipkart.com
>> > > > > Email-id:[hidden email]
>> > > > > Contact:08951803660
>> > > > >
>> > > >
>> > >
>> > >
>> > >
>> > > --
>> > > Chandresh Pancholi
>> > > Senior Software Engineer
>> > > Flipkart.com
>> > > Email-id:[hidden email]
>> > > Contact:08951803660
>> > >
>> >
>>
>>
>>
>> --
>> Chandresh Pancholi
>> Senior Software Engineer
>> Flipkart.com
>> Email-id:[hidden email]
>> Contact:08951803660
>>
>
>
Reply | Threaded
Open this post in threaded view
|

Re: Started working on IGNITE-429

chandresh pancholi
Which class is implementing IgniteDataStreamer? i want to see for reference
purpose.



On Sat, Aug 8, 2015 at 10:24 PM, Gianfranco Murador <
[hidden email]> wrote:

>  [EDIT : the interface is IgniteDataStreamer
>
> 2015-08-08 18:29 GMT+02:00 Gianfranco Murador <
> [hidden email]>
> :
>
> > Hello Chandresh,
> > I think it's the only way to implement an integration with Storm . I had
> > thought about creating a class that implements the IgniteStormStreamer
> > interface and IRichBolt interface , be careful to minimize the
> dependencies
> > with the jar that you'll  just need to create a bolt in Storm . Let me
> know
> > if you need help, I have studied the problem very well.
> > Regards,
> >  Gianfranco
> >
> > 2015-08-08 9:10 GMT+02:00 chandresh pancholi <
> > [hidden email]>:
> >
> >> Hi Igniters,
> >>
> >> I am working on IGNITE-429.To implement it  I will create a storm
> topology
> >> which reads input streams in spouts and bolts put data stream in ignite
> >> cache.
> >>
> >> let me know if this is the right approach.
> >>
> >> Thanks
> >>
> >> On Thu, Aug 6, 2015 at 5:19 AM, Dmitriy Setrakyan <
> [hidden email]>
> >> wrote:
> >>
> >> > Hi Chandresh,
> >> >
> >> > My comments are inline.
> >> >
> >> > D.
> >> >
> >> > On Wed, Aug 5, 2015 at 8:11 AM, chandresh pancholi <
> >> > [hidden email]> wrote:
> >> >
> >> > > I am planning to include this feature in semester project.
> >> > > Please let me know if we have other feature related to Integration
> of
> >> > > ignite with apache storm.I will include those feature in project and
> >> try
> >> > to
> >> > > finish as early as possible.
> >> > >
> >> >
> >> > At this moment, I can't think of any other integration work we would
> >> need
> >> > with Storm.
> >> >
> >> > I have other query related to this JIRA issue will ask next time.
> >> > >
> >> >
> >> > Please do. You can either send your questions here, or post them in
> the
> >> > Jira ticket.
> >> >
> >> >
> >> > > Thanks
> >> > >
> >> > > On Tue, Aug 4, 2015 at 12:49 PM, Dmitriy Setrakyan <
> >> > [hidden email]>
> >> > > wrote:
> >> > >
> >> > > > Hi Chandresh,
> >> > > >
> >> > > > Great to hear that you are starting to work on the Storm
> >> integration.
> >> > > > Please take a look at how Kafka integration is done - you should
> be
> >> > able
> >> > > to
> >> > > > borrow a lot from it.
> >> > > >
> >> > > >
> >> https://github.com/apache/incubator-ignite/tree/master/modules/kafka
> >> > > >
> >> > > > Once you get familiar, please send additional questions here.
> >> > > >
> >> > > > D.
> >> > > >
> >> > > > On Tue, Aug 4, 2015 at 12:00 AM, chandresh pancholi <
> >> > > > [hidden email]> wrote:
> >> > > >
> >> > > > > Hi,
> >> > > > >
> >> > > > > I have started working on
> >> > > > > https://issues.apache.org/jira/browse/IGNITE-429.
> >> > > > > It would be great  If anyone could provide inputs or suggestion
> on
> >> > how
> >> > > to
> >> > > > > proceed.
> >> > > > >
> >> > > > > --
> >> > > > > Chandresh Pancholi
> >> > > > > Senior Software Engineer
> >> > > > > Flipkart.com
> >> > > > > Email-id:[hidden email]
> >> > > > > Contact:08951803660
> >> > > > >
> >> > > >
> >> > >
> >> > >
> >> > >
> >> > > --
> >> > > Chandresh Pancholi
> >> > > Senior Software Engineer
> >> > > Flipkart.com
> >> > > Email-id:[hidden email]
> >> > > Contact:08951803660
> >> > >
> >> >
> >>
> >>
> >>
> >> --
> >> Chandresh Pancholi
> >> Senior Software Engineer
> >> Flipkart.com
> >> Email-id:[hidden email]
> >> Contact:08951803660
> >>
> >
> >
>



--
Chandresh Pancholi
Senior Software Engineer
Flipkart.com
Email-id:[hidden email]
Contact:08951803660
Reply | Threaded
Open this post in threaded view
|

Re: Started working on IGNITE-429

Gianfranco Murador-2
You can use also StreamAdapter extention:
https://ignite.incubator.apache.org/releases/1.2.0/javadoc/org/apache/ignite/stream/StreamAdapter.html.
please see the Kafka module implementation
Which class is implementing IgniteDataStreamer? i want to see for reference
purpose.



On Sat, Aug 8, 2015 at 10:24 PM, Gianfranco Murador <
[hidden email]> wrote:

>  [EDIT : the interface is IgniteDataStreamer
>
> 2015-08-08 18:29 GMT+02:00 Gianfranco Murador <
> [hidden email]>
> :
>
> > Hello Chandresh,
> > I think it's the only way to implement an integration with Storm . I had
> > thought about creating a class that implements the IgniteStormStreamer
> > interface and IRichBolt interface , be careful to minimize the
> dependencies
> > with the jar that you'll  just need to create a bolt in Storm . Let me
> know
> > if you need help, I have studied the problem very well.
> > Regards,
> >  Gianfranco
> >
> > 2015-08-08 9:10 GMT+02:00 chandresh pancholi <
> > [hidden email]>:
> >
> >> Hi Igniters,
> >>
> >> I am working on IGNITE-429.To implement it  I will create a storm
> topology
> >> which reads input streams in spouts and bolts put data stream in ignite
> >> cache.
> >>
> >> let me know if this is the right approach.
> >>
> >> Thanks
> >>
> >> On Thu, Aug 6, 2015 at 5:19 AM, Dmitriy Setrakyan <
> [hidden email]>
> >> wrote:
> >>
> >> > Hi Chandresh,
> >> >
> >> > My comments are inline.
> >> >
> >> > D.
> >> >
> >> > On Wed, Aug 5, 2015 at 8:11 AM, chandresh pancholi <
> >> > [hidden email]> wrote:
> >> >
> >> > > I am planning to include this feature in semester project.
> >> > > Please let me know if we have other feature related to Integration
> of
> >> > > ignite with apache storm.I will include those feature in project
and

> >> try
> >> > to
> >> > > finish as early as possible.
> >> > >
> >> >
> >> > At this moment, I can't think of any other integration work we would
> >> need
> >> > with Storm.
> >> >
> >> > I have other query related to this JIRA issue will ask next time.
> >> > >
> >> >
> >> > Please do. You can either send your questions here, or post them in
> the
> >> > Jira ticket.
> >> >
> >> >
> >> > > Thanks
> >> > >
> >> > > On Tue, Aug 4, 2015 at 12:49 PM, Dmitriy Setrakyan <
> >> > [hidden email]>
> >> > > wrote:
> >> > >
> >> > > > Hi Chandresh,
> >> > > >
> >> > > > Great to hear that you are starting to work on the Storm
> >> integration.
> >> > > > Please take a look at how Kafka integration is done - you should
> be
> >> > able
> >> > > to
> >> > > > borrow a lot from it.
> >> > > >
> >> > > >
> >> https://github.com/apache/incubator-ignite/tree/master/modules/kafka
> >> > > >
> >> > > > Once you get familiar, please send additional questions here.
> >> > > >
> >> > > > D.
> >> > > >
> >> > > > On Tue, Aug 4, 2015 at 12:00 AM, chandresh pancholi <
> >> > > > [hidden email]> wrote:
> >> > > >
> >> > > > > Hi,
> >> > > > >
> >> > > > > I have started working on
> >> > > > > https://issues.apache.org/jira/browse/IGNITE-429.
> >> > > > > It would be great  If anyone could provide inputs or suggestion
> on
> >> > how
> >> > > to
> >> > > > > proceed.
> >> > > > >
> >> > > > > --
> >> > > > > Chandresh Pancholi
> >> > > > > Senior Software Engineer
> >> > > > > Flipkart.com
> >> > > > > Email-id:[hidden email]
> >> > > > > Contact:08951803660
> >> > > > >
> >> > > >
> >> > >
> >> > >
> >> > >
> >> > > --
> >> > > Chandresh Pancholi
> >> > > Senior Software Engineer
> >> > > Flipkart.com
> >> > > Email-id:[hidden email]
> >> > > Contact:08951803660
> >> > >
> >> >
> >>
> >>
> >>
> >> --
> >> Chandresh Pancholi
> >> Senior Software Engineer
> >> Flipkart.com
> >> Email-id:[hidden email]
> >> Contact:08951803660
> >>
> >
> >
>



--
Chandresh Pancholi
Senior Software Engineer
Flipkart.com
Email-id:[hidden email]
Contact:08951803660