Isn't SQL Streaming mode generic in 2.5?

classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

Isn't SQL Streaming mode generic in 2.5?

dmagda
Vladimir, Alexander P., Igor,

We've documented the streaming mode usage (SET STREAMING ON/OFF) on the
JDBC docs:
https://apacheignite-sql.readme.io/v2.5/docs/jdbc-driver#section-streaming

But my guts feel it it's generic documentation that applies to all our SQL
interfaces and should go as a subpage of DDL section:
https://apacheignite-sql.readme.io/v2.5/docs/ddl

Am I correct?

--
Denis
Reply | Threaded
Open this post in threaded view
|

Re: Isn't SQL Streaming mode generic in 2.5?

Alexander Paschenko
Hi Denis,

Currently there’s no way to do SQL streaming besides ODBC/JDBC - that is,
there’s no other public API for it. I believe this is the first case when
we’re looking at a command that is supported only via drivers and not Java
API, so it’s an interesting question. Also streaming is no DDL, it doesn’t
“define” any data. It could rather be deemed as DML command I think.
That said, I think streaming docs being located at drivers’ section are
fine, but we probably should add links to it from general data load
section. Or maybe move it to an upper level - say, we have separate section
for distributed joins, see no reason why streaming is different in this
respect (it’s also an interesting and important feature that is about both
SQL and Ignite specific details).
Also DDL/DML doc pages are a mess - this one
https://apacheignite-sql.readme.io/docs/ddl says nothing about new user
management commands while this one
https://apacheignite-sql.readme.io/docs/dml contains full set of DDL
commands and not a single DML command (sic!) and doesn’t seem to be overly
confident about its content judging by contradictions between its title and
text (words DML/DDL are mixed). Both links are on main page of SQL docs and
in dropdown menu. DML commands (SELECT, etc) seem to be available only via
dropdown menu at the moment.

Regards,
Alex

ср, 30 мая 2018 г. в 1:28, Denis Magda <[hidden email]>:

> Vladimir, Alexander P., Igor,
>
> We've documented the streaming mode usage (SET STREAMING ON/OFF) on the
> JDBC docs:
> https://apacheignite-sql.readme.io/v2.5/docs/jdbc-driver#section-streaming
>
> But my guts feel it it's generic documentation that applies to all our SQL
> interfaces and should go as a subpage of DDL section:
> https://apacheignite-sql.readme.io/v2.5/docs/ddl
>
> Am I correct?
>
> --
> Denis
>
Reply | Threaded
Open this post in threaded view
|

Re: Isn't SQL Streaming mode generic in 2.5?

dsetrakyan
Alex,

STREAMING command is definitely a DML command. And by the way, the DML page
is not a mess. It documents all DML commands we have. I think you were
looking at something else.

What is the major difficulty of implementing STREAMING command on Ignite
SQL API? It should be even simpler than JDBC as all it should do is
delegate to the actual IgniteDataStreamer and that is it.

I keep repeating that we should stop adding handicapped features that work
only in some cases, but yet this trend continues.

Vladimir, can you comment?

D.

On Wed, May 30, 2018 at 5:30 AM, Alexander Paschenko <
[hidden email]> wrote:

> Hi Denis,
>
> Currently there’s no way to do SQL streaming besides ODBC/JDBC - that is,
> there’s no other public API for it. I believe this is the first case when
> we’re looking at a command that is supported only via drivers and not Java
> API, so it’s an interesting question. Also streaming is no DDL, it doesn’t
> “define” any data. It could rather be deemed as DML command I think.
> That said, I think streaming docs being located at drivers’ section are
> fine, but we probably should add links to it from general data load
> section. Or maybe move it to an upper level - say, we have separate section
> for distributed joins, see no reason why streaming is different in this
> respect (it’s also an interesting and important feature that is about both
> SQL and Ignite specific details).
> Also DDL/DML doc pages are a mess - this one
> https://apacheignite-sql.readme.io/docs/ddl says nothing about new user
> management commands while this one
> https://apacheignite-sql.readme.io/docs/dml contains full set of DDL
> commands and not a single DML command (sic!) and doesn’t seem to be overly
> confident about its content judging by contradictions between its title and
> text (words DML/DDL are mixed). Both links are on main page of SQL docs and
> in dropdown menu. DML commands (SELECT, etc) seem to be available only via
> dropdown menu at the moment.
>
> Regards,
> Alex
>
> ср, 30 мая 2018 г. в 1:28, Denis Magda <[hidden email]>:
>
> > Vladimir, Alexander P., Igor,
> >
> > We've documented the streaming mode usage (SET STREAMING ON/OFF) on the
> > JDBC docs:
> > https://apacheignite-sql.readme.io/v2.5/docs/jdbc-
> driver#section-streaming
> >
> > But my guts feel it it's generic documentation that applies to all our
> SQL
> > interfaces and should go as a subpage of DDL section:
> > https://apacheignite-sql.readme.io/v2.5/docs/ddl
> >
> > Am I correct?
> >
> > --
> > Denis
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: Isn't SQL Streaming mode generic in 2.5?

Igor Sapego-2
By the way, ODBC does not currently support streaming.

Best Regards,
Igor

On Wed, May 30, 2018 at 9:18 AM, Dmitriy Setrakyan <[hidden email]>
wrote:

> Alex,
>
> STREAMING command is definitely a DML command. And by the way, the DML
> page is not a mess. It documents all DML commands we have. I think you were
> looking at something else.
>
> What is the major difficulty of implementing STREAMING command on Ignite
> SQL API? It should be even simpler than JDBC as all it should do is
> delegate to the actual IgniteDataStreamer and that is it.
>
> I keep repeating that we should stop adding handicapped features that work
> only in some cases, but yet this trend continues.
>
> Vladimir, can you comment?
>
> D.
>
> On Wed, May 30, 2018 at 5:30 AM, Alexander Paschenko <
> [hidden email]> wrote:
>
>> Hi Denis,
>>
>> Currently there’s no way to do SQL streaming besides ODBC/JDBC - that is,
>> there’s no other public API for it. I believe this is the first case when
>> we’re looking at a command that is supported only via drivers and not Java
>> API, so it’s an interesting question. Also streaming is no DDL, it doesn’t
>> “define” any data. It could rather be deemed as DML command I think.
>> That said, I think streaming docs being located at drivers’ section are
>> fine, but we probably should add links to it from general data load
>> section. Or maybe move it to an upper level - say, we have separate
>> section
>> for distributed joins, see no reason why streaming is different in this
>> respect (it’s also an interesting and important feature that is about both
>> SQL and Ignite specific details).
>> Also DDL/DML doc pages are a mess - this one
>> https://apacheignite-sql.readme.io/docs/ddl says nothing about new user
>> management commands while this one
>> https://apacheignite-sql.readme.io/docs/dml contains full set of DDL
>> commands and not a single DML command (sic!) and doesn’t seem to be overly
>> confident about its content judging by contradictions between its title
>> and
>> text (words DML/DDL are mixed). Both links are on main page of SQL docs
>> and
>> in dropdown menu. DML commands (SELECT, etc) seem to be available only via
>> dropdown menu at the moment.
>>
>> Regards,
>> Alex
>>
>> ср, 30 мая 2018 г. в 1:28, Denis Magda <[hidden email]>:
>>
>> > Vladimir, Alexander P., Igor,
>> >
>> > We've documented the streaming mode usage (SET STREAMING ON/OFF) on the
>> > JDBC docs:
>> > https://apacheignite-sql.readme.io/v2.5/docs/jdbc-driver#
>> section-streaming
>> >
>> > But my guts feel it it's generic documentation that applies to all our
>> SQL
>> > interfaces and should go as a subpage of DDL section:
>> > https://apacheignite-sql.readme.io/v2.5/docs/ddl
>> >
>> > Am I correct?
>> >
>> > --
>> > Denis
>> >
>>
>
>
Reply | Threaded
Open this post in threaded view
|

Re: Isn't SQL Streaming mode generic in 2.5?

dsetrakyan
On Wed, May 30, 2018 at 5:40 AM, Igor Sapego <[hidden email]> wrote:

> By the way, ODBC does not currently support streaming.
>

Igor, and when do you plan to add this support?
Reply | Threaded
Open this post in threaded view
|

Re: Isn't SQL Streaming mode generic in 2.5?

Igor Sapego
Most probably, when I'm done with the C++ thin client.

Best Regards,
Igor

On Wed, May 30, 2018 at 5:02 PM, Dmitriy Setrakyan <[hidden email]>
wrote:

> On Wed, May 30, 2018 at 5:40 AM, Igor Sapego <[hidden email]> wrote:
>
> > By the way, ODBC does not currently support streaming.
> >
>
> Igor, and when do you plan to add this support?
>
Reply | Threaded
Open this post in threaded view
|

Re: Isn't SQL Streaming mode generic in 2.5?

dsetrakyan
On Wed, May 30, 2018 at 7:36 AM, Igor Sapego <[hidden email]> wrote:

> Most probably, when I'm done with the C++ thin client.
>

Sounds good. Do you have some estimate for when that might be?
Reply | Threaded
Open this post in threaded view
|

Re: Isn't SQL Streaming mode generic in 2.5?

dmagda
I've introduced "Operation Commands" section instead for the commands like
COPY and SET. Borrowed the idea from another DB vendor.

The COPY is already there:
https://apacheignite-sql.readme.io/v2.5/docs/copy

As for SET, here is a ticket to get its documented there rather than in the
JDBC docs:
https://issues.apache.org/jira/browse/IGNITE-8654

--
Denis


On Wed, May 30, 2018 at 2:56 PM, Dmitriy Setrakyan <[hidden email]>
wrote:

> On Wed, May 30, 2018 at 7:36 AM, Igor Sapego <[hidden email]> wrote:
>
> > Most probably, when I'm done with the C++ thin client.
> >
>
> Sounds good. Do you have some estimate for when that might be?
>