Обсуждение: Very large queries with ODBC

I am trying to execute a query that will return 8 million rows. The next
query I will need will return 45 million rows.
I have useDeclareFetch enabled.

I've traced into the ODBC code, and it seems like previous rows are
never discarded. This makes large queries, i.e. ones where you will be
doing bulk processing for OLAP, impossible.

Is this a known bug? (Is it a bug at all or a feature of ODBC?)
Are there, or would there be, plans to correct it?
If so, what is the strategy?

> -----Original Message-----
> From: markw
>
> I am trying to execute a query that will return 8 million rows. The next
> query I will need will return 45 million rows.
> I have useDeclareFetch enabled.
>
> I've traced into the ODBC code, and it seems like previous rows are
> never discarded.

Is it true ?

regards,
Hiroshi Inoue

That's MUCH better.

One suggestion, and maybe I did configure it correctly, but I had to
ODBCINSTDIR to an include file. Using --with-odbcinst=/usr/etc didn't
seem to work.

How much communication do you guys have with the unixODBC people? It
would be cool if there were some way to pick up their settings at either
runtime or comple time.


Hiroshi Inoue wrote:

> Please download the tar ball for *nix provided at
> http://odbc.postgresql.org/
> regards,
> Hiroshi Inoue
> -----Original Message-----
> From: markw [mailto:markw@mohawksoft.com]
>
>
> Hiroshi Inoue wrote:
>
>>-----Original Message-----
>>From: markw [mailto:markw@mohawksoft.com]
>>
>>Hiroshi Inoue wrote:
>>
>>-----Original Message-----
>>From: markw
>>
>>>I am trying to execute a query that will return 8 million rows. The next
>>>query I will need will return 45 million rows.
>>>I have useDeclareFetch enabled.
>>>
>>>I've traced into the ODBC code, and it seems like previous rows are
>>>never discarded.
>>>
>>>Is it true ?
>>>
>>>Which part of it?
>>>
>>>The last part i.e.
>>>   I've traced into the ODBC code, and it seems like previous rows are
>>>   never discarded.
>>>
>>>BTW which source code did you track into ?
>>>Are you looking at
>>>//http://gborg.postgresql.org/project/psqlodbc/projdisplay.php ?
>>>
>     I was looking at the PostgreSQL 7.2.3 standard source.
>

markw wrote:
>
> That's MUCH better.
>
> One suggestion, and maybe I did configure it correctly, but I had to
> ODBCINSTDIR to an include file. Using --with-odbcinst=/usr/etc didn't
> seem to work.

As far as I know --with-odbcinst has no meaing if
--with-unixodbc or --with-iodbc is specified.
If you are looking for the option to specify the
place where sql include files or odbcinst library
exist, there's no such option currently.
Unfortunately I'm not good at autoconf/automake/libtool
issue.

regards,
Hiroshi Inoue
    http://w2422.nsk.ne.jp/~inoue/