Re: Testing of a fast method to bulk insert a Pandas DataFrame into Postgres

Поиск
Список
Период
Сортировка
От Shaozhong SHI
Тема Re: Testing of a fast method to bulk insert a Pandas DataFrame into Postgres
Дата
Msg-id CA+i5JwYYUG-eLp6HWhJgEtWRRqaitjenj2QDLs2kdsKHRZu9cA@mail.gmail.com
обсуждение исходный текст
Ответ на Re: Testing of a fast method to bulk insert a Pandas DataFrame into Postgres  (Steve Midgley <science@misuse.org>)
Ответы Re: Testing of a fast method to bulk insert a Pandas DataFrame into Postgres  (Steve Midgley <science@misuse.org>)
Список pgsql-sql
Дерево обсуждения
Hello, Steve,

That is interesting.

Send me the link for Python doing "Copy---From....CSV".

I would like to review and test.

Regards,

David

On Mon, 4 Oct 2021 at 18:30, Steve Midgley <science@misuse.org> wrote:


On Mon, Oct 4, 2021 at 8:55 AM Shaozhong SHI <shishaozhong@gmail.com> wrote:
Has anyone tested this one?

I tried psql_insert_copy method, but I got the following error message.

to_sql() got an unexpected keyword argument 'method'

Can anyone shed light on this?

Interesting - I wasn't aware there was a faster method than "COPY ... FROM ... CSV" 

Maybe my best input is that I've always found COPY/FROM/CSV to be insanely fast and really easy to write from any standard console or ORM, so maybe the fractional performance increase from other methods isn't worth it, given how performant, reliable and easy to use this approach is? Not really an answer but food for thought..

Steve

В списке pgsql-sql по дате отправления:

Предыдущее
От: Steve Midgley
Дата:
Сообщение: Re: How to set up temporary path for starting up psql in any folder?
Следующее
От: Steve Midgley
Дата:
Сообщение: Re: Testing of a fast method to bulk insert a Pandas DataFrame into Postgres