Re: Hi, Friends, are there any ETL tools (free or commercial) available for PostgreSQL?

Поиск
Список
Период
Сортировка
От Tony Theodore
Тема Re: Hi, Friends, are there any ETL tools (free or commercial) available for PostgreSQL?
Дата
Msg-id 4F4D1987-03AF-4A51-813B-994F618A0864@gmail.com
обсуждение исходный текст
Ответ на Re: Hi, Friends, are there any ETL tools (free or commercial) available for PostgreSQL?  (raghu ram <raghuchennuru@gmail.com>)
Ответы Re: Hi, Friends, are there any ETL tools (free or commercial) available for PostgreSQL?  (Tony Theodore <tony.theodore@gmail.com>)
Список pgsql-general

On 09/10/2013, at 8:39 PM, raghu ram <raghuchennuru@gmail.com> wrote:


On Mon, Oct 7, 2013 at 8:32 PM, sunpeng <bluevaley@gmail.com> wrote:
Hi, Friends, are there any ETL tools (free or commercial) available for PostgreSQL?


ETL Tools for PostgreSQL::

Definition: An ETL process data to load into the database from a flat file

A. Extract
B. Transform
C. Load

1. PGLoader -  Load .csv file
2. Benetl 1.8 - Load .txt or .csv or .xls file
3. Talend Open Studio => http://www.talend.com/index.php
4. Pentaho Kettle => http://kettle.pentaho.com/
5. Visual Importer => Data can be imported from flat files,Excel.MS Access,Oracle.Mysql.Interbase,PostgreSQL,oleDB,ODBC and DBF files.

Both [3 &4] of these ETL solutions have a lot of the same types of features:

  • Both are Java based and run on Linux and Windows (Talend is Eclipse-based)
  • Visual designers for creating the transformations
  • Connectivity for a myriad of databases, including all the big DBs, text formats, etc.
  • Supports distributing jobs across multiple servers if you are doing serious lifting
  • Excellent error handling and error notification systems
  • Active and helpful forums (Kettle is older and seems to have a larger community however)
  • Free and open source
  • They are complex enough to handle a lot of tasks, but not so much as to kill you
  • There are versions of both (GeoKettle and Spatial Data Integrator) that are tailored for GIS 

Not exactly an ETL tool, but I've recently felt a sense of liberation since switching to make/python/psql/wget... for my ETL needs. Make is probably the cornerstone as it handles dependencies (think foreign key ordering with schema introspection) and parallel loading in a very intuitive way.

Cheers,

Tony

В списке pgsql-general по дате отправления:

Предыдущее
От: Jesse Long
Дата:
Сообщение: Incorrect index being used
Следующее
От: Tony Theodore
Дата:
Сообщение: Re: Hi, Friends, are there any ETL tools (free or commercial) available for PostgreSQL?