On 5/22/2016 10:52 PM, aluka raju wrote:
I have data storage in flat files (structured and unstructured) . I want to run sql queries on that , so i am looking in to postgresql how to use fdw on the data that i have. I want to prepare an api for running sql queries for the data in files,so i am trying to have separate postgresql engine and write an wrappper for connecting the data that are in files.
Help me out how can i proceed.
I'm not sure what you're expecting postgres to do for you here... Flat unstructured files have to be read sequentially to do /anything/. even a simple 'select * from someflattable where id=115', it will have to read the whole file to find any and all records with id=115.
If you want to use postgres to query this data efficiently, you really should import this data into postgres tables, properly indexed for the sorts of queries you wish to do.
--
john r pierce, recycling bits in santa cruz