Обсуждение: Re: [ADMIN] Best system for a data warehouse application
You could use pg_upgrade utility.
Regards.
De: pgsql-admin-owner@postgresql.org [mailto:pgsql-admin-owner@postgresql.org] En nombre de John Scalia
Enviado el: martes, 21 de febrero de 2017 06:58 p. m.
Para: Yuri Paes Leme
CC: pgsql-admin@postgresql.org
Asunto: Re: [ADMIN] Best system for a data warehouse application
Good to know, We haven't upgraded to 9.6 yet, however, but I'll suggest that for this upgrade.
On Tue, Feb 21, 2017 at 12:46 PM, Yuri Paes Leme <yuripl@gmail.com> wrote:
So, IMHO, if you can use the 9.6.x version, more cores, more power
On Tue, 21 Feb 2017 at 14:39 John Scalia <jayknowsunix@gmail.com> wrote:
Hi all,
One of my system admins has approached me about replacing our production data warehouse system. I believe I know the answer, but would just like more opinions. He's giving me two options so far:
1) CPU = Intel e5-2637 3.5GHz 4 core with hyperthreading
vs.
2) CPU = Intel e5-2650v4 2.2GHz 14 core with hyperthreading
The rest of the specs are identical with 512Gb RAM and more than 2 Tb SSD drives. Our data warehouse is just shy of 2Tb now. I suspect the the first option would be more optimal as I don't think PostgreSQL can make effective use of a lot of processor cores. So fewer cores would be better optimized with the O/S. Can anyone weigh in on whether my assumptions are correct?
--Jay
--
JayThe rest of the specs are identical with 512Gb RAM and more than 2 Tb SSD drives. Our data warehouse is just shy of 2Tb now. I suspect the the first option would be more optimal as I don't think PostgreSQL can make effective use of a lot of processor cores. So fewer cores would be better optimized with the O/S. Can anyone weigh in on whether my assumptions are correct?2) CPU = Intel e5-2650v4 2.2GHz 14 core with hyperthreadingvs.1) CPU = Intel e5-2637 3.5GHz 4 core with hyperthreadingHi all,One of my system admins has approached me about replacing our production data warehouse system. I believe I know the answer, but would just like more opinions. He's giving me two options so far:
--
So, IMHO, if you can use the 9.6.x version, more cores, more powerOn Tue, 21 Feb 2017 at 14:39 John Scalia <jayknowsunix@gmail.com> wrote:JayThe rest of the specs are identical with 512Gb RAM and more than 2 Tb SSD drives. Our data warehouse is just shy of 2Tb now. I suspect the the first option would be more optimal as I don't think PostgreSQL can make effective use of a lot of processor cores. So fewer cores would be better optimized with the O/S. Can anyone weigh in on whether my assumptions are correct?2) CPU = Intel e5-2650v4 2.2GHz 14 core with hyperthreadingvs.1) CPU = Intel e5-2637 3.5GHz 4 core with hyperthreadingHi all,One of my system admins has approached me about replacing our production data warehouse system. I believe I know the answer, but would just like more opinions. He's giving me two options so far:
--
You could use pg_upgrade utility.
Regards.
De: pgsql-admin-owner@postgresql.
org [mailto:pgsql-admin-owner@ postgresql.org] En nombre de John Scalia
Enviado el: martes, 21 de febrero de 2017 06:58 p. m.
Para: Yuri Paes Leme
CC: pgsql-admin@postgresql.org
Asunto: Re: [ADMIN] Best system for a data warehouse application
Good to know, We haven't upgraded to 9.6 yet, however, but I'll suggest that for this upgrade.
On Tue, Feb 21, 2017 at 12:46 PM, Yuri Paes Leme <yuripl@gmail.com> wrote:
So, IMHO, if you can use the 9.6.x version, more cores, more power
On Tue, 21 Feb 2017 at 14:39 John Scalia <jayknowsunix@gmail.com> wrote:
Hi all,
One of my system admins has approached me about replacing our production data warehouse system. I believe I know the answer, but would just like more opinions. He's giving me two options so far:
1) CPU = Intel e5-2637 3.5GHz 4 core with hyperthreading
vs.
2) CPU = Intel e5-2650v4 2.2GHz 14 core with hyperthreading
The rest of the specs are identical with 512Gb RAM and more than 2 Tb SSD drives. Our data warehouse is just shy of 2Tb now. I suspect the the first option would be more optimal as I don't think PostgreSQL can make effective use of a lot of processor cores. So fewer cores would be better optimized with the O/S. Can anyone weigh in on whether my assumptions are correct?
--Jay
JayThe rest of the specs are identical with 512Gb RAM and more than 2 Tb SSD drives. Our data warehouse is just shy of 2Tb now. I suspect the the first option would be more optimal as I don't think PostgreSQL can make effective use of a lot of processor cores. So fewer cores would be better optimized with the O/S. Can anyone weigh in on whether my assumptions are correct?2) CPU = Intel e5-2650v4 2.2GHz 14 core with hyperthreadingvs.1) CPU = Intel e5-2637 3.5GHz 4 core with hyperthreadingHi all,One of my system admins has approached me about replacing our production data warehouse system. I believe I know the answer, but would just like more opinions. He's giving me two options so far:
--
Option 1 is best if you will handle but a few connections to postgres (~<=4), since the higher cpu clock will prevail in this scenario.But if you expect having more than a few simultaneous connections go with option 2 without a doubt.Check how many simultaneous connections your DW system typically uses and go from there. Although more cores would in general be the correct choice, keep in mind that common DW in-database computations will greatly profit from the extra cpu cycles of the 3.5 GHz cpu.Cheers.El 21 feb. 2017 2:39 PM, "John Scalia" <jayknowsunix@gmail.com> escribió:JayThe rest of the specs are identical with 512Gb RAM and more than 2 Tb SSD drives. Our data warehouse is just shy of 2Tb now. I suspect the the first option would be more optimal as I don't think PostgreSQL can make effective use of a lot of processor cores. So fewer cores would be better optimized with the O/S. Can anyone weigh in on whether my assumptions are correct?2) CPU = Intel e5-2650v4 2.2GHz 14 core with hyperthreadingvs.1) CPU = Intel e5-2637 3.5GHz 4 core with hyperthreadingHi all,One of my system admins has approached me about replacing our production data warehouse system. I believe I know the answer, but would just like more opinions. He's giving me two options so far:
--
Well I prefer 1 choice, but first of choose a cpu model, I would check how many concurrent connections use your DW system. Also if you prefer a many-cores cpu, please check some previous errors related with cache line conetention in large numa system:https://www.enterprisedb.com/blog/solving-cache-line- contention-large-numa-systems 2017-02-22 3:15 GMT+01:00 Fernando Hevia <fhevia@gmail.com>:Option 1 is best if you will handle but a few connections to postgres (~<=4), since the higher cpu clock will prevail in this scenario.But if you expect having more than a few simultaneous connections go with option 2 without a doubt.Check how many simultaneous connections your DW system typically uses and go from there. Although more cores would in general be the correct choice, keep in mind that common DW in-database computations will greatly profit from the extra cpu cycles of the 3.5 GHz cpu.Cheers.El 21 feb. 2017 2:39 PM, "John Scalia" <jayknowsunix@gmail.com> escribió:JayThe rest of the specs are identical with 512Gb RAM and more than 2 Tb SSD drives. Our data warehouse is just shy of 2Tb now. I suspect the the first option would be more optimal as I don't think PostgreSQL can make effective use of a lot of processor cores. So fewer cores would be better optimized with the O/S. Can anyone weigh in on whether my assumptions are correct?2) CPU = Intel e5-2650v4 2.2GHz 14 core with hyperthreadingvs.1) CPU = Intel e5-2637 3.5GHz 4 core with hyperthreadingHi all,One of my system admins has approached me about replacing our production data warehouse system. I believe I know the answer, but would just like more opinions. He's giving me two options so far:
--