Обсуждение: Postgres and SUN
Hey,
I am very new in this mailing list and also very new in working with Postgres.
My questions is, is there a recommendation from Postgres about which SUN Machine you should choose when you have a huge Postgres Database.
Cheers thomas
On Dienstag, 1. April 2008 Thomas Bräutigam wrote: > My questions is, is there a recommendation from Postgres about which > SUN Machine you should choose when you have a huge Postgres Database This is like you ask "I fly a lot, which airplane should I choose?". Please provide exact information. What is "huge", which Sun's do you look at. How many transactions per second do you need, how many users, what kind of db, .... Still, even then I don't know if anybody could really help you really. I couldn't, as we don't use any Sun's. :-( mfg zmi -- // Michael Monnerie, Ing.BSc ----- http://it-management.at // Tel: 0676/846 914 666 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: www.keyserver.net Key-ID: 1C1209B4
Вложения
First, please keep the discussion on the mailinglist. On Dienstag, 1. April 2008 Thomas Bräutigam wrote: > What is "huge" > The DB Size is between 500 GB and 2 Terra, mostly over 1 Terra. Over 1 Tera is kinda huge, I'd say :-) > I looked at the Fire V490 > One to three User are necessary > I don't know the exact transacations per second, but the most of the > jobs the database have to do is that we have a high amount of > inserations and deletions in the database. > What do you mean with what kind of Database? If it's an offline like application where you just need to store lots of information to make some statistics, it wouldn't matter too much if a query takes 50 minutes or 60 minutes. If it's like a broker online system a single query should optimally take <1ms ;-) Do you have that db already, and on which hardware. Does it perform well? The best is to have a "normal" machine filled with the data to see if you need more. It can be surprising how many transactions/s a simple AMD dual core with 8GB RAM and a cheap SATA RAID with 16x10krpm WD Raptor disks can handle. Probably you can buy such a test machine, shouldn't cost more than 3000€, and it's good for a first idea how much you need. And if it's too slow, you'll have an estimation of how much more power you need. This can save a *lot* of money, as Sun's aren't the cheapest iron around, so a smaller model probably saves a lot more money than this test machine. mfg zmi -- // Michael Monnerie, Ing.BSc ----- http://it-management.at // Tel: 0676/846 914 666 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: www.keyserver.net Key-ID: 1C1209B4
Вложения
Hi Zmi, Okay thanks for that advice. Sorry its my first day on a mailing list. But do Postgres have a special recommendation which SUN equipment runs perfect with a Postgres Database? A time for a query over 30 seconds I would say is to long. So the machine should be fast enough to handle it in 10-20 Seconds.Price for the Machine doesn’t matter at all. The machine should just fit and can handle this kinda huge database. Cheers Thomas -----Original Message----- From: Michael Monnerie [mailto:michael.monnerie@it-management.at] Sent: Dienstag, 1. April 2008 14:54 To: Thomas Bräutigam Cc: pgsql-admin@postgresql.org Subject: Re: [ADMIN] Postgres and SUN First, please keep the discussion on the mailinglist. On Dienstag, 1. April 2008 Thomas Bräutigam wrote: > What is "huge" > The DB Size is between 500 GB and 2 Terra, mostly over 1 Terra. Over 1 Tera is kinda huge, I'd say :-) > I looked at the Fire V490 > One to three User are necessary > I don't know the exact transacations per second, but the most of the > jobs the database have to do is that we have a high amount of > inserations and deletions in the database. > What do you mean with what kind of Database? If it's an offline like application where you just need to store lots of information to make some statistics, it wouldn'tmatter too much if a query takes 50 minutes or 60 minutes. If it's like a broker online system a single query shouldoptimally take <1ms ;-) Do you have that db already, and on which hardware. Does it perform well? The best is to have a "normal" machine filled withthe data to see if you need more. It can be surprising how many transactions/s a simple AMD dual core with 8GB RAM anda cheap SATA RAID with 16x10krpm WD Raptor disks can handle. Probably you can buy such a test machine, shouldn't costmore than 3000€, and it's good for a first idea how much you need. And if it's too slow, you'll have an estimation ofhow much more power you need. This can save a *lot* of money, as Sun's aren't the cheapest iron around, so a smaller modelprobably saves a lot more money than this test machine. mfg zmi -- // Michael Monnerie, Ing.BSc ----- http://it-management.at // Tel: 0676/846 914 666 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: www.keyserver.net Key-ID: 1C1209B4
On Dienstag, 1. April 2008 Thomas Bräutigam wrote: > Okay thanks for that advice. Sorry its my first day on a mailing > list. No problem. > But do Postgres have a special recommendation which SUN equipment > runs perfect with a Postgres Database? I have nothing to do with postgres (well, I have to admin some servers running it). Maybe other can give hints. Or where you can get paid support/information. > A time for a query over 30 seconds I would say is to long. So the > machine should be fast enough to handle it in 10-20 Seconds. Price > for the Machine doesn’t matter at all. The machine should just fit > and can handle this kinda huge database. Still, we have no idea what kind of data is in there, what the queries would look like etc. I'd say any Sun equipment will be running fine, as it's fine hardware. For the sizing of that machine, I can only suggest running your application on a test server. I'm far from being a specialist for postgresql, but maybe other can help here too. mfg zmi -- // Michael Monnerie, Ing.BSc ----- http://it-management.at // Tel: 0676/846 914 666 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: www.keyserver.net Key-ID: 1C1209B4
Вложения
Thomas, Thomas Bräutigam wrote: > Hi Zmi, > > Okay thanks for that advice. Sorry its my first day on a mailing list. > > But do Postgres have a special recommendation which SUN equipment runs perfect with a Postgres Database? > > A time for a query over 30 seconds I would say is to long. So the machine should be fast enough to handle it in 10-20 Seconds.Price for the Machine doesn’t matter at all. The machine should just fit and can handle this kinda huge database. > Sun has published a benchmark on the Sun Fire T2000 Server and the results are published here http://www.spec.org/jAppServer2004/results/res2007q3/jAppServer2004-20070703-00073.html Jignesh has also done tests on the following AMD and Intel systems, and I believe the results were quite good. http://www.sun.com/servers/entry/x4200/ http://www.sun.com/servers/x64/x4450/ Regards, -Robert
Hi Robert What do you think about the SUN T5120 or T5220 with a Postgres Database? Cheers Thomas -----Original Message----- From: Robert.Lor@Sun.COM [mailto:Robert.Lor@Sun.COM] Sent: Donnerstag, 3. April 2008 19:28 To: Thomas Bräutigam Cc: pgsql-admin@postgresql.org; Jignesh K. Shah Subject: Re: [ADMIN] Postgres and SUN Thomas, Thomas Bräutigam wrote: > Hi Zmi, > > Okay thanks for that advice. Sorry its my first day on a mailing list. > > But do Postgres have a special recommendation which SUN equipment runs perfect with a Postgres Database? > > A time for a query over 30 seconds I would say is to long. So the machine should be fast enough to handle it in 10-20 Seconds.Price for the Machine doesn't matter at all. The machine should just fit and can handle this kinda huge database. > Sun has published a benchmark on the Sun Fire T2000 Server and the results are published here http://www.spec.org/jAppServer2004/results/res2007q3/jAppServer2004-20070703-00073.html Jignesh has also done tests on the following AMD and Intel systems, and I believe the results were quite good. http://www.sun.com/servers/entry/x4200/ http://www.sun.com/servers/x64/x4450/ Regards, -Robert
T5120 and T5220 have 8 cores with 8 threads each resulting in 64 threads. Best way to view this is 64-vcpu server in 1U or 2U size. Experience with PostgreSQL is varied on such boxes: * Setup on such boxes does not use lot of cpus as most utilities only use 1 vcpu at a time and hence can take a while to setup * However after that if you run OLTP or Web 2.0 type queries (small transactions with multiple users) or small reads and sometimes update from thousands of user then this box is great and throughput handled is quite remarkable. * But if you use it for DSS or data warehousing or Long running query with a small number of users, again since each query will use only 1 vcpu the resulting query could take a longer time on this 1.2 to 1.4Ghz cores. I am setting the expectations right. These boxes are great for OLTP, scalability is also great though it depends on the workload. Eventually I have seen that PostgreSQL saturates little before the box saturates but by then you probably end up being one of the big OLTP customers using Postgres handling hundreds to thousands of users:-) -Jignesh Thomas Bräutigam wrote: > Hi Robert > > What do you think about the SUN T5120 or T5220 with a Postgres Database? > > Cheers Thomas > > > -----Original Message----- > From: Robert.Lor@Sun.COM [mailto:Robert.Lor@Sun.COM] > Sent: Donnerstag, 3. April 2008 19:28 > To: Thomas Bräutigam > Cc: pgsql-admin@postgresql.org; Jignesh K. Shah > Subject: Re: [ADMIN] Postgres and SUN > > Thomas, > > Thomas Bräutigam wrote: > >> Hi Zmi, >> >> Okay thanks for that advice. Sorry its my first day on a mailing list. >> >> But do Postgres have a special recommendation which SUN equipment runs perfect with a Postgres Database? >> >> A time for a query over 30 seconds I would say is to long. So the machine should be fast enough to handle it in 10-20Seconds. Price for the Machine doesn't matter at all. The machine should just fit and can handle this kinda huge database. >> >> > Sun has published a benchmark on the Sun Fire T2000 Server and the results are published here http://www.spec.org/jAppServer2004/results/res2007q3/jAppServer2004-20070703-00073.html > > Jignesh has also done tests on the following AMD and Intel systems, and I believe the results were quite good. > > http://www.sun.com/servers/entry/x4200/ > http://www.sun.com/servers/x64/x4450/ > > > Regards, > -Robert > > > > > >
Hi Jignesh, Thanks for this information. Did SUN make any other tests with SUN Machines and Postgres Databases? Cheers Thomas -----Original Message----- From: pgsql-admin-owner@postgresql.org [mailto:pgsql-admin-owner@postgresql.org] On Behalf Of Jignesh K. Shah Sent: Freitag, 4. April 2008 15:14 To: Thomas Bräutigam Cc: Robert.Lor@Sun.COM; pgsql-admin@postgresql.org Subject: Re: [ADMIN] Postgres and SUN T5120 and T5220 have 8 cores with 8 threads each resulting in 64 threads. Best way to view this is 64-vcpu server in 1U or2U size. Experience with PostgreSQL is varied on such boxes: * Setup on such boxes does not use lot of cpus as most utilities only use 1 vcpu at a time and hence can take a while tosetup * However after that if you run OLTP or Web 2.0 type queries (small transactions with multiple users) or small reads andsometimes update from thousands of user then this box is great and throughput handled is quite remarkable. * But if you use it for DSS or data warehousing or Long running query with a small number of users, again since each querywill use only 1 vcpu the resulting query could take a longer time on this 1.2 to 1.4Ghz cores. I am setting the expectations right. These boxes are great for OLTP, scalability is also great though it depends on theworkload. Eventually I have seen that PostgreSQL saturates little before the box saturates but by then you probably endup being one of the big OLTP customers using Postgres handling hundreds to thousands of users:-) -Jignesh Thomas Bräutigam wrote: > Hi Robert > > What do you think about the SUN T5120 or T5220 with a Postgres Database? > > Cheers Thomas > > > -----Original Message----- > From: Robert.Lor@Sun.COM [mailto:Robert.Lor@Sun.COM] > Sent: Donnerstag, 3. April 2008 19:28 > To: Thomas Bräutigam > Cc: pgsql-admin@postgresql.org; Jignesh K. Shah > Subject: Re: [ADMIN] Postgres and SUN > > Thomas, > > Thomas Bräutigam wrote: > >> Hi Zmi, >> >> Okay thanks for that advice. Sorry its my first day on a mailing list. >> >> But do Postgres have a special recommendation which SUN equipment runs perfect with a Postgres Database? >> >> A time for a query over 30 seconds I would say is to long. So the machine should be fast enough to handle it in 10-20Seconds. Price for the Machine doesn't matter at all. The machine should just fit and can handle this kinda huge database. >> >> > Sun has published a benchmark on the Sun Fire T2000 Server and the > results are published here > http://www.spec.org/jAppServer2004/results/res2007q3/jAppServer2004-20 > 070703-00073.html > > Jignesh has also done tests on the following AMD and Intel systems, and I believe the results were quite good. > > http://www.sun.com/servers/entry/x4200/ > http://www.sun.com/servers/x64/x4450/ > > > Regards, > -Robert > > > > > > -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin