Re: 10K vs 15k rpm for analytics

От: Ing. Marcos Ortiz Valmaseda
Тема: Re: 10K vs 15k rpm for analytics
Дата: ,
Msg-id: 4B965C63.6040305@uci.cu
(см: обсуждение, исходный текст)
Ответ на: Re: 10K vs 15k rpm for analytics  ("Pierre C")
Список: pgsql-performance

Скрыть дерево обсуждения

10K vs 15k rpm for analytics  (Francisco Reyes, )
 Re: 10K vs 15k rpm for analytics  (Yeb Havinga, )
  Re: 10K vs 15k rpm for analytics  (Greg Smith, )
   Re: 10K vs 15k rpm for analytics  (Yeb Havinga, )
    Re: 10K vs 15k rpm for analytics  ("Pierre C", )
  Re: 10K vs 15k rpm for analytics  (Dave Crooke, )
  Re: 10K vs 15k rpm for analytics  (Scott Marlowe, )
   Re: 10K vs 15k rpm for analytics  (Yeb Havinga, )
 Re: 10K vs 15k rpm for analytics  (Scott Marlowe, )
 Re: 10K vs 15k rpm for analytics  (, )
  Re: 10K vs 15k rpm for analytics  (Scott Marlowe, )
   Re: 10K vs 15k rpm for analytics  (Greg Smith, )
    Re: 10K vs 15k rpm for analytics  (Scott Marlowe, )
     Re: 10K vs 15k rpm for analytics  (Greg Smith, )
      Re: 10K vs 15k rpm for analytics  (Scott Marlowe, )
       Re: 10K vs 15k rpm for analytics  (Greg Smith, )
 Re: 10K vs 15k rpm for analytics  (Francisco Reyes, )
  Re: 10K vs 15k rpm for analytics  (Greg Smith, )
  Re: 10K vs 15k rpm for analytics  (Yeb Havinga, )
 Re: 10K vs 15k rpm for analytics  (Francisco Reyes, )
  Re: 10K vs 15k rpm for analytics  (Scott Marlowe, )
   Re: 10K vs 15k rpm for analytics  (, )
    Re: 10K vs 15k rpm for analytics  (Scott Carey, )
     Re: 10K vs 15k rpm for analytics  (Greg Smith, )
      Re: 10K vs 15k rpm for analytics  ("Pierre C", )
       Re: 10K vs 15k rpm for analytics  ("Ing. Marcos Ortiz Valmaseda", )
       Re: 10K vs 15k rpm for analytics  (, )
       Re: 10K vs 15k rpm for analytics  ("Kevin Grittner", )
       Re: 10K vs 15k rpm for analytics  (Michael Stone, )
      Re: 10K vs 15k rpm for analytics  (Scott Carey, )
       Re: 10K vs 15k rpm for analytics  (Scott Carey, )
       Re: 10K vs 15k rpm for analytics  (Greg Smith, )
 Re: 10K vs 15k rpm for analytics  (Francisco Reyes, )
  Re: 10K vs 15k rpm for analytics  (Scott Carey, )
 Re: 10K vs 15k rpm for analytics  (Francisco Reyes, )
 Re: 10K vs 15k rpm for analytics  (Francisco Reyes, )
 Re: 10K vs 15k rpm for analytics  (Francisco Reyes, )
 Re: 10K vs 15k rpm for analytics  (Francisco Reyes, )
 Re: 10K vs 15k rpm for analytics  (Francisco Reyes, )
 Re: 10K vs 15k rpm for analytics  (Greg Smith, )
  Re: 10K vs 15k rpm for analytics  (Scott Marlowe, )
 Re: 10K vs 15k rpm for analytics  (Francisco Reyes, )
  Re: 10K vs 15k rpm for analytics  (Scott Marlowe, )
  Re: 10K vs 15k rpm for analytics  (Greg Smith, )
 Re: 10K vs 15k rpm for analytics  (Francisco Reyes, )
  Re: 10K vs 15k rpm for analytics  (Yeb Havinga, )
 Re: 10K vs 15k rpm for analytics  (Scott Marlowe, )

Pierre C escribió:
> On Tue, 09 Mar 2010 08:00:50 +0100, Greg Smith <>
> wrote:
>
>> Scott Carey wrote:
>>> For high sequential throughput, nothing is as optimized as XFS on
>>> Linux yet.  It has weaknesses elsewhere however.
>>>
>
> When files are extended one page at a time (as postgres does)
> fragmentation can be pretty high on some filesystems (ext3, but NTFS
> is the absolute worst) if several files (indexes + table) grow
> simultaneously. XFS has delayed allocation which really helps.
>
>> I'm curious what you feel those weaknesses are.
>
> Handling lots of small files, especially deleting them, is really slow
> on XFS.
> Databases don't care about that.
>
> There is also the dark side of delayed allocation : if your
> application is broken, it will manifest itself very painfully. Since
> XFS keeps a lot of unwritten stuff in the buffers, an app that doesn't
> fsync correctly can lose lots of data if you don't have a UPS.
>
> Fortunately, postgres handles fsync like it should be.
>
> A word of advice though : a few years ago, we lost a few terabytes on
> XFS (after that, restoring from backup was quite slow !) because a
> faulty SCSI cable crashed the server, then crashed it again during
> xfsrepair. So if you do xfsrepair on a suspicious system, please image
> the disks first.
>
And then Which file system do you recommend for the PostgreSQL data
directory? I was seeying that ZFS brings very cool features for that.
The problem with ZFS is that this file system is only on Solaris,
OpenSolaris, FreeBSD and Mac OSX Server, and on Linux systems not  What
do you think about that?
Regards

--
--------------------------------------------------------
-- Ing. Marcos Luís Ortíz Valmaseda                   --
-- Twitter: http://twitter.com/@marcosluis2186        --
-- FreeBSD Fan/User                                   --
-- http://www.freebsd.org/es                          --
-- Linux User # 418229                                --
-- Database Architect/Administrator                   --
-- PostgreSQL RDBMS                                   --
-- http://www.postgresql.org                          --
-- http://planetpostgresql.org                        --
-- http://www.postgresql-es.org                       --
--------------------------------------------------------
-- Data WareHouse -- Business Intelligence Apprentice --
-- http://www.tdwi.org                                --
--------------------------------------------------------
-- Ruby on Rails Fan/Developer                        --
-- http://rubyonrails.org                             --
--------------------------------------------------------

Comunidad Técnica Cubana de PostgreSQL
http://postgresql.uci.cu
http://personas.grm.uci.cu/+marcos

Centro de Tecnologías de Gestión de Datos (DATEC)
Contacto:
        Correo: 
        Telf: +53 07-837-3737
              +53 07-837-3714
Universidad de las Ciencias Informáticas
http://www.uci.cu





В списке pgsql-performance по дате сообщения:

От: "Kevin Grittner"
Дата:
Сообщение: Re: Deleting Large Objects
От: Scott Carey
Дата:
Сообщение: Re: 10K vs 15k rpm for analytics