Обсуждение: BUG #14223: stuck spinlock detected at bufmgr.c:1440
VGhlIGZvbGxvd2luZyBidWcgaGFzIGJlZW4gbG9nZ2VkIG9uIHRoZSB3ZWJz aXRlOgoKQnVnIHJlZmVyZW5jZTogICAgICAxNDIyMwpMb2dnZWQgYnk6ICAg ICAgICAgIFNjb3R0IE1pbGxpa2VuCkVtYWlsIGFkZHJlc3M6ICAgICAgc2Nv dHRAZGVsdGFleC5jb20KUG9zdGdyZVNRTCB2ZXJzaW9uOiA5LjUuMwpPcGVy YXRpbmcgc3lzdGVtOiAgIExpbnV4IDMuMi4wLTYwLWdlbmVyaWMsIFVidW50 dSAxMi4wNC41IExUUwpEZXNjcmlwdGlvbjogICAgICAgIAoKSSBleHBlcmll bmNlZCBhIFBvc3RncmVTUUwgc2VydmVyIGNyYXNoLCBhbmQgdGhvdWdodCBJ J2Qgc2hhcmUgdGhlIGRldGFpbHMKaW4gY2FzZSBpdCdzIGhlbHBmdWwuDQoN CkVycm9yIG1lc3NhZ2U6DQoyMDE2LTA3LTAxIDEwOjQ1OjI3LjE1NQpQRFQs Inh4eCIsInh4eCIsMjA1NywieHh4eDo1MDUzOSIsNTc3NjViNGUuODA5LDgw LCJJTlNFUlQiLDIwMTYtMDctMDEKMDU6MDA6MTQgUERULDgvNzM5ODkyLDEz NDg4ODY1NCxQQU5JQyxYWDAwMCwic3R1Y2sgc3BpbmxvY2sgKDB4N2Y4ZTFk ODFlMzYwKQpkZXRlY3RlZCBhdCBidWZtZ3IuYzoxNDQwIiwsLCwsLCJJTlNF UlQgSU5UTyAuLi4uIg0KDQpCdWlsZCBkZXRhaWxzDQpWZXJzaW9uOiA5LjUu Mw0KQ29uZmlndXJlIGZsYWdzOiAtLXdpdGgtb3BlbnNzbCAtLXdpdGgtcHl0 aG9uIC0td2l0aC1zZWdzaXplPTE2Ci0td2l0aC1ibG9ja3NpemU9MzIgLS13 aXRoLXdhbC1ibG9ja3NpemU9NjQgLS13aXRoLW9zc3AtdXVpZA0KDQpQb3Rl bnRpYWxseSByZWxldmFudCBHVUNzOg0KZWZmZWN0aXZlX2NhY2hlX3NpemUg PSA0MDBHQg0KZWZmZWN0aXZlX2lvX2NvbmN1cnJlbmN5ID0gMTYNCmZ1bGxf cGFnZV93cml0ZXMgPSBvZmYgKFpGUyBndWFyYW50ZWVzIGNvbnNpc3RlbmN5 KQ0KZHluYW1pY19zaGFyZWRfbWVtb3J5X3R5cGUgPSBwb3NpeA0Kc2hhcmVk X2J1ZmZlcnMgPSAxMkdCDQp0ZW1wX2J1ZmZlcnMgPSA1MTJNQg0Kd2FsX2J1 ZmZlcnMgPSA2NE1CDQp3YWxfa2VlcF9zZWdtZW50cyA9IDMwMDANCndhbF9s ZXZlbCA9IGhvdF9zdGFuZGJ5DQp3YWxfc2VuZGVyX3RpbWVvdXQgPSAwDQp3 b3JrX21lbSA9IDE2R0INCg0KVGhlIHF1ZXJ5IHRoYXQgY2F1c2VkIHRoaXMg Y3Jhc2ggd2FzIGluc2lkZSBhIG5lc3RlZCB0cmFuc2FjdGlvbiwgYW5kIHRv b2sKdGhlIGZvcm06DQpJTlNFUlQgSU5UTyBmb28gU0VMRUNUICogRlJPTSAo U0VMRUNUIFVOTkVTVChBUlJBWVsxLCAyLCAzLCAuLi4uXSkgQVMgaWQpKQpz dWIgV0hFUkUgTk9UIEVYSVNUUyAoU0VMRUNUICogRlJPTSBmb28gV0hFUkUg Zm9vLmlkID0gc3ViLmlkKTsNCihFZmZlY3RpdmVseSBhIGJhdGNoIHVwc2Vy dDsgbm93IHRoYXQgUG9zdGdyZVNRTCBoYXMgdXBzZXJ0IHRoZSBxdWVyeSBj YW4gYmUKcmVmYWN0b3JlZC4pDQoNClRoaXMgcXVlcnkgaGFzIHJ1biBodW5k cmVkcyBvZiB0aG91c2FuZHMgb2YgdGltZXMgb24gdGhpcyBwYXJ0aWN1bGFy CmRhdGFiYXNlIHN1Y2Nlc3NmdWxseTsgdGhpcyBpcyB0aGUgZmlyc3QgaW5z dGFuY2Ugb2YgdGhpcyBlcnJvciB0aGF0IGhhcwpvY2N1cmVkLg0KDQpUaGlz IGlzc3VlIGlzbid0IHVyZ2VudCBmb3IgbWUgYW5kIEkgaGF2ZSBubyB3YXkg dG8gcmVwcm9kdWNlIGl0LCBidXQgZmlndXJlCml0IHdvdWxkbid0IGh1cnQg dG8gc2hhcmUuIEl0IG1heSBiZSByZWxhdGl2ZWx5IHVuaXF1ZSB0byBtZSBi ZWNhdXNlIGl0CnJlbGF0ZXMgdG8gc2hhcmVkIGJ1ZmZlcnMsIHdoaWNoIEkg aGF2ZSBzZXQgYXQgdGhlIG5vbi1kZWZhdWx0IDMyayAoc2F2ZXMKfjMwJSBz aXplIG9uIGRpc2ssIGltcHJvdmVzIGJhdGNoIHRocm91Z2hwdXQpLgoK
Hi, On 2016-07-01 20:22:34 +0000, scott@deltaex.com wrote: > The following bug has been logged on the website: > > Bug reference: 14223 > Logged by: Scott Milliken > Email address: scott@deltaex.com > PostgreSQL version: 9.5.3 > Operating system: Linux 3.2.0-60-generic, Ubuntu 12.04.5 LTS > Description: > > I experienced a PostgreSQL server crash, and thought I'd share the details > in case it's helpful. > > Error message: > 2016-07-01 10:45:27.155 > PDT,"xxx","xxx",2057,"xxxx:50539",57765b4e.809,80,"INSERT",2016-07-01 > 05:00:14 PDT,8/739892,134888654,PANIC,XX000,"stuck spinlock (0x7f8e1d81e360) > detected at bufmgr.c:1440",,,,,,"INSERT INTO ...." Hm. Interesting. > full_page_writes = off (ZFS guarantees consistency) I don't believe that's actually true, but it's surely unrelated to this issue. > This query has run hundreds of thousands of times on this particular > database successfully; this is the first instance of this error that has > occured. Hm. Do you happen to have system statistics (load, user cpu, sys cpu) available by any chance? > This issue isn't urgent for me and I have no way to reproduce it, but figure > it wouldn't hurt to share. That's helpful! Andres
scott@deltaex.com wrote: > I experienced a PostgreSQL server crash, and thought I'd share the details > in case it's helpful. FWIW https://www.postgresql.org/message-id/DF53FBB6-81A2-4423-A0CD-822536F97E26@thebuild.com (this one appears fixed) https://www.postgresql.org/message-id/AANLkTin6WgLj5yMHMnUBCCvxUM-NLaPAj1A5zp6_v1Cz@mail.gmail.com https://www.postgresql.org/message-id/20150810204319.2695.22673@wrigleys.postgresql.org https://www.postgresql.org/message-id/20160127203119.2537.78623@wrigleys.postgresql.org -- Álvaro Herrera http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services
Hi, On 2016-07-01 20:22:34 +0000, scott@deltaex.com wrote: > The following bug has been logged on the website: > > Bug reference: 14223 > Logged by: Scott Milliken > Email address: scott@deltaex.com > PostgreSQL version: 9.5.3 > Operating system: Linux 3.2.0-60-generic, Ubuntu 12.04.5 LTS Given that the kernel is so old, two likely causes are transparent hugepages, and zone_reclaim_mode. Both have to be disabled on older kernels (the latter is disabled by default these days). Greetings, Andres Freund