[d-kernel] OVZ kernel failure
Grigory Batalov
bga на altlinux.org
Вт Мар 6 15:42:18 MSK 2007
Здравствуйте!
Сегодня у нас один ovz-контейнер, собиравший glibc в хэшере, завалил весь
сервер =). Дальше длинный лог.
$ uname -a
Linux gate.spb.altlinux.org 2.6.18-ovz-smp-alt3 #1 SMP Tue Dec 5 22:41:47 MSK 2006 x86_64 GNU/Linux
/var/log/messages :
...
Mar 6 11:12:39 gate kernel: BUG: warning at kernel/rtmutex.c:565/remove_waiter()
Mar 6 11:12:39 gate kernel:
Mar 6 11:12:39 gate kernel: Call Trace:
Mar 6 11:12:39 gate kernel: [dump_stack+18/23] dump_stack+0x12/0x17
Mar 6 11:12:39 gate kernel: [<ffffffff80268074>] dump_stack+0x12/0x17
Mar 6 11:12:39 gate kernel: [rt_mutex_slowlock+1162/1280] rt_mutex_slowlock+0x48a/0x500
Mar 6 11:12:39 gate kernel: [<ffffffff80260b59>] rt_mutex_slowlock+0x48a/0x500
Mar 6 11:12:39 gate kernel: [futex_lock_pi+1467/2306] futex_lock_pi+0x5bb/0x902
Mar 6 11:12:39 gate kernel: [<ffffffff8029f187>] futex_lock_pi+0x5bb/0x902
Mar 6 11:12:39 gate kernel: [do_futex+3008/3065] do_futex+0xbc0/0xbf9
Mar 6 11:12:39 gate kernel: [<ffffffff8023e54e>] do_futex+0xbc0/0xbf9
Mar 6 11:12:39 gate kernel: [sys_futex+259/289] sys_futex+0x103/0x121
Mar 6 11:12:39 gate kernel: [<ffffffff8029f5d1>] sys_futex+0x103/0x121
Mar 6 11:12:39 gate kernel: [system_call+126/131] system_call+0x7e/0x83
Mar 6 11:12:39 gate kernel: [<ffffffff8025bbf2>] system_call+0x7e/0x83
Mar 6 11:12:39 gate kernel: DWARF2 unwinder stuck at system_call+0x7e/0x83
Mar 6 11:12:39 gate kernel: Leftover inexact backtrace:
Mar 6 11:12:39 gate kernel:
Mar 6 11:12:43 gate kernel: BUG: warning at kernel/rtmutex.c:565/remove_waiter()
Mar 6 11:12:43 gate kernel:
Mar 6 11:12:43 gate kernel: Call Trace:
Mar 6 11:12:43 gate kernel: [dump_stack+18/23] dump_stack+0x12/0x17
Mar 6 11:12:43 gate kernel: [<ffffffff80268074>] dump_stack+0x12/0x17
Mar 6 11:12:43 gate kernel: [rt_mutex_slowlock+1162/1280] rt_mutex_slowlock+0x48a/0x500
Mar 6 11:12:43 gate kernel: [<ffffffff80260b59>] rt_mutex_slowlock+0x48a/0x500
Mar 6 11:12:43 gate kernel: [futex_lock_pi+1467/2306] futex_lock_pi+0x5bb/0x902
Mar 6 11:12:43 gate kernel: [<ffffffff8029f187>] futex_lock_pi+0x5bb/0x902
Mar 6 11:12:43 gate kernel: [do_futex+3008/3065] do_futex+0xbc0/0xbf9
Mar 6 11:12:43 gate kernel: [<ffffffff8023e54e>] do_futex+0xbc0/0xbf9
Mar 6 11:12:43 gate kernel: [sys_futex+259/289] sys_futex+0x103/0x121
Mar 6 11:12:43 gate kernel: [<ffffffff8029f5d1>] sys_futex+0x103/0x121
Mar 6 11:12:43 gate kernel: [system_call+126/131] system_call+0x7e/0x83
Mar 6 11:12:43 gate kernel: [<ffffffff8025bbf2>] system_call+0x7e/0x83
Mar 6 11:12:43 gate kernel: DWARF2 unwinder stuck at system_call+0x7e/0x83
Mar 6 11:12:43 gate kernel: Leftover inexact backtrace:
Mar 6 11:12:43 gate kernel:
Mar 6 11:12:48 gate kernel: BUG: warning at kernel/rtmutex.c:565/remove_waiter()
Mar 6 11:12:48 gate kernel:
Mar 6 11:12:48 gate kernel: Call Trace:
Mar 6 11:12:48 gate kernel: [dump_stack+18/23] dump_stack+0x12/0x17
Mar 6 11:12:48 gate kernel: [<ffffffff80268074>] dump_stack+0x12/0x17
Mar 6 11:12:48 gate kernel: [rt_mutex_slowlock+1162/1280] rt_mutex_slowlock+0x48a/0x500
Mar 6 11:12:48 gate kernel: [<ffffffff80260b59>] rt_mutex_slowlock+0x48a/0x500
Mar 6 11:12:48 gate kernel: [futex_lock_pi+1467/2306] futex_lock_pi+0x5bb/0x902
Mar 6 11:12:48 gate kernel: [<ffffffff8029f187>] futex_lock_pi+0x5bb/0x902
Mar 6 11:12:48 gate kernel: [do_futex+3008/3065] do_futex+0xbc0/0xbf9
Mar 6 11:12:48 gate kernel: [<ffffffff8023e54e>] do_futex+0xbc0/0xbf9
Mar 6 11:12:48 gate kernel: [sys_futex+259/289] sys_futex+0x103/0x121
Mar 6 11:12:48 gate kernel: [<ffffffff8029f5d1>] sys_futex+0x103/0x121
Mar 6 11:12:48 gate kernel: [system_call+126/131] system_call+0x7e/0x83
Mar 6 11:12:48 gate kernel: [<ffffffff8025bbf2>] system_call+0x7e/0x83
Mar 6 11:12:48 gate kernel: DWARF2 unwinder stuck at system_call+0x7e/0x83
Mar 6 11:12:48 gate kernel: Leftover inexact backtrace:
Mar 6 11:12:48 gate kernel:
Mar 6 11:16:39 gate kernel: BUG: warning at kernel/rtmutex.c:565/remove_waiter()
Mar 6 11:16:39 gate kernel:
Mar 6 11:16:39 gate kernel: Call Trace:
Mar 6 11:16:39 gate kernel: [dump_stack+18/23] dump_stack+0x12/0x17
Mar 6 11:16:39 gate kernel: [<ffffffff80268074>] dump_stack+0x12/0x17
Mar 6 11:16:39 gate kernel: [rt_mutex_slowlock+1162/1280] rt_mutex_slowlock+0x48a/0x500
Mar 6 11:16:39 gate kernel: [<ffffffff80260b59>] rt_mutex_slowlock+0x48a/0x500
Mar 6 11:16:39 gate kernel: [futex_lock_pi+1467/2306] futex_lock_pi+0x5bb/0x902
Mar 6 11:16:39 gate kernel: [<ffffffff8029f187>] futex_lock_pi+0x5bb/0x902
Mar 6 11:16:39 gate kernel: [do_futex+3008/3065] do_futex+0xbc0/0xbf9
Mar 6 11:16:39 gate kernel: [<ffffffff8023e54e>] do_futex+0xbc0/0xbf9
Mar 6 11:16:39 gate kernel: [sys_futex+259/289] sys_futex+0x103/0x121
Mar 6 11:16:39 gate kernel: [<ffffffff8029f5d1>] sys_futex+0x103/0x121
Mar 6 11:16:39 gate kernel: [system_call+126/131] system_call+0x7e/0x83
Mar 6 11:16:39 gate kernel: [<ffffffff8025bbf2>] system_call+0x7e/0x83
Mar 6 11:16:39 gate kernel: DWARF2 unwinder stuck at system_call+0x7e/0x83
Mar 6 11:16:39 gate kernel: Leftover inexact backtrace:
Mar 6 11:16:39 gate kernel:
Mar 6 11:16:39 gate kernel: ----------- [cut here ] --------- [please bite here ] ---------
Mar 6 11:16:39 gate kernel: Kernel BUG at kernel/sched.c:4997
Mar 6 11:16:39 gate kernel: invalid opcode: 0000 [1] SMP
Mar 6 11:16:39 gate kernel: CPU: 0
Mar 6 11:16:39 gate kernel: Modules linked in: nls_koi8_r isofs nls_base zlib_inflate nfsd exportfs lockd nfs_acl simfs vznetdev vzethdev vzrst vzcpt vzdquota vzmon ipv6 vzdev ipt_ttl ipt_TCPMSS iptable_mangle ipt_tos ipt_REJECT af_packet ac thermal processor button ide_cd cdrom parport_pc parport floppy psmouse pcspkr sunrpc iptable_nat ip_nat ip_conntrack nfnetlink iptable_filter ip_tables x_tables ohci_hcd tg3 usbcore i2c_amd8111 i2c_amd756 i2c_core amd_rng k8temp hwmon sg subfs dm_mod rtc ext3 jbd mbcache arcmsr sata_sil libata sd_mod scsi_mod ide_disk ide_generic amd74xx generic ide_core
Mar 6 11:16:39 gate kernel: Pid: 16431, comm: ld-linux-x86-64 Not tainted 2.6.18-ovz-smp-alt3 #1
Mar 6 11:16:39 gate kernel: RIP: 0060:[rt_mutex_setprio+31/170] [rt_mutex_setprio+31/170] rt_mutex_setprio+0x1f/0xaa
Mar 6 11:16:39 gate kernel: RIP: 0060:[<ffffffff8027d52f>] [<ffffffff8027d52f>] rt_mutex_setprio+0x1f/0xaa
Mar 6 11:16:39 gate kernel: RSP: 0068:ffff81009c5cbb78 EFLAGS: 00010096
Mar 6 11:16:39 gate kernel: RAX: 0000000082224b00 RBX: ffff81007b1103e0 RCX: ffff810029cb5438
Mar 6 11:16:39 gate kernel: RDX: ffff81009c5cbd28 RSI: 0000000082224b00 RDI: ffff81007b1103e0
Mar 6 11:16:39 gate kernel: RBP: ffff81009c5cbbb8 R08: 0000000000004033 R09: 0000000000000000
Mar 6 11:16:39 gate kernel: R10: 0000000000402ac0 R11: ffff810029cb5400 R12: ffff8100f2d022a0
Mar 6 11:16:39 gate kernel: R13: 0000000082224b00 R14: ffffffff8055d1d0 R15: 0000000000000000
Mar 6 11:16:39 gate kernel: FS: 0000000040200940(0033) GS:ffffffff8058d000(0000) knlGS:00000000b7eba6c0
Mar 6 11:16:39 gate kernel: CS: 0060 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 6 11:16:39 gate kernel: CR2: 00002aaaaaab9fa0 CR3: 00000000d78f6000 CR4: 00000000000006e0
Mar 6 11:16:39 gate kernel: Process ld-linux-x86-64 (pid: 16431, veid=107, threadinfo ffff81009c5ca000, task ffff81007b1103e0)
Mar 6 11:16:39 gate kernel: Stack: 0000000000000282 ffffffff8023a142 0000000000000282 ffff8100f2d022a0
Mar 6 11:16:39 gate kernel: ffff8100f2d022a0 ffff810029cb5410 ffffffff8055d1d0 0000000000000000
Mar 6 11:16:39 gate kernel: 0000000000000282 ffffffff802607ee 0000000000000000 0000000100000000
Mar 6 11:16:39 gate kernel: Call Trace:
Mar 6 11:16:39 gate kernel: [rt_mutex_slowlock+287/1280] rt_mutex_slowlock+0x11f/0x500
Mar 6 11:16:39 gate kernel: [<ffffffff802607ee>] rt_mutex_slowlock+0x11f/0x500
Mar 6 11:16:39 gate kernel: [futex_lock_pi+1467/2306] futex_lock_pi+0x5bb/0x902
Mar 6 11:16:39 gate kernel: [<ffffffff8029f187>] futex_lock_pi+0x5bb/0x902
Mar 6 11:16:39 gate kernel: [do_futex+3008/3065] do_futex+0xbc0/0xbf9
Mar 6 11:16:39 gate kernel: [<ffffffff8023e54e>] do_futex+0xbc0/0xbf9
Mar 6 11:16:39 gate kernel: [sys_futex+259/289] sys_futex+0x103/0x121
Mar 6 11:16:39 gate kernel: [<ffffffff8029f5d1>] sys_futex+0x103/0x121
Mar 6 11:16:39 gate kernel: [system_call+126/131] system_call+0x7e/0x83
Mar 6 11:16:39 gate kernel: [<ffffffff8025bbf2>] system_call+0x7e/0x83
Mar 6 11:16:39 gate kernel: DWARF2 unwinder stuck at system_call+0x7e/0x83
Mar 6 11:16:39 gate kernel: Leftover inexact backtrace:
Mar 6 11:16:39 gate kernel:
Mar 6 11:16:39 gate kernel:
Mar 6 11:16:39 gate kernel: Code: 0f 0b 68 4d 0a 40 80 c2 85 13 48 8d 75 d0 48 89 df e8 9f f8
Mar 6 11:16:39 gate kernel: RIP [rt_mutex_setprio+31/170] rt_mutex_setprio+0x1f/0xaa
Mar 6 11:16:39 gate kernel: RIP [<ffffffff8027d52f>] rt_mutex_setprio+0x1f/0xaa
Mar 6 11:16:39 gate kernel: RSP <ffff81009c5cbb78>
Mar 6 11:16:39 gate kernel: Unable to handle kernel NULL pointer dereference at 0000000000000000 RIP:
Mar 6 11:16:39 gate kernel: [plist_add+90/164] plist_add+0x5a/0xa4
Mar 6 11:16:39 gate kernel: [<ffffffff80318ac1>] plist_add+0x5a/0xa4
Mar 6 11:16:39 gate kernel: PGD d2838067 PUD cfccb067 PMD 0
Mar 6 11:16:39 gate kernel: Oops: 0000 [2] SMP
Mar 6 11:16:39 gate kernel: CPU: 1
Mar 6 11:16:39 gate kernel: Modules linked in: nls_koi8_r isofs nls_base zlib_inflate nfsd exportfs lockd nfs_acl simfs vznetdev vzethdev vzrst vzcpt vzdquota vzmon ipv6 vzdev ipt_ttl ipt_TCPMSS iptable_mangle ipt_tos ipt_REJECT af_packet ac thermal processor button ide_cd cdrom parport_pc parport floppy psmouse pcspkr sunrpc iptable_nat ip_nat ip_conntrack nfnetlink iptable_filter ip_tables x_tables ohci_hcd tg3 usbcore i2c_amd8111 i2c_amd756 i2c_core amd_rng k8temp hwmon sg subfs dm_mod rtc ext3 jbd mbcache arcmsr sata_sil libata sd_mod scsi_mod ide_disk ide_generic amd74xx generic ide_core
Mar 6 11:16:39 gate kernel: Pid: 16437, comm: ld-linux-x86-64 Not tainted 2.6.18-ovz-smp-alt3 #1
Mar 6 11:16:39 gate kernel: RIP: 0060:[plist_add+90/164] [plist_add+90/164] plist_add+0x5a/0xa4
Mar 6 11:16:39 gate kernel: RIP: 0060:[<ffffffff80318ac1>] [<ffffffff80318ac1>] plist_add+0x5a/0xa4
Mar 6 11:16:39 gate kernel: RSP: 0068:ffff8100f6569ba8 EFLAGS: 00010017
Mar 6 11:16:39 gate kernel: RAX: fffffffffffffff8 RBX: ffff8100f6569c20 RCX: ffff8100f6569c38
Mar 6 11:16:39 gate kernel: RDX: 0000000000000000 RSI: fffffffffffffff8 RDI: ffff8100f6569c20
Mar 6 11:16:39 gate kernel: RBP: ffff8100f6117278 R08: ffff8100f6569c28 R09: 0000000000000000
Mar 6 11:16:39 gate kernel: R10: 0000000000402ac0 R11: ffff810029cb5e00 R12: ffff8100f6116c10
Mar 6 11:16:39 gate kernel: R13: ffff810029cb5e10 R14: ffff8100f6569bf8 R15: 0000000000000246
Mar 6 11:16:39 gate kernel: FS: 0000000040e06940(0033) GS:ffff810103f1cd80(0000) knlGS:0000000000000000
Mar 6 11:16:39 gate kernel: CS: 0060 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 6 11:16:39 gate kernel: CR2: 0000000000000000 CR3: 00000000d78f6000 CR4: 00000000000006e0
Mar 6 11:16:39 gate kernel: Process ld-linux-x86-64 (pid: 16437, veid=107, threadinfo ffff8100f6568000, task ffff8100fa9f7140)
Mar 6 11:16:39 gate kernel: Stack: ffff810029cb5e10 0000000000000000 ffff8100f6569bf8 ffffffff80260910
Mar 6 11:16:39 gate kernel: 000000000090cbd0 0000000100000000 ffff8100f6569d28 000000010e386a7b
Mar 6 11:16:39 gate kernel: 0000000000000001 0000000000000001 0000000000000086 ffff810029cb5e18
Mar 6 11:16:39 gate kernel: Call Trace:
Mar 6 11:16:39 gate kernel: [rt_mutex_slowlock+577/1280] rt_mutex_slowlock+0x241/0x500
Mar 6 11:16:39 gate kernel: [<ffffffff80260910>] rt_mutex_slowlock+0x241/0x500
Mar 6 11:16:39 gate kernel: [futex_lock_pi+1467/2306] futex_lock_pi+0x5bb/0x902
Mar 6 11:16:39 gate kernel: [<ffffffff8029f187>] futex_lock_pi+0x5bb/0x902
Mar 6 11:16:39 gate kernel: [do_futex+3008/3065] do_futex+0xbc0/0xbf9
Mar 6 11:16:39 gate kernel: [<ffffffff8023e54e>] do_futex+0xbc0/0xbf9
Mar 6 11:16:39 gate kernel: [sys_futex+259/289] sys_futex+0x103/0x121
Mar 6 11:16:39 gate kernel: [<ffffffff8029f5d1>] sys_futex+0x103/0x121
Mar 6 11:16:39 gate kernel: [system_call+126/131] system_call+0x7e/0x83
Mar 6 11:16:39 gate kernel: [<ffffffff8025bbf2>] system_call+0x7e/0x83
Mar 6 11:16:39 gate kernel: DWARF2 unwinder stuck at system_call+0x7e/0x83
Mar 6 11:16:39 gate kernel: Leftover inexact backtrace:
Mar 6 11:16:39 gate kernel:
Mar 6 11:16:39 gate kernel:
Mar 6 11:16:39 gate kernel: Code: 48 8b 56 08 0f 18 0a 48 8d 46 08 48 39 e8 75 dc 48 8d 46 08
Mar 6 11:16:39 gate kernel: RIP [plist_add+90/164] plist_add+0x5a/0xa4
Mar 6 11:16:39 gate kernel: RIP [<ffffffff80318ac1>] plist_add+0x5a/0xa4
Mar 6 11:16:39 gate kernel: RSP <ffff8100f6569ba8>
Mar 6 11:16:39 gate kernel: CR2: 0000000000000000
<перезагрузка>
----------- следущая часть -----------
Было удалено вложение не в текстовом формате...
Имя : отсутствует
Тип : application/pgp-signature
Размер : 189 байтов
Описание: отсутствует
Url : http://lists.altlinux.org/pipermail/devel-kernel/attachments/20070306/48231f55/attachment.bin
Подробная информация о списке рассылки devel-kernel