
平臺論壇博客文庫

› 論壇 › IT運(yùn)維 › 集群和高可用 › call trace疑問

call trace疑問 [復(fù)制鏈接]

bgsmgrx

白手起家

論壇徽章:: 2

電梯直達(dá)

1樓 [收藏(0)] [報告]

發(fā)表于 2014-03-11 22:57 |只看該作者 |倒序瀏覽

本帖最后由 bgsmgrx 于 2014-03-11 22:58 編輯

不知道有沒有人知道下面的一些call trace信息是有java程序造成的還是集群本身的問題？

Mar 10 11:40:37 nhoaapp01 kernel: INFO: task pdflush:19024 blocked for more than 120 seconds.
Mar 10 11:40:37 nhoaapp01 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar 10 11:40:37 nhoaapp01 kernel: pdflush    D ffffffff80151248    0 19024 211       30452 11161 (L-TLB)
Mar 10 11:40:37 nhoaapp01 kernel:  ffff8102d8685bd0 0000000000000046 0000000000000001 ffff81027ea4e600
Mar 10 11:40:37 nhoaapp01 kernel:  ffff81027ea4cc00 000000000000000a ffff8102174b77a0 ffff810287277080
Mar 10 11:40:37 nhoaapp01 kernel:  002c06179daefc68 000000000000780d ffff8102174b7988 000000057eb17980
Mar 10 11:40:37 nhoaapp01 kernel: Call Trace:
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff881cfb03>] :dm_mod:dm_table_any_congested+0x53/0xa3
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff88555ee7>] :gfs2:just_schedule+0x0/0xe
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff88555ef0>] :gfs2:just_schedule+0x9/0xe
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff80064a16>] __wait_on_bit+0x40/0x6e
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff88555ee7>] :gfs2:just_schedule+0x0/0xe
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff80064ab0>] out_of_line_wait_on_bit+0x6c/0x78
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff800a1bd2>] wake_bit_function+0x0/0x23
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff88555ee2>] :gfs2:gfs2_glock_wait+0x2b/0x30
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff88566269>] :gfs2:gfs2_write_inode+0x5f/0x152
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff88566261>] :gfs2:gfs2_write_inode+0x57/0x152
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff8002ff40>] __writeback_single_inode+0x1e9/0x328
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff80020f16>] sync_sb_inodes+0x1b5/0x26f
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff800a198c>] keventd_create_kthread+0x0/0xc4
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff80051581>] writeback_inodes+0x82/0xd8
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff800ca89b>] wb_kupdate+0xd4/0x14e
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff80056bc0>] pdflush+0x0/0x1fb
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff80056d11>] pdflush+0x151/0x1fb
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff800ca7c7>] wb_kupdate+0x0/0x14e
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff80032bdc>] kthread+0xfe/0x132
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff8005efb1>] child_rip+0xa/0x11
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff800a198c>] keventd_create_kthread+0x0/0xc4
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff80032ade>] kthread+0x0/0x132
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff8005efa7>] child_rip+0x0/0x11
Mar 10 11:40:37 nhoaapp01 kernel:
Mar 10 11:40:37 nhoaapp01 kernel: INFO: task java:28709 blocked for more than 120 seconds.
Mar 10 11:40:37 nhoaapp01 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar 10 11:40:37 nhoaapp01 kernel: java       D ffffffff80151248    0 28709  28609       28710 28708 (NOTLB)
Mar 10 11:40:37 nhoaapp01 kernel:  ffff8102e2f2dc88 0000000000000082 0000000000000018 ffffffff8852a4f3
Mar 10 11:40:37 nhoaapp01 kernel:  0000000000000296 000000000000000a ffff810444c36040 ffff81047fc36080
Mar 10 11:40:37 nhoaapp01 kernel:  002c06140b4512ea 0000000000042b98 ffff810444c36228 0000000d8852be5a
Mar 10 11:40:37 nhoaapp01 kernel: Call Trace:
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff8852a4f3>] :dlm:request_lock+0x93/0xa0
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff88555ee7>] :gfs2:just_schedule+0x0/0xe
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff88555ef0>] :gfs2:just_schedule+0x9/0xe
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff80064a16>] __wait_on_bit+0x40/0x6e
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff88555ee7>] :gfs2:just_schedule+0x0/0xe
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff80064ab0>] out_of_line_wait_on_bit+0x6c/0x78
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff800a1bd2>] wake_bit_function+0x0/0x23
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff88555ee2>] :gfs2:gfs2_glock_wait+0x2b/0x30
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff8856579e>] :gfs2:gfs2_permission+0x83/0xd5
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff88565796>] :gfs2:gfs2_permission+0x7b/0xd5
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff8000d947>] permission+0x81/0xc8
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff80012518>] may_open+0x65/0x22f
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff8001b1c1>] open_namei+0x2c4/0x6d5
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff800274fb>] do_filp_open+0x1c/0x38
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff80019e1e>] do_sys_open+0x44/0xbe
Mar 10 11:40:37 nhoaapp01 kernel:  [<ffffffff8005e28d>] tracesys+0xd5/0xe0