i/o error

wwszadu

環(huán)境：
BL25P兩臺(tái)（雙端口光纖通道適配器）
MSA1000（雙控制器）
2/16san交換機(jī)兩臺(tái)
redhatas4(2.6.9-34-ELsmp)
redhat cluster suite u3
HBA信息：

主機(jī)1

firmware: 3.03.18 IPX
driver: 8.01.02-d4

主機(jī)2

firmware: 3.03.11 IPX
driver: 8.00.02-fo

問題：
安裝了PSP包后，配置一下FCA2214，把failover的功能，選擇為QLogicFailover。用ACU工具在MSA1000上劃了兩個(gè)邏輯卷分別映射兩臺(tái)主機(jī)。重啟機(jī)器后，其中一臺(tái)機(jī)器會(huì)報(bào)一下錯(cuò)誤：
i/O error on device sdc, logical block 66
Buffer I/O error on device sdc, logical block 67
Buffer I/O error on device sdc, logical block 68
Buffer I/O error on device sdc, logical block 69
Buffer I/O error on device sdc, logical block 70
Buffer I/O error on device sdc, logical block 71
Device sdc not ready.
end_request: I/O error, dev sdc, sector 512
Buffer I/O error on device sdc, logical block 64
802.1Q VLAN Support v1.8 Ben Greear <greearb@candelatech.com>
All bugs added by David S. Miller <davem@redhat.com>
mtrr: type mismatch for f6000000,800000 old: uncachable new: write-combining
mtrr: type mismatch for f6000000,800000 old: uncachable new: write-combining
NET: Unregistered protocol family 30
Device sdc not ready.
end_request: I/O error, dev sdc, sector 0
Buffer I/O error on device sdc, logical block 0
Device sdc not ready.
end_request: I/O error, dev sdc, sector 0
Buffer I/O error on device sdc, logical block 0
Device sdd not ready.
end_request: I/O error, dev sdd, sector 0
Buffer I/O error on device sdd, logical block 0
Device sdd not ready.
end_request: I/O error, dev sdd, sector 0
Buffer I/O error on device sdd, logical block 0
Device sdc not ready.
end_request: I/O error, dev sdc, sector 0
Buffer I/O error on device sdc, logical block 0
Buffer I/O error on device sdc, logical block 1
Buffer I/O error on device sdc, logical block 2
Buffer I/O error on device sdc, logical block 3
Buffer I/O error on device sdc, logical block 4
Buffer I/O error on device sdc, logical block 5
Buffer I/O error on device sdc, logical block 6
Buffer I/O error on device sdc, logical block 7
Buffer I/O error on device sdc, logical block 8
Buffer I/O error on device sdc, logical block 9
Buffer I/O error on device sdc, logical block 10
Buffer I/O error on device sdc, logical block 11
Buffer I/O error on device sdc, logical block 12
Buffer I/O error on device sdc, logical block 13
Buffer I/O error on device sdc, logical block 14
Buffer I/O error on device sdc, logical block 15
Device sdc not ready.
end_request: I/O error, dev sdc, sector 0
Buffer I/O error on device sdc, logical block 0
Device sdc not ready.
end_request: I/O error, dev sdc, sector 0
Buffer I/O error on device sdc, logical block 0
Device sdc not ready.
end_request: I/O error, dev sdc, sector 0
Buffer I/O error on device sdc, logical block 0
Device sdc not ready.
end_request: I/O error, dev sdc, sector 96255352
Buffer I/O error on device sdc, logical block 12031919
Device sdc not ready.
end_request: I/O error, dev sdc, sector 96255352
Buffer I/O error on device sdc, logical block 12031919
Device sdc not ready.
end_request: I/O error, dev sdc, sector 0
Buffer I/O error on device sdc, logical block 0
Device sdc not ready.
end_request: I/O error, dev sdc, sector 0
Buffer I/O error on device sdc, logical block 0
Device sdc not ready.
end_request: I/O error, dev sdc, sector 0
Buffer I/O error on device sdc, logical block 0
Device sdc not ready.
end_request: I/O error, dev sdc, sector 0
Buffer I/O error on device sdc, logical block 0
Device sdc not ready.
end_request: I/O error, dev sdc, sector 0
Buffer I/O error on device sdc, logical block 0
Device sdd not ready.
end_request: I/O error, dev sdd, sector 0
Buffer I/O error on device sdd, logical block 0
Buffer I/O error on device sdd, logical block 1
Buffer I/O error on device sdd, logical block 2
Buffer I/O error on device sdd, logical block 3
Buffer I/O error on device sdd, logical block 4
Buffer I/O error on device sdd, logical block 5
Buffer I/O error on device sdd, logical block 6
Buffer I/O error on device sdd, logical block 7
Buffer I/O error on device sdd, logical block 8
Buffer I/O error on device sdd, logical block 9
Buffer I/O error on device sdd, logical block 10
Buffer I/O error on device sdd, logical block 11
Buffer I/O error on device sdd, logical block 12
Buffer I/O error on device sdd, logical block 13
Buffer I/O error on device sdd, logical block 14
Buffer I/O error on device sdd, logical block 15
Device sdd not ready.
end_request: I/O error, dev sdd, sector 0
Buffer I/O error on device sdd, logical block 0
Device sdd not ready.
end_request: I/O error, dev sdd, sector 0
Buffer I/O error on device sdd, logical block 0
Device sdd not ready.
end_request: I/O error, dev sdd, sector 0
Buffer I/O error on device sdd, logical block 0
Device sdd not ready.
end_request: I/O error, dev sdd, sector 88168792
Buffer I/O error on device sdd, logical block 11021099
Device sdd not ready.
end_request: I/O error, dev sdd, sector 88168792
Buffer I/O error on device sdd, logical block 11021099
Device sdd not ready.
end_request: I/O error, dev sdd, sector 0
Buffer I/O error on device sdd, logical block 0
Device sdd not ready.
end_request: I/O error, dev sdd, sector 0
Buffer I/O error on device sdd, logical block 0
Device sdd not ready.
end_request: I/O error, dev sdd, sector 0
Buffer I/O error on device sdd, logical block 0
Device sdd not ready.
end_request: I/O error, dev sdd, sector 0
Buffer I/O error on device sdd, logical block 0
Device sdd not ready.
end_request: I/O error, dev sdd, sector 0
Buffer I/O error on device sdd, logical block 0
usb 2-1: USB disconnect, address 2
usb 2-2: USB disconnect, address 3
ohci_hcd 0000:01:00.1: wakeup
usb 2-1: new low speed USB device using address 4
input: USB HID v1.00 Mouse [413c:3010] on usb-0000:01:00.1-1
usb 2-2: new low speed USB device using address 5
input: USB HID v1.10 Keyboard [CHICONY HP Basic USB Keyboard] on usb-0000:01:00.1-

lsw

沒記錯(cuò)的話，MSA1000有專門針對(duì)非WINDOWS平臺(tái)的firmware

ljhb

你的failover功能在哪里配置的？要在加載模塊的時(shí)候使用參數(shù)ql2xfailover=1

wwszadu

謝謝回復(fù),在安裝PSP包的時(shí)候配置的QLOGICFAILOVER.在/etc/modprobe.conf里面有的是ql2xfailover=1,有的是ql2xfailover=0,還有就是完全沒有這個(gè).

nntp

1. 不要安裝psp包.

2. 斷開MSA,  單獨(dú)把每個(gè)blade裝好后， configure好OS之后，從 hp download site ,search FCA2214, -> linux -> redhat EL xxxx -> 一個(gè)8MB以上的文件 (tar.gz)

3. blade 如果network load比較高，可以把RHEL bundle的 driver(tg3 or e1000)用hp download site的 driver換掉，這個(gè)我就不多說了.

4.  tar zxvf 那個(gè)dl下來的包之后， INSTALL -f  安裝, 然后reboot

5. MSA上進(jìn)入 ACU -> enable SSP -> 選擇好LUN ,  connection 從default 修改成 Linux (否則 path不會(huì)failover)

6. 你的這些故障信息出現(xiàn)的原因就是第5步?jīng)]有做.


btw:你是HP得人，還是HP的代理還是最終用戶?

wwszadu

第五步我是做了的，不過我在做SSP時(shí)一直都開著MSA1000，會(huì)不會(huì)是這個(gè)原因呢？只有等五一過后再去弄了。但是12臺(tái)機(jī)子中，有2對(duì)是正常的（未報(bào)錯(cuò)）。下次再去試試，快放假了，這段時(shí)間時(shí)間好像有點(diǎn)心慌似的，一直沒靜下心來做這件事。做技術(shù)的是不是不該這樣喲：）

nntp

connection 真的確定改成Linux了么? 你要100%確認(rèn)的,因?yàn)槟愕墓收闲畔⑹�有八九是這個(gè)沒有弄.

即便是你的LUN兩個(gè)node都要看到，SSP也一定要enable,然后手工assign到兩個(gè)node的WWN上去.

你會(huì) acu CLI么？ 如果會(huì)的話，在linux上把 acu cli 裝好，然后連上去配，可以有比ACU 圖形更多的控制，很方便的. 不要用附帶的線直接連MSA配，速度龜慢.

wwszadu

是的  我是通過ACU進(jìn)去配置的 HP的做小機(jī)和存儲(chǔ)的工程師都看過了,沒問題的.但是他搞不懂LINUX.有些機(jī)子我是用超級(jí)終端進(jìn)去配置的.我發(fā)現(xiàn)有些機(jī)子安裝了PSP包后無法使用ACU工具.ACU只檢測(cè)到本地的陣列,看不到MSA1000.

nntp

原帖由 wwszadu 于 2006-4-29 21:54 發(fā)表
是的  我是通過ACU進(jìn)去配置的 HP的做小機(jī)和存儲(chǔ)的工程師都看過了,沒問題的.但是他搞不懂LINUX.有些機(jī)子我是用超級(jí)終端進(jìn)去配置的.我發(fā)現(xiàn)有些機(jī)子安裝了PSP包后無法使用ACU工具.ACU只檢測(cè)到本地的陣列,看不到MSA1000.

你要用MSA1000 Support CD.

說老實(shí)話，你這個(gè)問題如果拋開硬件故障，基本上就是SSP范圍的東西.   ACU GUI看到的東西太少，我基本不用GUI來配的，因?yàn)閚ode還需要重新啟動(dòng)，不太現(xiàn)實(shí).  ACU CLI可以online配，很方便，最主要是可以做成腳本.

wwszadu

謝謝你nntp，非常感謝你給我的建議。