C6509 장비 두대를 VSS 로 묶어서 사용중이었습니다..
네트워크에 원인 미상의 장애가 발생하여.. 상단으로 연결된 L4 스위치들과의
LB 문제 유발로 상호 점검을 했으나.. 특이점이 없어서..
각 장비들 전부 재부팅을 했고..
마지막으로 재부팅을 한게 VSS 백본이었습니다..
1,2 번 장비를 모두 끄고...
1번을 부팅 -> 정상 부팅
1번이 액티브 되고.. 2번을 켜셔 장비끼리 통신을 하고 부팅을 시키려 하는데..
에러가 뜨면서 계속 재부팅이 되네요..
00:00:24: %PFREDUN-6-ACTIVE: Initializing as ACTIVE processor for this switch
Active crashed three times, disabling auto-boot and dropping to rommon
Crashdump : 14:15:23.776 Tue May 20 2014 : ios-base : (PID=12311, TID=4) : -Traceback=(s72033-advipservicesk9_wan-2-dso-b.so+0x51BAEC) ([37:0]+0x51DBE0) ([37:0]+0x521420) ([27:-9]3+0x2CCC78) ([37:0]+0x2D94A0) ([27:-9]6+0x138B1C) ([37:0]+0x138AF4)
crashdump called (with pause = 0 sec)
%ALIGN-1-FATAL: Illegal access to a low address 14:15:23 UTC Tue May 20 2014
addr=0x0, pc=0x72AB55EC, ra=0x72AB551C, sp=0x323EB88
SLOT0:00:00:24: %DUMPER-3-PROCINFO: pid = 12311: (sbin/ios-base), terminated due to signal SIGSEGV, Segmentation violation (Address not mapped)
SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311: zero at v0 v1
SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311: R0 00000000 7A221568 00000014 00FBCFC0
SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311: a0 a1 a2 a3
SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311: R4 00000000 00FBCEC0 00000000 00000000
SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311: t0 t1 t2 t3
SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311: R8 00000000 00000000 00000053 00000025
SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311: t4 t5 t6 t7
SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311: R12 00000000 72A30B00 FFFFFFFF 728F8000
SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311: s0 s1 s2 s3
SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311: R16 0323EE48 0323EE78 00000000 00000000
SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311: s4 s5 s6 s7
SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311: R20 00000000 00000000 00000000 00000000
SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311: t8 t9 k0 k1
SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311: R24 0323EA88 70CD5040 00000000 00000000
SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311: gp sp s8 ra
SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311: R28 7A05E710 0323EB88 00000000 72AB551C
SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311: sr lo hi bad
SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311: R32 1000FC63 00000000 00000001 00000000
SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311: cause pc epc
SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311: R36 00000000 72AB55EC 00000000
SLOT0:00:00:24: %DUMPER-3-TRACE_BACK_INFO: 12311: (s72033-advipservicesk9_wan-6-dso-b.so+0x1BD5EC) (s72033-advipservicesk9_wan-2-dso-b.so+0x51BAEC) (s72033-advipservicesk9_wan-2-dso-b.so+0x51DBE0) (s72033-advipservicesk9_wan-2-dso-b.so+0x521420) (s72033-advipservicesk9_wan-3-dso-b.so+0x2CCC78) (s72033-advipservicesk9_wan-3-dso-b.so+0x2D94A0) (s72033-advipservicesk9_wan-6-dso-b.so+0x138B1C) (s72033-advipservicesk9_wan-6-dso-b.so+0x138AF4)
SLOT0:00:00:25: %DUMPER-6-BAD_PATH: 12311: Choice 1 either not configured or bad path. Trying next choice.
SLOT0:00:00:25: %DUMPER-6-BAD_PATH: 12311: Choice 2 either not configured or bad path. Trying next choice.
SLOT0:00:00:25: %DUMPER-6-BAD_PATH: 12311: Choice 3 either not configured or bad path. Trying next choice.
SLOT0:00:00:25: %DUMPER-3-DUMP_FAILURE: 12311: Core dump failed: Could not create core
SLOT0:00:00:26: %DUMPER-3-CRASHINFO_FILE_NAME: 12311: Crashinfo for process sbin/ios-base at bootflash:/crashinfo_ios-base-20140520-141523
SLOT0:00:00:26: %SYSMGR-3-ABNORMTERM: ios-base:1 (jid 74) abnormally terminated, restart disabled
SLOT0:00:00:26: %SYSMGR-6-ERROR_EOK: ios-base:1 (jid 74) mandatory process exited, rebooting
하... 뭔가 심각하다는게 본능적으로 느껴지는데
시스코 엔지니어분들 계시면 조언 부탁드리겠습니다..