WAITED TOO LONG FOR A ROW CACHE ENQUEUE LOCK! : Oracle

>>> WAITED TOO LONG FOR A ROW CACHE ENQUEUE LOCK! pid=78
System State dumped to trace file c:\admin\borisen\udump\borisen_ora_5008.trc
Wed Jul 16 01:44:09 2014
>>> WAITED TOO LONG FOR A ROW CACHE ENQUEUE LOCK! pid=11
Wed Jul 16 01:44:09 2014
>>> WAITED TOO LONG FOR A ROW CACHE ENQUEUE LOCK! pid=26
Wed Jul 16 08:12:49 2014

Dump file c:\admin\borisen\udump\borisen_ora_5008.trc
Wed Jul 16 01:44:09 2014
ORACLE V10.2.0.5.0 - 64bit Production vsnsta=0
vsnsql=14 vsnxtr=3
Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
Windows NT Version V5.2 Service Pack 2
CPU : 16 - type 8664, 2 Physical Cores
Process Affinity : 0x0000000000000000
Memory (Avail/Total): Ph:13394M/16322M, Ph+PgF:15295M/17750M
Instance name: borisen

Redo thread mounted by this instance: 1

Oracle process number: 78

Windows thread id: 5008, image: ORACLE.EXE (SHAD)


*** 2014-07-16 01:44:09.160
*** ACTION NAME:() 2014-07-16 01:44:09.160
*** MODULE NAME:(Sm.Main.exe) 2014-07-16 01:44:09.160
*** SERVICE NAME:(SYS$USERS) 2014-07-16 01:44:09.160
*** SESSION ID:(110.46394) 2014-07-16 01:44:09.160
>>> WAITED TOO LONG FOR A ROW CACHE ENQUEUE LOCK! <<<
row cache enqueue: session: 000007FF9EB51070, mode: N, request: S

Dump file c:\admin\borisen\bdump\borisen_cjq0_4352.trc
Wed Jul 16 01:44:09 2014
ORACLE V10.2.0.5.0 - 64bit Production vsnsta=0
vsnsql=14 vsnxtr=3
Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
Windows NT Version V5.2 Service Pack 2
CPU : 16 - type 8664, 2 Physical Cores
Process Affinity : 0x0000000000000000
Memory (Avail/Total): Ph:13415M/16322M, Ph+PgF:15317M/17750M
Instance name: borisen

Redo thread mounted by this instance: 1

Oracle process number: 11

Windows thread id: 4352, image: ORACLE.EXE (CJQ0)


*** 2014-07-16 01:44:09.348
*** SERVICE NAME:(SYS$BACKGROUND) 2014-07-16 01:44:09.348
*** SESSION ID:(161.1) 2014-07-16 01:44:09.348
>>> WAITED TOO LONG FOR A ROW CACHE ENQUEUE LOCK! <<<
row cache enqueue: session: 000007FF9EB95758, mode: N, request: S
ABORTING SYSTEM STATE DUMP: ANOTHER PROCESS (so = 0x000007FF9EA8FA48) EXECUTING SYSTEM STATE DUMP

OlegON ➤ База в SHARED? DEDICATED пробовали подключаться, когда повисла?

SQL> select server,count(server) from v$session group by server;

SERVER COUNT(SERVER)
--------- -------------
DEDICATED 89

OlegON ➤ Диски не умирают? Совсем недавно на сломанной полке и куче юзеров база именно такое выдавала.

bayan ➤ Никакие сессии через alter system kill session не прибивали случаем? Ну и AWR, конечно, надо смотреть, что там происходило то вообще.

john_the_ripper ➤ На контроллере медиа эрроров не висит по винтам. Мистика) Тоже была такая мысль изначально.

john_the_ripper ➤ Прошедшей ночью, на одной из баз завис Oracle(перестал принимать соединения). В alert логе, появились следующие строки: