HP-UX web登陆无反应，猜就是数据库出了问题

今天清明节的第2天了， 接到一个陌生电话，结果是现在项目经理， 给我“哭诉”， 系统登陆不起了，局方在导数据。

因为最近在研究大数据，所以oracle的事情很少碰。  这些系统也比较稳定了。

1. 开始了，收到了登陆方式，立马打开电脑，ssh 上去， df -h, 察。。。 HP-UX  , 立马bdf ,看看是不是系统log100%》无法记录导致。结果不是

2.  

$ crs_stat -tCRS-0184: Cannot communicate with the CRS daemon

3, 这里出问题，一般情况下是raw设备权限丢失， 磁盘坏block, 网卡异常。

4. 检查下是否 4个都异常了

$ crsctl check crsCRS-4638: Oracle High Availability Services is onlineCRS-4535: Cannot communicate with Cluster Ready ServicesCRS-4529: Cluster Synchronization Services is onlineCRS-4533: Event Manager is online

5.看下crs日志

2015-04-05 08:05:12.419: [  OCRASM][1]ASM Error Stack : 2015-04-05 08:05:12.517: [  OCRASM][1]proprasmo: kgfoCheckMount returned [6]2015-04-05 08:05:12.517: [  OCRASM][1]proprasmo: Th<span style="color:#ff0000;">e ASM disk group DG01R10 is not found or not mounted</span>2015-04-05 08:05:12.519: [  OCRRAW][1]proprioo: Failed to open [+DG01R10]. Returned proprasmo() with [26]. Marking location as UNAVAILABLE.2015-04-05 08:05:12.519: [  OCRRAW][1]proprioo: No OCR/OLR devices are usable2015-04-05 08:05:12.519: [  OCRASM][1]proprasmcl: asmhandle is NULL2015-04-05 08:05:12.519: [    GIPC][1] gipcCheckInitialization: possible incompatible non-threaded init from [prom.c : 690], original from [clsss.c : 5326]2015-04-05 08:05:12.523: [ default][1]clsvactversion:4: Retrieving Active Version from local storage.2015-04-05 08:05:12.526: [  OCRRAW][1]proprrepauto: The local OCR configuration matches with the configuration published by OCR Cache Writer. No repair required.2015-04-05 08:05:12.530: [  OCRRAW][1]proprinit: Could not open raw device 2015-04-05 08:05:12.530: [  OCRASM][1]proprasmcl: asmhandle is NULL2015-04-05 08:05:12.532: [  OCRAPI][1]a_init:16!: Backend init unsuccessful : [26]2015-04-05 08:05:12.532: [  CRSOCR][1] OCR context init failure.  Error: PROC-26: Error while accessing the physical storage2015-04-05 08:05:12.533: [ CRSMAIN][1] Created alert : (:CRSD00111:) :  Could not init OCR, error: PROC-26: Error while accessing the physical storage

6. 立马查看磁盘状态，果然有dismounted 的磁盘。 马上mount,看报什么错， 结果一下就成功了。 。。。。。汗

SQL> select name,state,total_mb,free_mb from v$asm_diskgroup;NAME                           STATE         TOTAL_MB    FREE_MB------------------------------ ----------- ---------- ----------DG01R10                        MOUNTED       19436544    5783632DG02R10REDO01                  MOUNTED         307200     183808DG02R5                         MOUNTED      139124736   36946816DG03R10REDO01                  MOUNTED         307200     183876DG_NETAPP                      MOUNTED       31713372    2910471

7. 拉起crs服务

$ pwd/u01/app/crs_home/bin$ /u01/app/crs_home/bin/crsctl start res ora.crsd -initCRS-2672: Attempting to start 'ora.crsd' on 'psmsdb01'CRS-2676: Start of 'ora.crsd' on 'psmsdb01' succeeded

8.然后，再查看状态

$ crsctl check crs  这里还不正常，可能还在检查中， 所以别猴急CRS-4638: Oracle High Availability Services is onlineCRS-4535: Cannot communicate with Cluster Ready ServicesCRS-4529: Cluster Synchronization Services is onlineCRS-4533: Event Manager is online$ crsctl check crs  好了CRS-4638: Oracle High Availability Services is onlineCRS-4537: Cluster Ready Services is onlineCRS-4529: Cluster Synchronization Services is onlineCRS-4533: Event Manager is online

9.收工。