2025-02-18T21:36:47.953581+08:00 PMON (ospid: 41879): terminating the instance due to ORA error 499 2025-02-18T21:36:47.953675+08:00 Cause - 'Instance is being terminated due to fatal process death (pid: 5, ospid: 41971, IPC0)'
自动重启后，再次发生实例崩溃，日志如下：
1 2 3 4 5 6 7 8 9 10 11 12 13
2025-02-18T21:38:18.289755+08:00 Dwn-cvts replayed, VALBLKs dubious All grantable enqueues granted 2025-02-18T21:46:23.819853+08:00 Errors in file /u01/app/oracle/diag/rdbms/mesdb/mesdb2/trace/mesdb2_fenc_3353096.trc (incident=480559): ORA-00600: internal error code, arguments: [kfmdPriRegRclient04], [], [], [], [], [], [], [], [], [], [], [] Incident details in: /u01/app/oracle/diag/rdbms/mesdb/mesdb2/incident/incdir_480559/mesdb2_fenc_3353096_i480559.trc Use ADRCI or Support Workbench to package the incident. See Note 411.1 at My Oracle Support for error and packaging details. 2025-02-18T21:46:24.224088+08:00 Errors in file /u01/app/oracle/diag/rdbms/mesdb/mesdb2/trace/mesdb2_fenc_3353096.trc: ORA-00600: internal error code, arguments: [kfmdPriRegRclient04], [], [], [], [], [], [], [], [], [], [], [] FENC (ospid: 3353096): terminating the instance due to ORA error 854
通过上述日志可以发现，从 2025-02-18T21:38:18.289755+08:00 ～ 2025-02-18T21:46:23.819853+08:00，主要 hang 在 All grantable enqueues granted 阶段，等待了接近 8 分钟左右，然后报错 ORA-00600 [kfmdPriRegRclient04]，实例再次异常 Crashed。
This bug is only relevant when using Real Application Clusters (RAC) During instance start, it takes too long to complete FIXWRITE step and instance is killed and restarted when using Real Application Clusters (RAC) REDISCOVERY INFORMATION: If ORA-600 [kfmdPriRegRclient04] is hit during instance start FIXWRITE step, then this bug is encountered.
Workaround NONE
可以看到这个 BUG 的唯一解决方案就是 打补丁。
问题解决
补丁下载
在 MOS 上下载对应版本补丁：
正式安装补丁之前建议先阅读一下 README 文档：
This patch is RAC Rolling Installable（注意：这是一个支持滚动安装的补丁，所以可以挨个节点进行安装）.
Ensure that 19 Release 19.22.0.0.240116DBRU Patch Set Update (PSU) 35943157 is already applied on the Oracle Database.
Ensure that you have OPatch 19 Release 12.2.0.1.40 or higher.
Ensure that you shut down all the services running from the Oracle home.
For a RAC environment, shut down all the services (database, ASM, listeners, nodeapps, and CRS daemons) running from the Oracle home of the node you want to patch.
[oracle@mesdb2 35469192]$ opatch prereq CheckConflictAgainstOHWithDetail -ph ./ Oracle Interim Patch Installer version 12.2.0.1.41 Copyright (c) 2025, Oracle Corporation. All rights reserved.
PREREQ session
Oracle Home : /u01/app/oracle/product/19.3.0/db_1 Central Inventory : /u01/app/oraInventory from : /u01/app/oracle/product/19.3.0/db_1/oraInst.loc OPatch version : 12.2.0.1.41 OUI version : 12.2.0.7.0 Log file location : /u01/app/oracle/product/19.3.0/db_1/cfgtoollogs/opatch/opatch2025-02-19_01-26-47AM_1.log
[oracle@mesdb2 35469192]$ opatch apply Oracle Interim Patch Installer version 12.2.0.1.41 Copyright (c) 2025, Oracle Corporation. All rights reserved.
Oracle Home : /u01/app/oracle/product/19.3.0/db_1 Central Inventory : /u01/app/oraInventory from : /u01/app/oracle/product/19.3.0/db_1/oraInst.loc OPatch version : 12.2.0.1.41 OUI version : 12.2.0.7.0 Log file location : /u01/app/oracle/product/19.3.0/db_1/cfgtoollogs/opatch/opatch2025-02-19_01-38-43AM_1.log
Verifying environment and performing prerequisite checks... OPatch continues with these patches: 35469192
Do you want to proceed? [y|n] y User Responded with: Y All checks passed.
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system. (Oracle Home = '/u01/app/oracle/product/19.3.0/db_1')
Is the local system ready for patching? [y|n] y User Responded with: Y Backing up files... Applying interim patch '35469192' to OH '/u01/app/oracle/product/19.3.0/db_1'
