Patch Name: PHSS_30418 Patch Description: s700_800 11.23 ServiceGuard Extension for RAC 11.15.00 Creation Date: 04/07/14 Post Date: 04/07/16 Hardware Platforms - OS Releases: s700: 11.23 s800: 11.23 Products: ServiceGuard Extension for RAC A.11.15.00 Filesets: SG-NMAPI.CM-NMAPI,fr=A.11.15.00,fa=HP-UX_B.11.23_IA,v=HP Automatic Reboot?: No Status: General Release Critical: No (superseded patches were critical) PHSS_29097: OTHER RAC instance cannot open the database as it fails to register with cmgmsd. Registration fails with EOVERFLOW error. The following error message is seen in the Oracle trace file: ORA-00600: internal error code, arguments: [ksimgchg:1], [4294967295], [], [], [ ], [], [], [] The error is permanent currently Other errors observed: Sun Dec 21 21:01:05 2003 ORA-00304: requested INSTANCE_NUMBER is busy ORA-27300: OS system dependent operation:skgxnreg: gm_primary_attach failed In the gms log file, the following error message is found: Dec 23 16:45:37 [26520] ERROR: Failed to get process name for pid: 13868 (-1,72) Because of these errors RAC instances cannot open the database. Category Tags: defect_repair general_release critical Path Name: /hp-ux_patches/s700_800/11.X/PHSS_30418 Symptoms: PHSS_30418: 1. Oracle RAC 9i and 10g database may shutdown with error messages in SGeRAC product log files. In the cmgmsd log file, if logging is enabled with gmsetlog, the following error message is found: Jun 11 10:44:06 [2391] WARNING: Failed to send reply message to client (235,Socket is not connected). PHSS_29097: 1. RAC instance may not be able to register with cmgmsd because the system may not have sufficient network port numbers in the machine. The error number encountered is EADDRESSINUSE. 2. A RAC instance may fail to startup on a 64-bit system. RAC instance cannot open the DB as it fails to register with cmgmsd. Registration fails with EOVERFLOW error. The following error messages in the Oracle trace file may be an indication of this problem: ORA-00600: internal error code, arguments: [ksimgchg:1], [4294967295], [], [], [ ], [], [], [] Sun Dec 21 21:01:05 2003 ORA-00304: requested INSTANCE_NUMBER is busy ORA-27300: OS system dependent operation:skgxnreg: gm_primary_attach failed In the gms log file, the following error message is found: Dec 23 16:45:37 [26520] ERROR: Failed to get process name for pid: 13868 (-1,72) Number 72 in the previous line indicates error number for EOVERFLOW. Because of these errors, RAC instance is not able to open the database. Defect Description: PHSS_30418: 1. cmgmsd keeps the socket connection alive with the RAC's primary and slave processes. During shutdown of the database, the client expects reply from cmgmsd. In this case cmgmsd is closing the socket before replying on that socket. Resolution: Close the socket after replying to the client. PHSS_29097: 1. SGeRAC disconnects the socket connection between client and cmgmsd, thus needing new network ports when client makes another connection with cmgmsd. If the system does not have sufficient network ports available, it may not be possible to establish new network connections. Resolution: We reuse the socket connections made between client process and cmgmsd. 2. When a 32-bit process is run on 64-bit OS, pstat_getproc () may return EOVERFLOW error. This is because when an executable is built in a 32-bit environment it uses data types according to 32-bit architecture. When the executable is run a 64-bit OS the data types used to fill the members would be 64-bit data types. This may cause OVERFLOW error depending on the data. We have noticed that when pst_addr, address of process in memory), exceeds 2 gig in size we ran into EOVERFLOW error. The code does not currently handle the EOVERFLOW return and exits, thus the RAC instance fails to start. The particular fields that we are interested in from the pstat_getproc() never overflow, so we can safely ignore the EOVERFLOW error return. Resolution: Ignore EOVERFLOW error for pstat_getproc and if process name is returned correctly continue with registration. Enhancement: No SR: 8606301658 8606343589 8606366642 Patch Files: SG-NMAPI.CM-NMAPI,fr=A.11.15.00,fa=HP-UX_B.11.23_IA,v=HP: /opt/nmapi/nmapi2/lib/hpux32/libnmapi2.so.1 /opt/nmapi/nmapi2/lib/hpux64/libnmapi2.so.1 /usr/lbin/cmgmsd what(1) Output: SG-NMAPI.CM-NMAPI,fr=A.11.15.00,fa=HP-UX_B.11.23_IA,v=HP: /opt/nmapi/nmapi2/lib/hpux32/libnmapi2.so.1: Build platform: hpux Build date: Sun Jun 20 21:48:52 PDT 2004 Build id: ibld_sgerac_a1115patch_1123_product NMAPI2 A.11.15.00 Date: 06/20/04 Patch: PHSS_30418 /opt/nmapi/nmapi2/lib/hpux64/libnmapi2.so.1: Build platform: hpux - 64 bit Build date: Sun Jun 20 21:53:18 PDT 2004 Build id: ibld_sgerac_a1115patch_1123_product NMAPI2 A.11.15.00 Date: 06/20/04 Patch: PHSS_30418 /usr/lbin/cmgmsd: Build platform: hpux Build date: Sun Jun 20 21:49:17 PDT 2004 Build id: ibld_sgerac_a1115patch_1123_product A.11.15.00 Date: 06/20/04 Patch: PHSS_30418 CMGMSD CMGMSD cksum(1) Output: SG-NMAPI.CM-NMAPI,fr=A.11.15.00,fa=HP-UX_B.11.23_IA,v=HP: 2820437134 342976 /opt/nmapi/nmapi2/lib/hpux32/ libnmapi2.so.1 3121276481 347088 /opt/nmapi/nmapi2/lib/hpux64/ libnmapi2.so.1 3574816120 325436 /usr/lbin/cmgmsd Patch Conflicts: None Patch Dependencies: None Hardware Dependencies: None Other Dependencies: None Supersedes: PHSS_29097 Equivalent Patches: PHSS_30417: s700: 11.11 s800: 11.11 Patch Package Size: 290 KBytes Installation Instructions: Please review all instructions and the Hewlett-Packard SupportLine User Guide or your Hewlett-Packard support terms and conditions for precautions, scope of license, restrictions, and, limitation of liability and warranties, before installing this patch. ------------------------------------------------------------ 1. Back up your system before installing a patch. 2. Login as root. 3. Copy the patch to the /tmp directory. 4. Move to the /tmp directory and unshar the patch: cd /tmp sh PHSS_30418 5. Run swinstall to install the patch: swinstall -x autoreboot=true -x patch_match_target=true \ -s /tmp/PHSS_30418.depot By default swinstall will archive the original software in /var/adm/sw/save/PHSS_30418. If you do not wish to retain a copy of the original software, include the patch_save_files option in the swinstall command above: -x patch_save_files=false WARNING: If patch_save_files is false when a patch is installed, the patch cannot be deinstalled. Please be careful when using this feature. For future reference, the contents of the PHSS_30418.text file is available in the product readme: swlist -l product -a readme -d @ /tmp/PHSS_30418.depot To put this patch on a magnetic tape and install from the tape drive, use the command: dd if=/tmp/PHSS_30418.depot of=/dev/rmt/0m bs=2k Special Installation Instructions: 1) Shutdown all RAC database instances on the node where installing the patch. 2) Halt ServiceGuard on that node. 3) Install this patch on that node. 4) Restart ServiceGuard on that node. 5) Restart all RAC instances. 6) Repeat the steps above to install this patch on all nodes in the cluster.