GoldenGate Error and Solution

ERROR OGG-25127 Received an error reply requesting a graceful shutdown:

We may get this error for newly created Pump Process for new remote trail file location.

GGSCI (orclprd.localdomain) 47> view report PEMP


***********************************************************************
                 Oracle GoldenGate Capture for Oracle
    Version 19.1.0.0.4 OGGCORE_19.1.0.0.0_PLATFORMS_191017.1054_FBO
   Linux, x64, 64bit (optimized), Oracle 19c on Oct 17 2019 21:16:58

Copyright (C) 1995, 2019, Oracle and/or its affiliates. All rights reserved.

                    Starting at 2023-11-21 14:25:48
***********************************************************************

Operating System Version:
Linux
Version #2 SMP Mon Sep 24 14:45:01 PDT 2018, Release 4.14.35-1818.3.3.el7uek.x86_64
Node: orclprd.localdomain
Machine: x86_64
                         soft limit   hard limit
Address Space Size   :    unlimited    unlimited
Heap Size            :    unlimited    unlimited
File Size            :    unlimited    unlimited
CPU Time             :    unlimited    unlimited

Process id: 17516

Description:

***********************************************************************
**            Running with the following parameters                  **
***********************************************************************

2023-11-21 14:25:48  INFO    OGG-03059  Operating system character set identified as UTF-8.

2023-11-21 14:25:48  INFO    OGG-02695  ANSI SQL parameter syntax is used for parameter parsing.

2023-11-21 14:25:48  INFO    OGG-02095  Successfully set environment variable ORACLE_SID=ORCLPRD.

2023-11-21 14:25:48  INFO    OGG-01360  EXTRACT is running in Data Pump mode.

2023-11-21 14:25:49  INFO    OGG-01889  Flush size (max message size) is set to 27,985.
EXTRACT PEMP
SETENV (ORACLE_SID=ORCLPRD)
PASSTHRU
CACHEMGR CACHESIZE 2GB, CACHEDIRECTORY /u01/goldengate/gg_dircache 4GB
EOFDELAYCSECS 1
FLUSHCSECS 1
RMTHOST orcl19c.localdomain, MGRPORT 7809
RMTTRAIL /u01/goldengate/ogg19/dirdat/hr
GETUPDATEBEFORES
GETUPDATEAFTERS
REPORTCOUNT EVERY 10 MINUTES, RATE
TABLE HR.EMPLOYEES;
TABLE HR.DEPARTMENTS;

2023-11-21 14:25:49  INFO    OGG-01851  filecaching started: thread ID: 139919651047168.

2023-11-21 14:25:49  INFO    OGG-01815  Virtual Memory Facilities for: COM
    anon alloc: mmap(MAP_ANON)  anon free: munmap
    file alloc: mmap(MAP_SHARED)  file free: munmap
    target directories:
    /u01/goldengate/gg_dircache.

2023-11-21 14:25:55  INFO    OGG-01888  TCP network is configured as

                  OS DEFAULT          SPECIFIED           ACTUAL VALUE
         IP_DSCP    0                   N/A                 0
          IP_TOS    0                   N/A                 0
     TCP_NODELAY    0                   N/A                 0
    TCP_QUICKACK    1                   N/A                 1
        TCP_CORK    0                   N/A                 0
       SO_SNDBUF    8192                N/A                 8192
       SO_RCVBUF    43690               N/A                 43690.

Source Context :
  SourceModule            : [gglib.ggtrail.LegacyTrailDataTarget]
  SourceID                : [er/LegacyTrailDataTarget.cpp]
  SourceMethod            : [complete_tcp_msg]
  SourceLine              : [2225]
  ThreadBacktrace         : [14] elements
                          : [/u01/goldengate/db19/libgglog.so(CMessageContext::AddThreadContext())]
                          : [/u01/goldengate/db19/libgglog.so(CMessageFactory::CreateMessage(CSourceContext*, unsigned int, ...))]
                          : [/u01/goldengate/db19/libgglog.so(_MSG_String(CSourceContext*, int, char const*, CMessageFactory::MessageDisposition)
)]
                          : [/u01/goldengate/db19/extract(ggs::gglib::ggtrail::LegacyTrailDataTarget::complete_tcp_msg(extract_def*))]
                          : [/u01/goldengate/db19/extract(ggs::gglib::ggtrail::LegacyTrailDataTarget::flush_tcp(extract_def*, bool))]
                          : [/u01/goldengate/db19/extract()]
                          : [/u01/goldengate/db19/extract(EXTRECOVERY_initialize(ggs::gglib::ggapp::ReplicationContext&))]
                          : [/u01/goldengate/db19/extract()]
                          : [/u01/goldengate/db19/extract(ggs::gglib::MultiThreading::MainThread::ExecMain())]
                          : [/u01/goldengate/db19/extract(ggs::gglib::MultiThreading::Thread::RunThread(ggs::gglib::MultiThreading::Thread::Threa
dArgs*))]
                          : [/u01/goldengate/db19/extract(ggs::gglib::MultiThreading::MainThread::Run(int, char**))]
                          : [/u01/goldengate/db19/extract(main)]
                          : [/lib64/libc.so.6(__libc_start_main)]
                          : [/u01/goldengate/db19/extract()]

2023-11-21 14:25:55  ERROR   OGG-25127  Received an error reply requesting a graceful shutdown. (Reply received is 'GSOutput file /u01/gg_target/hr000000 is not in any allowed output directories.'.).

2023-11-21 14:25:55  ERROR   OGG-01668  PROCESS ABENDING.

Add Below parameter and Path on GLOBALS parameter files on Target Database Server:

GGSCI (orcl.localdomain) 69> view param ./GLOBALS

ALLOWOUTPUTDIR /u01/gg_target

ERROR OGG-01224 TCP/IP error 113 (No route to host):

Usually we get this error on pump process when target server is not reachable specially when manager process is down on target server.

GGSCI (orclprd.localdomain) 37> view report PEMP


***********************************************************************
                 Oracle GoldenGate Capture for Oracle
    Version 19.1.0.0.4 OGGCORE_19.1.0.0.0_PLATFORMS_191017.1054_FBO
   Linux, x64, 64bit (optimized), Oracle 19c on Oct 17 2019 21:16:58

Copyright (C) 1995, 2019, Oracle and/or its affiliates. All rights reserved.

                    Starting at 2023-11-21 14:20:28
***********************************************************************

Operating System Version:
Linux
Version #2 SMP Mon Sep 24 14:45:01 PDT 2018, Release 4.14.35-1818.3.3.el7uek.x86_64
Node: orclprd.localdomain
Machine: x86_64
                         soft limit   hard limit
Address Space Size   :    unlimited    unlimited
Heap Size            :    unlimited    unlimited
File Size            :    unlimited    unlimited
CPU Time             :    unlimited    unlimited

Process id: 17118

Description:

***********************************************************************
**            Running with the following parameters                  **
***********************************************************************

2023-11-21 14:20:29  INFO    OGG-03059  Operating system character set identified as UTF-8.

2023-11-21 14:20:29  INFO    OGG-02695  ANSI SQL parameter syntax is used for parameter parsing.

2023-11-21 14:20:29  INFO    OGG-02095  Successfully set environment variable ORACLE_SID=ORCLPRD.

2023-11-21 14:20:29  INFO    OGG-01360  EXTRACT is running in Data Pump mode.

2023-11-21 14:20:29  INFO    OGG-01889  Flush size (max message size) is set to 27,985.
EXTRACT PEMP
SETENV (ORACLE_SID=ORCLPRD)
PASSTHRU
CACHEMGR CACHESIZE 2GB, CACHEDIRECTORY /u01/goldengate/gg_dircache 4GB
EOFDELAYCSECS 1
FLUSHCSECS 1
RMTHOST 192.168.56.20, MGRPORT 7809
RMTTRAIL /u01/gg_target/hr
GETUPDATEBEFORES
GETUPDATEAFTERS
REPORTCOUNT EVERY 10 MINUTES, RATE
TABLE HR.EMPLOYEES;
TABLE HR.DEPARTMENTS;

2023-11-21 14:20:29  INFO    OGG-01851  filecaching started: thread ID: 140352860501760.

2023-11-21 14:20:29  INFO    OGG-01815  Virtual Memory Facilities for: COM
    anon alloc: mmap(MAP_ANON)  anon free: munmap
    file alloc: mmap(MAP_SHARED)  file free: munmap
    target directories:
    /u01/goldengate/gg_dircache.

Source Context :
  SourceModule            : [ggnet.tcprtn]
  SourceID                : [../gglib/ggnet/tcprtn.c]
  SourceMethod            : [opt_negotiate]
  SourceLine              : [4739]
  ThreadBacktrace         : [12] elements
                          : [/u01/goldengate/db19/libgglog.so(CMessageContext::AddThreadContext())]
                          : [/u01/goldengate/db19/libgglog.so(CMessageFactory::CreateMessage(CSourceContext*, unsigned int, ...))]
                          : [/u01/goldengate/db19/libgglog.so(_MSG_String(CSourceContext*, int, char const*, CMessageFactory::MessageDisposition)
)]
                          : [/u01/goldengate/db19/extract(opt_negotiate(int, char (&) [2048]))]
                          : [/u01/goldengate/db19/extract()]
                          : [/u01/goldengate/db19/extract()]
                          : [/u01/goldengate/db19/extract(ggs::gglib::MultiThreading::MainThread::ExecMain())]
                          : [/u01/goldengate/db19/extract(ggs::gglib::MultiThreading::Thread::RunThread(ggs::gglib::MultiThreading::Thread::Threa
dArgs*))]
                          : [/u01/goldengate/db19/extract(ggs::gglib::MultiThreading::MainThread::Run(int, char**))]
                          : [/u01/goldengate/db19/extract(main)]
                          : [/lib64/libc.so.6(__libc_start_main)]
                          : [/u01/goldengate/db19/extract()]

2023-11-21 14:20:29  ERROR   OGG-01224  TCP/IP error 113 (No route to host), endpoint: 192.168.56.20:7809.

2023-11-21 14:20:29  ERROR   OGG-01668  PROCESS ABENDING.

Solution:

Make sure that manger process are running on target database server and PORT # has been mentioned correctly on PUMP.

Remote host name and port on PUMP:

RMTHOST 192.168.56.20, MGRPORT 7809
RMTTRAIL /u01/gg_target/hr

Manager Process on Target:

GGSCI (orcl19c.localdomain) 5> info mgr

Manager is running (IP port TCP:orcl19c.localdomain.7809, Process ID 6413).

ERROR OGG-01224 Connect failed to ::1:7810, error 111:Connection refused – retries exceeded:

GGSCI (orclprd.localdomain) 72> view report pemp


***********************************************************************
                 Oracle GoldenGate Capture for Oracle
    Version 19.1.0.0.4 OGGCORE_19.1.0.0.0_PLATFORMS_191017.1054_FBO
   Linux, x64, 64bit (optimized), Oracle 19c on Oct 17 2019 21:16:58

Copyright (C) 1995, 2019, Oracle and/or its affiliates. All rights reserved.

                    Starting at 2023-11-21 15:22:43
***********************************************************************

Operating System Version:
Linux
Version #2 SMP Mon Sep 24 14:45:01 PDT 2018, Release 4.14.35-1818.3.3.el7uek.x86_64
Node: orclprd.localdomain
Machine: x86_64
                         soft limit   hard limit
Address Space Size   :    unlimited    unlimited
Heap Size            :    unlimited    unlimited
File Size            :    unlimited    unlimited
CPU Time             :    unlimited    unlimited

Process id: 21079

Description:

***********************************************************************
**            Running with the following parameters                  **
***********************************************************************

2023-11-21 15:22:43  INFO    OGG-03059  Operating system character set identified as UTF-8.

2023-11-21 15:22:43  INFO    OGG-02695  ANSI SQL parameter syntax is used for parameter parsing.

2023-11-21 15:22:43  INFO    OGG-02095  Successfully set environment variable ORACLE_SID=ORCLPRD.

2023-11-21 15:22:43  INFO    OGG-01360  EXTRACT is running in Data Pump mode.

2023-11-21 15:22:43  INFO    OGG-01889  Flush size (max message size) is set to 27,985.
EXTRACT PEMP
SETENV (ORACLE_SID=ORCLPRD)
PASSTHRU
CACHEMGR CACHESIZE 2GB, CACHEDIRECTORY /u01/goldengate/gg_dircache 4GB
EOFDELAYCSECS 1
FLUSHCSECS 1
RMTHOST orcl19c.localdomain, MGRPORT 7809
RMTTRAIL /u01/gg_target/hr
GETUPDATEBEFORES
GETUPDATEAFTERS
REPORTCOUNT EVERY 10 MINUTES, RATE
TABLE HR.EMPLOYEES;
TABLE HR.DEPARTMENTS;

2023-11-21 15:22:44  INFO    OGG-01851  filecaching started: thread ID: 140537278785280.

2023-11-21 15:22:44  INFO    OGG-01815  Virtual Memory Facilities for: COM
    anon alloc: mmap(MAP_ANON)  anon free: munmap
    file alloc: mmap(MAP_SHARED)  file free: munmap
    target directories:
    /u01/goldengate/gg_dircache.

2023-11-21 15:22:49  INFO    OGG-01888  TCP network is configured as

                  OS DEFAULT          SPECIFIED           ACTUAL VALUE
         IP_DSCP    0                   N/A                 0
          IP_TOS    0                   N/A                 0
     TCP_NODELAY    0                   N/A                 0
    TCP_QUICKACK    1                   N/A                 1
        TCP_CORK    0                   N/A                 0
       SO_SNDBUF    8192                N/A                 8192
       SO_RCVBUF    43690               N/A                 43690.

2023-11-21 15:22:49  WARNING OGG-01221  Connect failed to ::1:7810, error 111:Connection refused.

2023-11-21 15:22:59  WARNING OGG-01221  Connect failed to ::1:7810, error 111:Connection refused.

2023-11-21 15:23:09  WARNING OGG-01221  Connect failed to ::1:7810, error 111:Connection refused.

2023-11-21 15:23:19  WARNING OGG-01221  Connect failed to ::1:7810, error 111:Connection refused.

2023-11-21 15:23:29  WARNING OGG-01221  Connect failed to ::1:7810, error 111:Connection refused.

2023-11-21 15:23:39  WARNING OGG-01221  Connect failed to ::1:7810, error 111:Connection refused.

2023-11-21 15:23:49  WARNING OGG-01221  Connect failed to ::1:7810, error 111:Connection refused.

2023-11-21 15:23:59  WARNING OGG-01221  Connect failed to ::1:7810, error 111:Connection refused.

2023-11-21 15:24:09  WARNING OGG-01221  Connect failed to ::1:7810, error 111:Connection refused.

2023-11-21 15:24:19  WARNING OGG-01221  Connect failed to ::1:7810, error 111:Connection refused.

2023-11-21 15:24:29  WARNING OGG-01221  Connect failed to ::1:7810, error 111:Connection refused.

Source Context :
  SourceModule            : [ggnet.tcprtn]
  SourceID                : [../gglib/ggnet/tcprtn.c]
  SourceMethod            : [opt_negotiate]
  SourceLine              : [4743]
  ThreadBacktrace         : [12] elements
                          : [/u01/goldengate/db19/libgglog.so(CMessageContext::AddThreadContext())]
                          : [/u01/goldengate/db19/libgglog.so(CMessageFactory::CreateMessage(CSourceContext*, unsigned int, ...))]
                          : [/u01/goldengate/db19/libgglog.so(_MSG_String(CSourceContext*, int, char const*, CMessageFactory::MessageDisposition)
)]
                          : [/u01/goldengate/db19/extract(opt_negotiate(int, char (&) [2048]))]
                          : [/u01/goldengate/db19/extract()]
                          : [/u01/goldengate/db19/extract()]
                          : [/u01/goldengate/db19/extract(ggs::gglib::MultiThreading::MainThread::ExecMain())]
                          : [/u01/goldengate/db19/extract(ggs::gglib::MultiThreading::Thread::RunThread(ggs::gglib::MultiThreading::Thread::Threa
dArgs*))]
                          : [/u01/goldengate/db19/extract(ggs::gglib::MultiThreading::MainThread::Run(int, char**))]
                          : [/u01/goldengate/db19/extract(main)]
                          : [/lib64/libc.so.6(__libc_start_main)]
                          : [/u01/goldengate/db19/extract()]

2023-11-21 15:24:39  ERROR   OGG-01224  Connect failed to ::1:7810, error 111:Connection refused - retries exceeded.

2023-11-21 15:24:39  ERROR   OGG-01668  PROCESS ABENDING.

Check the IP or host name used correctly or not on PUMP:

Check the port is opened or not:

GGSCI (orcl19c.localdomain) 8> send mgr getportinfo detail

Sending GETPORTINFO request to MANAGER ...

Dynamic Port List

Starting Index 0
Entry Port  Error  Process     Assigned             Program
----- ----- ----- ----------   -------------------  -------
   0   7809     0
   1   7810     0
   2   7811     0
   3   7812     0
   4   7813     0
   5   7814     0
   6   7815     0
   7   7816     0
   8   7817     0
   9   7818     0
  10   7819     0
  11   7820     0
  12   7821     0
  13   7822     0
  14   7823     0
  15   7824     0
  16   7825     0
  17   7826     0
  18   7827     0
  19   7828     0
  20   7829     0
  21   7830     0
  22   7831     0
  23   7832     0