PRVF-5424 : Clock time offset check failed with PRVF-5413

Applies to: Database Management Software Oracle Server - Enterprise Edition - Version: Oracle 11g R1 to R2
This problem can occur on any platform.

I have two node Real Application cluster on Database Management Software Oracle 11.2.0.2. Alert log files of database start showing this messages on both nodes. The clocks between cluster nodes must be synchronized and it is always recommended to use NTP to achieve this. Because of difference in time on nodes, cluster can face sever consequences like node evictions etc.

Alter log files of Database Instance.

CRS-2409:The clock on host "hostname1" is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
2013-02-28 15:18:58.226
CRS-2409:The clock on host "hostname2" is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
2013-02-28 15:48:59.368


[client(124161)]CRS-10051:CVU found following errors with Clusterware setup : PRVG-1015 : Time server ".LOCL." has time offsets that are not within permissible                                                  limit "1000.0" on nodes "hostname1,hostname2".
PRVF-5424 : Clock time offset check failed
PRVF-5413 : Node "hostname1" has a time offset of -8301.9 that is beyond permissible limit of 1000.0 from NTP Time Server ".LOCL."
PRVF-5413 : Node "hostname2" has a time offset of -7348.6 that is beyond permissible limit of 1000.0 from NTP Time Server ".LOCL."

Cross check issue with cluvfy utility.

[oracle@bin]$ cluvfy comp clocksync -n all -verbose


-----------------------------------------------
-----------------------------------------------
-----------------------------------------------
-----------------------------------------------

Time Server: .LOCL.
Time Offset Limit: 1000.0 msecs
  Node Name     Time Offset               Status
  ------------  ------------------------  ------------------------
PRVF-5413 : Node "hostname1" has a time offset of -1558.9 that is beyond permissible limit of 1000.0 from NTP Time Server ".LOCL."
  hostname1    -1558.9                   failed
PRVF-5413 : Node "hostname2" has a time offset of -1199.0 that is beyond permissible limit of 1000.0 from NTP Time Server ".LOCL."
  hostname2    -1199.0                   failed
PRVF-5424 : Clock time offset check failed
Result: Clock synchronization check using Network Time Protocol(NTP) failed

PRVF-9652 : Cluster Time Synchronization Services check failed

Verification of Clock Synchronization across the cluster nodes was unsuccessful on all the specified nodes.

Crosscheck the Issue with date command for some Database Bug:

[root@ ~]# ssh hostname2 date;ssh hostname1 date

If, the date output on both nodes are same. You can ignore this error message. If, there
is difference in time on both the nodes. Follow below steps.

Solution:

Attempt to correct ntpd time with below steps on both nodes. Login using root user and execute on both nodes one by one.

[root@hostname2 ~]# service ntpd stop
[root@hostname2 ~]# ntpdate
[root@hostname2 ~]# service ntpd start

Now, crosscheck the output with below command.

[root@ ~]# ssh hostname2 date;ssh hostname1 date

If, date is same issue is resolved otherwise take help from OS admin or open a ticket to Oracle Support.

Please share your feed back about this article.

No comments:

Post a Comment