OBSOLETE BACKUPSET ARE NOT DELETED FROM THE FRA AUTOMATICALLY

Before reading this bug. I will recommend following:

If backups are not deleted from FRA even after crossing retention policy and you have configured recovery window. This is a normal behavior because RMAN keep backup until there is space crunch in FRA. So before concluding this bug. Please try to wait for space crunch when FRA is used up to 70-80% when this will be situation, backups will delete automatically. If this is not happening then you can conclude this bug.

Bug 7828095: OBSOLETE BACKUPSET ARE NOT DELETED FROM THE FRA AUTOMATICALLY

Show Bug Attributes Bug Attributes
Type B - Defect Fixed in Product Version -
Severity 2 - Severe Loss of Service Product Version 10.2.0.4.0
Status 33 - Suspended, Req'd Info not Avail Platform 226 - Linux x86-64
Created 20-Jan-2009 Platform Version 2.6.9-55.ELSMP
Updated 06-Aug-2009 Base Bug -
Database Version 10.2.0.4.0
Affects Platforms Generic
Product Source Oracle

Show Related Products Related Products
Line Oracle Database Products Family Oracle Database
Area Oracle Database Product 5 - Oracle Server - Enterprise Edition

Hdr: 7828095 10.2.0.4.0 RDBMS 10.2.0.4.0 RMAN PRODID-5 PORTID-226
Abstract: OBSOLETE BACKUPSET ARE NOT DELETED FROM THE FRA AUTOMATICALLY

*** 01/20/09 04:21 pm ***
TAR:
----
7208313.993

PROBLEM:
--------
The obsolete backupset are not deleted from the FRA automatically.

DIAGNOSTIC ANALYSIS:
--------------------
- The only files created in the FRA are the backupsets.
- The archivelog files are created under +ARCH01.
- FLASHBACK is disabled :

SQL> select flashback_on from v$datavase;

FLASHBACK_ON
------------------
NO

1 row selected.

- Information of FRA :

SQL> show parameter db_recover

NAME TYPE VALUE
------------------------------------ -----------
------------------------------
db_recovery_file_dest string +FLASH01
db_recovery_file_dest_size big integer 1540G

SQL> select name,space_limit as quota, space_used as used, space_reclaimable
as reclaimable, number_of_files as num_files
from v$recovery_file_dest;

NAME QUOTA USED RECLAIMABLE NUM_FILES
-------- ------------ ------------- ------------ --------------------

+FLASH01 1653562408960 1644048678912 316669952 1251

SQL> select file_type,percent_space_used as used, percent_space_reclaimable
as reclaimable,number_of_files as num_files
from v$flash_recovery_area_usage;

FILE_TYPE USED RECLAIMABLE NUM_FILES
------------ -------------------- -------------------- --------------------
CONTROLFILE 0 0 0
ONLINELOG 0 0 0
ARCHIVELOG 0 0 0
BACKUPPIECE 99.42 .02 1251
IMAGECOPY 0 0 0
FLASHBACKLOG 0 0 0

6 rows selected.

- Current RMAN Configuration :

RMAN> show all;

RMAN configuration parameters are:
CONFIGURE RETENTION POLICY TO RECOVERY WINDOW OF 11 DAYS;
CONFIGURE BACKUP OPTIMIZATION ON;
CONFIGURE DEFAULT DEVICE TYPE TO DISK;
CONFIGURE CONTROLFILE AUTOBACKUP OFF;
CONFIGURE CONTROLFILE AUTOBACKUP FORMAT FOR DEVICE TYPE DISK TO '%F'; #
default
CONFIGURE DEVICE TYPE DISK PARALLELISM 4 BACKUP TYPE TO COMPRESSED BACKUPSET;
CONFIGURE DATAFILE BACKUP COPIES FOR DEVICE TYPE DISK TO 1; # default
CONFIGURE ARCHIVELOG BACKUP COPIES FOR DEVICE TYPE DISK TO 1; # default
CONFIGURE CHANNEL DEVICE TYPE DISK MAXPIECESIZE 16 G;
CONFIGURE MAXSETSIZE TO UNLIMITED; # default
CONFIGURE ENCRYPTION FOR DATABASE OFF; # default
CONFIGURE ENCRYPTION ALGORITHM 'AES128'; # default
CONFIGURE ARCHIVELOG DELETION POLICY TO NONE; # default
CONFIGURE SNAPSHOT CONTROLFILE NAME TO
'/opt/oracle/product/10.2.0/db_1/dbs/snapcf_hsbcprd1.f'; # default


WORKAROUND:
-----------
Delete the backupset manually.

RELATED BUGS:
-------------
Bug 5454486 RMAN NOT DELETING OBSOLETE BACKUPSETS TO RECLAIM SPACE

REPRODUCIBILITY:
----------------
On custoemr site.

TEST CASE:
----------
Enable the FRA.
Take the backup creating the backup pieces in the FRA.

STACK TRACE:
------------

SUPPORTING INFORMATION:
-----------------------
I will upload the files.

24 HOUR CONTACT INFORMATION FOR P1 BUGS:
----------------------------------------

DIAL-IN INFORMATION:
--------------------

IMPACT DATE:
------------

*** 01/20/09 04:22 pm ***
DIAGNOSTIC ANALYSIS:
---------------------

There are obsolete backups :

RMAN> report obsolete;

RMAN retention policy will be applied to the command
RMAN retention policy is set to recovery window of 11 days
Report of obsolete backups and copies
Type Key Completion Time Filename/Handle
-------------------- ------ ------------------ --------------------
Backup Set 221876 04-JAN-09
Backup Piece 221885 04-JAN-09
+FLASH01/hsbcprd1/backupset/2009_01_04/annnf0_090104_0000_arch_0.779.675216055

Backup Set 221877 04-JAN-09
Backup Piece 221886 04-JAN-09
+FLASH01/hsbcprd1/backupset/2009_01_04/annnf0_090104_0000_arch_0.781.675216055

:::::::::
Backup Set 225845 05-JAN-09
Backup Piece 225851 05-JAN-09
+FLASH01/hsbcprd1/backupset/2009_01_05/annnf0_090105_0100_hot_l1_0.918.6753060
77
Backup Set 225846 05-JAN-09
Backup Piece 225852 05-JAN-09
+FLASH01/hsbcprd1/backupset/2009_01_05/annnf0_090105_0100_hot_l1_0.925.6753060
77
Backup Set 225847 05-JAN-09
Backup Piece 225853 05-JAN-09
+FLASH01/hsbcprd1/backupset/2009_01_05/annnf0_090105_0100_hot_l1_0.920.6753060
77

- The backup failed with the error :

RMAN-6731: command backup:1.9% complete, time left 268:37:11
RMAN-6731: command backup:1.9% complete, time left 268:37:11
RMAN-6731: command backup:1.9% complete, time left 268:37:11
RMAN-571: ===========================================================
RMAN-569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-571: ===========================================================
RMAN-3009: failure of backup command on ORA_DISK_1 channel at 01/16/2009
15:08:45
RMAN-10038: database session for channel ORA_DISK_1 terminated unexpectedly

- In the alert file, is possible to see that the following error warning was
reported some minutes after the backup failed :

Fri Jan 16 15:29:03 2009
Errors in file /opt/oracle/admin/hsbcprd1/udump/hsbcprd1_ora_19024.trc:
ORA-19815: WARNING: db_recovery_file_dest_size of 1653562408960 bytes is
100.00%
used, and has 6291456 remaining bytes available.
Fri Jan 16 15:29:03 2009
************************************************************************
You have following choices to free up space from flash recovery area:
1. Consider changing RMAN RETENTION POLICY. If you are using Data Guard,
then consider changing RMAN ARCHIVELOG DELETION POLICY.
2. Back up files to tertiary device such as tape using RMAN
BACKUP RECOVERY AREA command.
3. Add disk space and increase db_recovery_file_dest_size parameter to
reflect the new space.
4. Delete unnecessary files using RMAN DELETE command. If an operating
system command was used to delete files, then use RMAN CROSSCHECK and
DELETE EXPIRED commands.
************************************************************************

- The following event was enabled before to take the backup in order to
generate more information :

SQL> alter session set events 'immediate trace name kra_trace level 3';

- The event was disabled after the information was gotten using the command :


SQL> alter session set events 'immediate trace name kra_trace level 4';

- According to the documentation :


"Oracle and RMAN create files in the flash recovery area until the space used
reaches the flash recovery area disk limit. Then, Oracle deletes the minimum
set of existing files from the flash recovery area that are obsolete,
redundant copies, or backed up to tertiary storage. Oracle warns the user
when available disk space is less than 15%, but it continues to fill the disk
to 100% of the flash recovery area disk limit."



*** 01/20/09 04:28 pm *** (CHG: Sta->16)
*** 01/20/09 04:28 pm ***

Controlfile.zip ---> Controlfile dump
TraceFiles1.zip ---> RMAN logfile and trace files and FRA Information
Udump.zip and Bdump.zip ---> Trace files generated in udump and bdump
when the events kra_trace level 3 was set.

*** 01/20/09 05:35 pm ***
*** 01/20/09 05:56 pm ***
*** 01/20/09 05:56 pm *** (CHG: Sta->30 Asg->NEW OWNER)
*** 01/20/09 08:24 pm ***
*** 01/24/09 12:34 am ***
*** 01/24/09 12:34 am ***
*** 02/09/09 02:48 pm ***
*** 03/09/09 05:51 pm *** (CHG: Sta->33 SubComp->UNKNOWN)
*** 03/09/09 05:51 pm ***
*** 03/24/09 12:38 pm ***
Bug 7828095: OBSOLETE BACKUPSET ARE NOT DELETED FROM THE FRA AUTOMATICALLY

No comments:

Post a Comment