Symptoms
Backup retention does not work and failed backups are not getting deleted from Virtuozzo backup nodes.
As a result, there are a lot of extra backups, not visible in PCP or CCP for the affected VEs.
Cloud Infrastructure Log is filling up with Failed to backup VE events.
Cause
Stuck entries in backups_to_remove table due to various reasons in the past lead to no backup removal at all in OACI environment. The issue is improved in scope of requests CCU-14886 and CCU-15055, both resolved in Odin Automation 7.2.
As a consequence, backups are getting created without rotation, eating up disk space on the backup nodes and leading to new VE backups failing.
Resolution
Restart OACI IM service to reset the queue of removing backups:
# service PACI-im restart