Symptoms

OA Control Panel gets down occasionally while navigating Hosting CP under some provider staff member and switching to More Services tab.

There are a lot of APS application instances created under provider.

The following sequence of messages appears in /var/log/pa/pui/pui.log on the UI node:

00:46:36.222 [default task-135] DEBUG com.tbn.VarResolver - Getting MSS var 'tenant' in scope of http://www.acronis.com/aps/cloud-backup-v1#ccp
00:46:37.380 [default task-135] DEBUG com.tbn.VarResolver - tenant:[{"aps":{"type":"http://acronis.com/aps/cloud-backup-v1/tenant/9.1","id":"8eb67e71-6b66-48f6-a479-70391e940816","status":"aps:ready","revision":356,"modified":"2017-05-19T20:11:52Z","subscription":"8889670e-0e85-435e-9f78-4738bc1a9282"},"AcronisHostedStorage":{"limit":0,"usage":70444413800},"AcronisHostedStorageMbH":{"limit":0,"usage":67182},"MailboxCount":{"limit":0,"usage":0},"MailboxCountItemH":{"limit":0,"usage":0},"MobileDeviceCount":{"limit":0,"usage":0}.
...very long results list at this point...
00:58:06.300 [default task-135] DEBUG com.tbn.ejb.NavApiBean -  690195 ms [NavApi.handleNavigation]
00:58:06.317 [default task-135] WARN  c.p.p.c.u.common.MenuTreeBuilderImpl - Failed to build menu items of plugin com.plesk.p2.cp.core.saas.Application$4@4c43f101
java.lang.RuntimeException: javax.ejb.EJBException: WFLYEJB0442: Unexpected Error
...
Caused by: java.lang.OutOfMemoryError: Java heap space

Cause

APS variable resolution of various APS applications is planned to be improved in terms of memory usage in scope of internal request APS-41609 and APS-43287.

Resolution

Until the issue is addressed in product, it is recommended to increase Java heap size on all UI nodes, provided that UI node has enough free RAM for the increased memory limit:

  1. Edit /usr/local/pem/wildfly-10.1.0.Final/bin/standalone.conf and replace -Xmx4096m with -Xmx8192m for the JAVA_OPTS variable to increase the limit from 4GB to 8GB (if the current value is less, do the same proportionally, increase it twice).

  2. Restart pau service:

    # service pau restart

Internal content