Symptoms
A core dump file was created on the Management Node in /usr/local/pem/var/cores/ directory on SaaS Service Controller crash. The panel itself was not accessible at the time but it was brought up by restoring SaaS SC by watchdog service.
The following back trace can be investigated with gdb utility:
$ gdb -c core.11195 /usr/local/pem/bin/SoLoader...Using host libthread_db library "/lib64/libthread_db.so.1".Core was generated by `/usr/local/pem/bin/SoLoader --sc_id=12 --sc="SaaS:/usr/local/pem/libexec/SaaS.s'.Program terminated with signal 11, Segmentation fault.#0 0x00007f23ca52e450 in SDK::Platform::ServantBase::poa() const () from /usr/local/pem/libexec/SaaS.so.8.0.0.1001Missing separate debuginfos, use: debuginfo-install pa-core-8.0.0.254-1.x86_64(gdb) bt#0 0x00007f23ca52e450 in SDK::Platform::ServantBase::poa() const () from /usr/local/pem/libexec/SaaS.so.8.0.0.1001#1
0x00007f23ca522d23 in
SDK::Platform::TransactionScope::Keep::Impl::checkInit() () from
/usr/local/pem/libexec/SaaS.so.8.0.0.1001#2
0x00007f23ca524735 in
SDK::Platform::TransactionScope::Keep::Impl::getShelf(std::string
const&) () from /usr/local/pem/libexec/SaaS.so.8.0.0.1001#3
0x00007f23ca521d3c in
SDK::Platform::TransactionScope::Keep::getShelf(std::string const&)
() from /usr/local/pem/libexec/SaaS.so.8.0.0.1001#4
0x00007f23ca30ede2 in Plesk::APS::APSC::(anonymous
namespace)::TransactMgr::getCurrentWeak() [clone .isra.96] () from
/usr/local/pem/libexec/SaaS.so.8.0.0.1001#5
0x00007f23ca30f0ee in Plesk::APS::APSC::(anonymous
namespace)::srvInterceptor::send_exception(PortableInterceptor::ServerRequestInfo*)
() from /usr/local/pem/libexec/SaaS.so.8.0.0.1001#6
0x00007f23d26ded15 in
TAO::ServerRequestInterceptor_Adapter_Impl::send_exception(TAO_ServerRequest&,
TAO::Argument* const*, unsigned long,
TAO::Portable_Server::Servant_Upcall*, CORBA::TypeCode* const*, unsigned
int) ()from /lib64/libTAO_PI_Server.so.2.2.1#7
0x00007f23d245289b in TAO_Object_Adapter::dispatch(TAO::ObjectKey&,
TAO_ServerRequest&, TAO_Pseudo_Out_T<CORBA::Object>) () from
/lib64/libTAO_PortableServer.so.2.2.1#8
0x00007f23d3521d72 in
TAO_Adapter_Registry::dispatch(TAO::ObjectKey&,
TAO_ServerRequest&, TAO_Pseudo_Out_T<CORBA::Object>) () from
/lib64/libTAO.so.2.2.1#9
0x00007f23d358f614 in TAO_Request_Dispatcher::dispatch(TAO_ORB_Core*,
TAO_ServerRequest&, TAO_Pseudo_Out_T<CORBA::Object>) () from
/lib64/libTAO.so.2.2.1#10
0x00007f23d35354ee in
TAO_GIOP_Message_Base::process_request(TAO_Transport*,
TAO_InputCDR&, TAO_OutputCDR&,
TAO_GIOP_Message_Generator_Parser*) () from /lib64/libTAO.so.2.2.1#11
0x00007f23d35361b6 in
TAO_GIOP_Message_Base::process_request_message(TAO_Transport*,
TAO_Queued_Data*) () from /lib64/libTAO.so.2.2.1#12
0x00007f23d35b4b0c in
TAO_Transport::process_parsed_messages(TAO_Queued_Data*,
TAO_Resume_Handle&) () from /lib64/libTAO.so.2.2.1#13 0x00007f23d35b5177 in TAO_Transport::process_queue_head(TAO_Resume_Handle&) () from /lib64/libTAO.so.2.2.1#14
0x00007f23d35b567e in
TAO_Transport::handle_input_parse_data(TAO_Resume_Handle&,
ACE_Time_Value*) () from /lib64/libTAO.so.2.2.1#15 0x00007f23d35b5aee in TAO_Transport::handle_input(TAO_Resume_Handle&, ACE_Time_Value*) () from /lib64/libTAO.so.2.2.1#16 0x00007f23d35266c7 in TAO_Connection_Handler::handle_input_internal(int, ACE_Event_Handler*) () from /lib64/libTAO.so.2.2.1#17 0x00007f23d35268f6 in TAO_Connection_Handler::handle_input_eh(int, ACE_Event_Handler*) () from /lib64/libTAO.so.2.2.1#18 0x00007f23d39537fe in ACE_TP_Reactor::dispatch_socket_event(ACE_EH_Dispatch_Info&) () from /lib64/libACE.so.6.2.1#19 0x00007f23d3953910 in ACE_TP_Reactor::handle_socket_events(int&, ACE_TP_Token_Guard&) () from /lib64/libACE.so.6.2.1#20 0x00007f23d3953b8e in ACE_TP_Reactor::dispatch_i(ACE_Time_Value*, ACE_TP_Token_Guard&) () from /lib64/libACE.so.6.2.1#21 0x00007f23d3953e26 in ACE_TP_Reactor::handle_events(ACE_Time_Value*) () from /lib64/libACE.so.6.2.1#22 0x00007f23d3577e5e in TAO_ORB_Core::run(ACE_Time_Value*, int) () from /lib64/libTAO.so.2.2.1#23 0x000000000046e910 in Loader_impl::svc() ()#24 0x00007f23d3948fe7 in ACE_Task_Base::svc_run(void*) () from /lib64/libACE.so.6.2.1#25 0x00007f23d394a6d5 in ACE_Thread_Adapter::invoke_i() () from /lib64/libACE.so.6.2.1#26 0x00007f23d394a61f in ACE_Thread_Adapter::invoke() () from /lib64/libACE.so.6.2.1#27 0x00007f23d44e5e25 in start_thread (arg=0x7f23acdfa700) at pthread_create.c:308#28 0x00007f23cf12634d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:113
Cause
The issue is recognized as a code flow with internal request ID #OA-2920.
Resolution
The architecture of SaaS Sservice Controller has been significantly reworked in scope of #PFR-837 in Odin Automation version 8.2. Consider an upgrade to the latest OA version available to ensure more stable SaaS Service Controller work.