Network Management
SWJobEngineSvc2.exe crashes once a day with Event id 1026 on agent nodes in the SolarWinds Platform
In environments running SolarWinds Platform 2024.2 and 2024.2.1, agent nodes fail every night simultaneously, generating event log id 1026, System.IO.FileNotFoundException. The stack trace shows an exception for SolarWinds.JobEngine.Routing.RouterTrackingStoreCache.RemoveEmptyRouters(System.Object).
First published date
Last published date
Overview
On an Agent node monitored by the SolarWinds Platform, errors relating to a crash can be found in the Windows Event logs. These logs are found by right-clicking the Start menu > Event Viewer > Windows Logs > Application. These errors do not affect the functionality of the agent, which recovers after the crash, and below is the full error message:
Event id 1026 Description: The process was terminated due to an unhandled exception.
Exception Info: System.IO.FileNotFoundException at SolarWinds.JobEngine.Routing.RouterTrackingStoreCache.RemoveEmptyRouters(System.Object)
Opening the logs on the agent at C:\ProgramData\SolarWinds\JobEngine.v2\Logs_Agent will display the following: FATAL
SolarWinds.JobEngine.ServiceProcess.SolarWindsService - (null) Unhandled exception caught System.IO.FileNotFoundException: Could not load file or assembly 'SolarWinds.Orion.Common, Version=2024.2.0.0, Culture=neutral, PublicKeyToken=null' or one of its dependencies. The system cannot find the file specified. File name: 'SolarWinds.Orion.Common, Version=2024.2.0.0, Culture=neutral, PublicKeyToken=null' at SolarWinds.JobEngine.Routing.RouterTrackingStoreCache.RemoveEmptyRouters(Object state)Product section
Cause
This issue occurs due to a known issue in the SolarWinds Platform on 2024.2 and 2024.2.1.
Resolution
To resolve this issue, please upgrade to SolarWinds Platform 2024.4 and above. Until then, please use the workaround below to address this:
- Connect to the agent node.
- Navigate to C:\Program Files (x86)\SolarWinds\Agent\Plugins\JobEngine.
- Open the SWJobEngineSvc2.exe.config file:
- Navigate to the following section of the file:
<!--AgentPlugin operation mode settings--> <jobEngineSettings_AgentPlugin maxWorkerProcess="1"
- Add the following to the end of the line:
emptyRouterCleanupInterval="24.00:00:00"
- Save the file.
- Restart the Agent service on the node.
- Open Services.msc from the Windows Run window (shortcut: Win+R).
- Select the SolarWinds Agent service, and Restart the service.