Applications Systems

SAM monitors are failing intermittently

All SAM monitors are failing intermittently with connection errors. The following error is visible in the logs: An operation on a socket could not be performed because the system lacked sufficient buffer space or because a queue was full.

First published date

11/15/2018 2:52 AM

Last published date

6/26/2020 5:35 AM

Overview

All SAM monitors are failing intermittently with connection errors. The following error is visible in the logs:

An operation on a socket could not be performed because the system lacked sufficient buffer space or because a queue was full.

Product section

Server Application Monitor

Cause

One of the nodes is not closing the RPC connections properly in the monitored server.

Resolution

Do one of the following to resolve this issue:

Fix the monitored server (it is recommended that you consult this with your Windows Administrator).
- You can help identify the node that might be causing the issue via running the following command from the command prompt:
  - Netstat -aon
- Once you have run that command, look for the ip address of a node that you are monitoring that has a lot of TIME_WAIT or CLOSE_WAIT status on it.
You can remove the node from the monitoring server, or you can also try increasing the number of ephemeral ports.
Please see this article for how to increase the port allowances:
- How to increase ephemeral port allowances

Disclaimer: Please note, any content posted herein is provided as a suggestion or recommendation to you for your internal use. This is not part of the SolarWinds software or documentation that you purchased from SolarWinds, and the information set forth herein may come from third parties. Your organization should internally review and assess to what extent, if any, such custom scripts or recommendations will be incorporated into your environment. You elect to use third-party content at your own risk, and you will be solely responsible for the incorporation of the same if any.