Security Compliance

How to avoid throttling and list item problems in a Sharepoint online scan in ARM

This article explains how to mitigate a problem with the throttling and 'List Item' problems in a Sharepoint Online scan in ARM.

First published date

6/7/2021 1:02 PM

Last published date

11/19/2024 9:22 PM

Overview

Sometimes the Sharepoint Online scan hangs because of throttling and the duration is very long or it does not complete at all. Also, if the scan completes the 'List Items' will display a warning as below. In the log file, the respective error logs will show the below information.

TS.SP.SPScanProcessor.GetListItems |<Date|Timestamp>|Error ] GenericLogMessageHelper.LogMessages(ITechnologyService technologyService): <Date Timestamp> |11 | Error getting items for list --> cancel scan | Title: Documents | ID:  | Error: System.Exception: SPSharedClientContextPool.GetNewClientContext | Error creating new context after 5 attempts | Error: System.Net.WebException: The remote server returned an error: (429).

TS.SP.SPScanProcessor.IncludeListItems |<Date|Timestamp>|Error ] GenericLogMessageHelper.LogMessages(ITechnologyService technologyService): <Date Timestamp> |12 | Error check if list items should be scanned for list --> cancel scan | Title: Documents | ID:  | Error after 0 items | Error: Microsoft.SharePoint.Client.ServerException: The attempted operation is prohibited because it exceeds the list display threshold.
 

Product section

Access Rights Manager

Cause

  • Maybe too many connection attempts are being tried for Sharepoint Online.
  • Maybe the list items are blocked by another application, so ARM can't read them.

Resolution

  • The scan is unusually slow. To avoid throttling errors please do the following.
  • Please set the parallel requests to one or two.
  • The scan account should only be used in ARM and not in other applications. 
  • Please set the "Maximum connection renew attempts" to one to see if other errors occur that are not visible.
  • The mentioned settings can be set in the 'Additional properties ' in the Sharepoint scan configuration as described below.
  • image.png
  • Regarding the 'List Items'. You could turn them off completely (“Exclude list items”)
  • Maybe it is enough to disable only the hidden entries (“Exclude hidden list”) in the scan. These are not always necessary and are often used by other applications.