skip to main content
Administering Hybrid Data Pipeline : Configuring row limit throttling
  

Try Now

Configuring row limit throttling

Hybrid Data Pipeline supports limiting query results to a specified number of rows (row limit throttling). Throttling is handled with the MaxFetchRows limit in the Limits API. The MaxFetchRows limit can be applied at four levels: system, tenant, user, and data source. The following hierarchy applies to these levels.
1. Data source
2. User
3. Tenant
4. System
A row limit set on a data source overrides any row limit set at the other levels; a row limit set on a user account overrides a row limit set on a tenant or at the system level; a row limit set on a tenant overrides a row limit set at the system level; and a row limit set at the system level overrides the default row limit. Default and system limits apply to behavior across Hybrid Data Pipeline, while limits on data sources, users, and tenants apply to the resources they handle.
To configure row limit throttling, the administrator must have either the Administrator (12) or the Limits (27) permission. As shown in the following examples, a limit can be applied by executing a POST request on the system level or on a given resource.

System level operation

The following POST creates a system-level limit of 1000 rows. The number 1 is the ID of the MaxFetchRows limit. The payload passes 1000 as the value for this limit.
POST https://<myserver>:<port>/api/admin/limits/system/1
{
"value": 1000
}

Tenant operation

The following POST sets a limit of 1500 rows on the specified tenant. The number 32 is the ID of the tenant, and the number 1 is the ID of the MaxFetchRows limit. The payload passes 1500 as the value for this limit.
POST https://<myserver>:<port>/api/admin/limits/tenants/32/1
{
"value": 1500
}

User account operation

The following POST sets a limit of 2000 rows on the specified user account. The number 86 is the ID of the user account, and the number 1 is the ID of the MaxFetchRows limit. The payload passes 2000 as the value for this limit.
POST https://<myserver>:<port>/api/admin/limits/users/86/1
{
"value": 2000
}

Data source operation

The following POST sets a limit of 2500 rows on the specified data source. The number 86 is the ID of the user account; the number 14 is the ID of the data source that is owned by the user account; and the number 1 is the ID of the MaxFetchRows limit. The payload passes 2500 as the value for this limit.
PUT https://<myserver>:<port>/api/admin/limits/users/86/datasources/14/1
{
"value": 2500
}
See Limits API for further details.