Hybrid Data Pipeline supports limiting query results to a specified number of rows (row limit throttling). Throttling is handled with the MaxFetchRows limit. The MaxFetchRows limit can be applied at four levels: system, tenant, user, and data source. The following hierarchy applies to these levels.
1. Data source
2. User
3. Tenant
4. System
A row limit set on a data source overrides any row limit set at the other levels; a row limit set on a user account overrides a row limit set on a tenant or at the system level; a row limit set on a tenant overrides a row limit set at the system level; and a row limit set at the system level overrides the default row limit. Default and system limits apply to behavior across Hybrid Data Pipeline, while limits on data sources, users, and tenants apply to the resources they handle.
To configure row limit throttling, the administrator must have either the Administrator (12) or the Limits (27) permission.
System level configuration
Row limit throttling can be configured at the system level either with the Web UI or with the Limits API. For details on using the Web UI, see Manage Limits view.
The following POST creates a system-level limit of 1000 rows. The number 1 is the ID of the MaxFetchRows limit. The payload passes 1000 as the value for this limit.
POST https://<myserver>:<port>/api/admin/limits/system/1
{
"value": 1000
}
Tenant configuration
Row limit throttling can be configured at the tenant level either with the Web UI or with the Limits API. For details on using the Web UI, see Manage Limits view.
The following POST sets a limit of 1500 rows on the specified tenant. The number 32 is the ID of the tenant, and the number 1 is the ID of the MaxFetchRows limit. The payload passes 1500 as the value for this limit.
POST https://<myserver>:<port>/api/admin/limits/tenants/32/1
{
"value": 1500
}
User account configuration
Row limit throttling can be configured at the user level either with the Web UI or with the Limits API. For details on using the Web UI, see Manage Users view.
The following POST sets a limit of 2000 rows on the specified user account. The number 86 is the ID of the user account, and the number 1 is the ID of the MaxFetchRows limit. The payload passes 2000 as the value for this limit.
POST https://<myserver>:<port>/api/admin/limits/users/86/1
{
"value": 2000
}
Data source configuration
Row limit throttling can only be configured at the data sources level using the Limits API. The following POST sets a limit of 2500 rows on the specified data source. The number 86 is the ID of the user account; the number 14 is the ID of the data source that is owned by the user account; and the number 1 is the ID of the MaxFetchRows limit. The payload passes 2500 as the value for this limit.
PUT https://<myserver>:<port>/api/admin/limits/users/86/datasources/14/1
