Hybrid Data Pipeline enables access to a variety of data stores, such as Apache Hive, DB2, SQL Server, Oracle, and Salesforce. To access data residing on a backend data store, Hybrid Data Pipeline administrators or users must create a Hybrid Data Pipeline data source. A Hybrid Data Pipeline data source can be created by specifying parameters associated with a specific data store. The information provided in the data source allows the service to connect to the backend data store. A data source can be created with the Web UI or the Data Sources API.
Note: While administrators can create their own data sources with the Web UI, they cannot create or modify data sources on behalf of users in the Web UI. In addition, administrators cannot set permissions on data sources with the Web UI. To create data sources on behalf of a user or set permissions on data sources, an administrator must execute API operations with the Data Sources API. See User provisioning for use cases with example API operations.
Hybrid Data Pipeline also supports OData access to backend data stores. This access is enabled by specifying the appropriate parameters and configuring an OData schema under the OData tab. OData access occurs over HTTPS (or HTTP) and does not require a driver to be installed locally. Each OData-enabled data source exposes an OData schema. The name of this data source becomes part of the resource path in the OData URI. A data source group can be created to enable OData access from multiple schemas using a single resource path. A data source group can contain references to multiple data sources that have been enabled for OData. These data sources can be specified when the group is created, or added later. For more information, see Configuring data sources for OData connectivity and working with data source groups.
In addition, Hybrid Data Pipeline supports SQL read-only access to JSON-based REST services through the Autonomous REST Connector. When you create a REST data source, the connector creates a relational model of the returned JSON data and translates SQL statements to REST API requests. You can create and manage REST data sources either through the Web UI or through the Hybrid Data Pipeline API. For details, see Creating and using REST data sources and Autonomous REST Connector parameters.
The following topics provide instructions on how to create a data source using the Web UI. The first topic provides step-by-step instructions for creating a data source. The subsequent topics describe the parameters that can be used to define a data source for each data store supported by Hybrid Data Pipeline.
