Manage data sources
- Last Updated: November 19, 2026
- 4 minute read
- Documentation
A data source is a saved connection to an external system that holds your content. Pipelines use data sources to read content and import it into a dataset. Data sources belong to your account rather than to a single project, so you can use one data source in pipelines across several projects.
This topic covers the following:
- Supported data sources
- Create a data source
- View a data source
- Test a connection
- Edit a data source
- Share a data source
- Delete a data source
Before you begin
- To view and test data sources, you must have the Data Source User platform role.
- To create, edit, or delete data sources, you must have the Data Source Admin platform role. To edit or delete a data source, you also need Writer access to it.
If you do not have the required roles, ask an account owner to assign them. See Manage platform access for details.
Supported data sources
You can connect to the following types of systems:
| Type | Description |
|---|---|
| Amazon S3 | Files stored in an Amazon S3 bucket. |
| Azure Storage | Files stored in Azure Storage. |
| Google Cloud Storage | Files stored in a Google Cloud Storage bucket. |
| External Database | Records in a relational database that you connect to using JDBC. |
| MarkLogic | Documents in a MarkLogic database. |
The types available to you might vary based on your account. For file-based data sources, you also choose the file type and read options used to read the files. See File types and read options for more information. For descriptions of the options for each type, see Data source options.
Create a data source
To create a data source:
- Select Data Sources from the sidebar menu.
- In the Data Sources view, click New Data Source. The Connect Source window opens.
- Select the data source type.
- Provide values for the following fields:
- Title: A name for the data source. For example,
Production S3 Bucket. - (Optional) Description: A description of the data source.
- The connection fields for the selected type, such as the location of the content and the credentials to access it. Required fields are marked with an asterisk. See Data source options for details.
- For file-based sources, also set the file type and read options. See File types and read options. Required fields are marked with an asterisk.
- Title: A name for the data source. For example,
- Click Connect.
Note: You can also create a data source while you create a pipeline. In the pipeline's Data Source field, select Create New Data Source.
View a data source
To view a data source, select Data Sources from the sidebar menu, and then select the data source. The data source view shows:
- The data source type and its connection settings. Secret values, such as passwords and keys, are hidden.
- A status badge:
- Ready: The data source is configured and can be used by pipelines.
- Needs configuration: The data source settings are incomplete or no longer valid. Edit the data source to correct them.
- Used by Pipelines: The pipelines, across all projects, that use this data source.
- Sharing: The users who have access to the data source.
Test a connection
To confirm that Progress Data Platform can reach the external system, open the data source and click Test Connection in the Actions panel. You can also select Test Connection from the data source's actions menu in the Data Sources view. Data Platform displays a message that indicates whether the test succeeded.
If the test fails, review the message and the data source settings. If the data source is not publicly reachable, make sure that your network allows connections from Data Platform. See Network requirements.
Edit a data source
To edit a data source:
Open the data source and click Edit in the Actions panel.
Update the settings. See Data source options for details.
Note: Saved secret values are hidden. Leave a secret field unchanged to keep its saved value.
Click Save Changes.
Changes apply to the next run of every pipeline that uses the data source.
Share a data source
Use the Sharing panel in the data source view to give other account users access to the data source. Assign each user one of the following roles:
- Reader: Can view the data source.
- Writer: Can view the data source. Writers who also have the Data Source Admin platform role can edit and delete the data source and manage who has access to it. See Manage platform access for more information.
Delete a data source
To delete a data source, open it and click Delete in the Actions panel, and then confirm.
You cannot delete a data source that is used by a pipeline. To delete it, first delete the pipelines listed under Used by Pipelines, or edit them to use a different data source.
Note: Creating, editing, and deleting data sources require the appropriate account permissions. If these actions are unavailable, contact your account administrator.