Once you have created a connection in AWS Glue, you can create and run an ETL job.

Take the following steps to create and run an ETL job in AWS Glue Studio.

  1. Sign in to the AWS Glue Studio Console.
  2. Click the Create and manage jobs icon.
  3. Under Create job, select Source and target added to the graph; then, provide values for the following drop-down menus:
    • Source: Select Progress DataDirect Cloud Connector for Salesforce.
    • Target: Select the S3 bucket.
      Note: You can also select a Glue Data Catalog target, when that work flow becomes available.
  4. Click Create.
  5. On the Visual tab, select the Progress DataDirect Cloud Connector for Salesforce node.
  6. Select your connection from the Connection drop-down menu.
  7. Choose one of the following:
    • Enter table name: Enter the table name against which you want to execute the ETL job.
    • Write a query: Specify a query to be used to return the data against which you want to execute the ETL job.
    Note: Optionally, you can use the Filter predicate field, schema editor, Partition column field, or Data type casting feature to further modify the data that is to be returned.
  8. Select the Data target node. Then provide values for the following fields:
    • Format: Select the target format of your output.
    • Compression Type: Optionally, select the format to use when compressing output.
    • S3 Target Location: The target location for output.
  9. Select the Job details tab. Provide values for the following fields:
    • Name: Provide the name of your job.
    • Description: Optionally, provide a description of your job.
    • IAM Role: The role assumed by the job with permission to access your data sources. For more information, see Updating IAM Role permissions.

    The remaining fields on this tab should be configured to suit your environment.

  10. Click Save; then, Run.
  11. Select Run details to view the status of your run.
  12. After the run has succeeded, navigate to your job:
    1. Open the AWS Management Console
    2. Under Storage, select S3.
    3. Select your bucket from the list; then, select your job from the Objects list.
  13. Download your job using the Object actions menu.