Hybrid Data Pipeline enables access to data that resides behind a firewall with the On-Premises Connector (OPC). The OPC is a software component that must be installed on the same network in which the data store resides. The OPC maintains a communication channel with the Hybrid Data Pipeline service hosted on your AWS EC2 instance. When the hosted Hybrid Data Pipeline service requires access to the data source, it uses this communication channel to send a connection request to the OPC. In turn, the OPC opens a connection between the hosted Hybrid Data Pipeline service and the data source. Currently, the OPC is only supported on Windows machines.

Before you can install the OPC, you must set up an installation directory with the installer executable and four configuration and certificate files generated during the Hybrid Data Pipeline server installation.

Create an installation directory and download the OPC installer

Take the following steps to create an installation directory and download the OPC installer.

  1. Create an OPC installation directory. For example:

    c:\temp\hdp-opc-installer\

  2. Go to the DataDirect Connectors Download page, complete the download form, and click DOWNLOAD.
  3. Click the On-Premises Connector tab.
  4. Download the OPC installer executable. The following executable will be downloaded.

    PROGRESS_DATADIRECT_HDP_OPCONNECTOR_WIN_64.exe

  5. Copy the executable to the installation directory.

Obtain the Hybrid Data Pipeline configuration and certificate files

Take the following steps to obtain the configuration and certificate files generated during the installation of the Hybrid Data Pipeline server.

Note:

  • The configuration and certificate files generated during the installation of the Hybrid Data Pipeline server are located in the redist folder of the installation directory. For example:

    /home/ec2-user/Progress/DataDirect/Hybrid_Data_Pipeline/Hybrid_Server/redist/

  • These are the Hybrid Data Pipeline server files you must obtain:
    • config.properties
    • OnPremise.properties
    • ddcloud.pem
    • ddcloudTrustStore.jks

Copy the configuration and certificate files from the installation directory on your EC2 instance to the Windows installer directory.

In the following example, an SCP client was used to copy the files from the EC2 instance to the Windows machine.

scp -i C:\hdp-aws\hdp-on-aws.pem ec2-user@ec2-12-34-56-78.compute-1.a
mazonaws.com:/home/ec2-user/Progress/DataDirect/Hybrid_Data_Pipeline/Hybrid_Serv
er/redist/config.properties c:\temp\hdp-opc-installer\

scp -i C:\hdp-aws\hdp-on-aws.pem ec2-user@ec2-12-34-56-78.compute-1.a
mazonaws.com:/home/ec2-user/Progress/DataDirect/Hybrid_Data_Pipeline/Hybrid_Serv
er/redist/ddcloud.pem c:\temp\hdp-opc-installer\

scp -i C:\hdp-aws\hdp-on-aws.pem ec2-user@ec2-12-34-56-78.compute-1.a
mazonaws.com:/home/ec2-user/Progress/DataDirect/Hybrid_Data_Pipeline/Hybrid_Serv
er/redist/ddcloudTrustStore.jks c:\temp\hdp-opc-installer\

scp -i C:\hdp-aws\hdp-on-aws.pem ec2-user@ec2-12-34-56-78.compute-1.a
mazonaws.com:/home/ec2-user/Progress/DataDirect/Hybrid_Data_Pipeline/Hybrid_Serv
er/redist/OnPremise.properties c:\temp\hdp-opc-installer\
Note: For additional information, refer to Transfer files to Linux instances using an SCP client in the Amazon EC2 User Guide for Linux Instances.

Result: You have all the files that you need to run the OPC installer. Your installation directory should include the following files:

  • PROGRESS_DATADIRECT_HDP_OPCONNECTOR_WIN_64.exe
  • config.properties
  • OnPremise.properties
  • ddcloud.pem
  • ddcloudTrustStore.jks

Next steps: