Powered by Zoomin Software. For more details please contactZoomin

DataDirect ODBC ReadMe

Apache Spark SQL ODBC 8.0.2 Windows

  • Last Updated: May 8, 2026
  • 12 minute read
    • OpenAccess SDK
    • Documentation

     README
     Progress (R) DataDirect (R)
     
     Progress(R) DataDirect(R) for ODBC for 
     Apache Spark SQL(TM) Wire Protocol Driver 
     
     Windows Platforms (32- and 64-bit) 
     8.0.2 Release  
     April 2026


***********************************************************************
Copyright (C) 2026 Progress Software Corporation and/or its 
subsidiaries or affiliates. All Rights Reserved.

***********************************************************************


This README file contains information for Progress(R) DataDirect  
for ODBC for Apache Spark SQL(TM) Wire Protocol Driver. 

This README file contains information not included in the PROGRESS
DATADIRECT(R) FOR ODBC FOR APACHE SPARK SQL WIRE PROTOCOL DRIVER USER'S GUIDE
AND REFERENCE.


CONTENTS

Post-GA Product Announcements
Requirements
Installation Directory
Data Source and Platform Support
Third-party Components Compatibility Matrix
Changes Since 8.0.2 GA
Changes for 8.0.2 GA 
Changes for 8.0.1 GA
Features for 8.0.0 GA 
Driver WorkAround Options
Notes, Known Problems, and Restrictions
Documentation
Uninstalling the Driver
Installed Files


   Post-GA Product Announcements

The readme files will no longer be updated with product announcements and new 
features after the General Availability (GA) of the product. For the latest 
updates and enhancements, please refer to the release notes 
(https://www.progress.com/datadirect-connectors/whats-new).


    Requirements

* The installer program requires a JVM that is Java SE 11 or higher, including
  Oracle JDK, OpenJDK, and IBM SDK (Java) distributions.

* The driver requires the following runtime library:
  Microsoft Visual C/C++ runtime version 14.40.33810 or higher

* IMPORTANT: You must have the Microsoft Data Access Components (MDAC) 
  installed to use this product.
 
  - For 32-bit Windows systems, version 2.6 or higher is required.
  - For 64-bit Windows systems, version 2.8 or higher is required.

  Depending on the version of your Windows operating system, these 
  components may already be installed. You can download a utility that 
  determines whether MDAC is installed and its version from the following
  Microsoft site:

  http://msdn.microsoft.com/en-us/data/aa937730.aspx

  You can also download MDAC from the same site.
 

    Installation Directory 

* The default installation directory for the 32-bit driver on a 64-bit 
  system is:

  C:\Program Files (86)\Progress\DataDirect\ODBC

* The default installation directory for all other installations is:

  C:\Program Files\Progress\DataDirect\ODBC


    Data Source and Platform Support

For the latest data source and platform support information, refer to the 
Product Compatibility Guide: 
https://docs.progress.com/bundle/datadirect-product-compatibility/resource/
datadirect-product-compatibility.pdf


    Third-party Components Compatibility Matrix

For information about the third-party components that are installed with the 
product, refer to the ODBC Third-party Components Compatibility Matrix on the 
DataDirect Product Life Cycle page:
https://docs.progress.com/bundle/datadirect-product-life-cycle/page/topics/
datadirect_life_cycle/datadirect-product-life-cycle.html


    Changes Since 8.0.2 GA  

Debugging Symbols
-----------------
The product package now includes .pdb files. These files contain debugging 
symbols that can be used for diagnosing and debugging issues in the driver.

Windows Runtime Version Upgrade
-------------------------------
The driver is now compiled with a Visual Studio 2022 compiler for Windows 
platforms. As a result, you must have Microsoft Visual C/C++ runtime 
version 14.40.33810 or higher on your machine to run the driver.


JRE Requirement for the Installer
---------------------------------
The installer program now requires you to install a JRE that is Java SE 11 or
higher before running the installer. In earlier versions, the JRE used by the
installer program was included in the product. However, to avoid potential
security vulnerabilities, the installer program no longer includes a JRE.
Instead, the installer program uses the JRE in your environment to allow for
the most secure version of a JRE to be used.
 
Notes:
* This change does not affect the JVM requirements for the driver. For the latest 
  driver requirements, refer to the Product Compatibility Guide:
  https://docs.progress.com/bundle/datadirect-product-compatibility/resource/
  datadirect-product-compatibility.pdf
* The installer program cannot remove the already installed JRE files from the 
  install directory automatically. Remove them manually.


ICU Library Upgrade (74.1)
--------------------------
The ICU library files that are installed with the product have been 
upgraded to version 74.1. As a part of this upgrade, the ICU library 
file names have changed:
* For the 32-bit driver: From ivicu28.dll to ivicu.dll
* For the 64-bit driver: From ddicu28.dll to ddicu.dll

This upgrade is available starting in build 08.02.1072 of the ICU 
library files.

SSL Enhancement (3.0.9)
-----------------------
Note: OpenSSL library 3.0.9 has been replaced with a later version. For 
the latest information about the third-party components that are installed 
with the product, refer to the ODBC Third-party Components Compatibility 
Matrix on the DataDirect Product Life Cycle page:
https://docs.progress.com/bundle/datadirect-product-life-cycle/page/topics/
datadirect_life_cycle/datadirect-product-life-cycle.html.

The default version of the OpenSSL library has been upgraded to version 
3.0.9, which fixes the security vulnerabilities listed on the following 
page: https://www.openssl.org/news/vulnerabilities-3.0.html

This upgrade is available in build 08.02.0595 of the following OpenSSL 
library files: ivopenssl30.dll (32-bit) and ddopenssl30.dll (64-bit).

Notes:
* The driver supports the following OpenSSL 3.0 providers: Default and 
  FIPS.

* The FIPS provider is supported only on the following platforms: 
  Windows 64-bit, Linux 64-bit, and AIX 64-bit.

* The following connection options have been added to configure the 
  driver to use OpenSSL 3.0: Enable FIPS (EnableFIPS), OpenSSL Config File
  (OpenSSLConfigFile), and OpenSSL Provider Path (OpenSSLProviderPath).
  For more information on the new connection options and how to configure
  the driver to use OpenSSL 3.0, refer to the user's guide.
  
* When installing a new version of the product, the installer program will 
  automatically replace the OpenSSL 1.1.1 library files with the OpenSSL 3.0 
  library files in the install directory, which will impact all the DataDirect 
  ODBC drivers installed on a machine. Therefore:
  - If you are using multiple 8.0 drivers, upgrade all your drivers to the latest 
    version.
  - If you are using both 8.0 and 7.1 versions of the driver, copy the xxtls27.dll
    file to a different location before installing a new version of the 8.0 driver. 
    Copy it back to the install directory once the installation is complete.


End of Support for OpenSSL 1.1.1
--------------------------------
The product no longer includes version 1.1.1 of the OpenSSL library. 
The library will reach the end of its product life cycle in September 2023
and will not receive any security updates after that. Note that continuing 
to use the library after September 2023 can potentially expose you to 
security vulnerabilities.

Note: As a result of this change, when installing a new version of the product, 
the installer program will automatically remove version 1.1.1 of the library 
from the install directory, which will impact all the DataDirect ODBC drivers 
installed on a machine.


Installer Upgrade
-----------------
The installer program has been enhanced to use a more modern and
secure technology. As a result of this enhancement: 

* The default installation location has been changed to:

  - For the 32-bit driver on a 64-bit system:
    C:\Program Files (86)\Progress\DataDirect\ODBC

  - For all other installations:
    C:\Program Files\Progress\DataDirect\ODBC

* The new installer program does not support upgrading installations 
  made with earlier versions of the installer. You will need to 
  uninstall the existing installation and reinstall with the new 
  installer to resume upgrades in the same directory.

* The existing data sources cannot be used until they are 
  updated to point to the new installation location. To learn 
  how to update them, refer to the best practices documented 
  at https://community.progress.com/s/.

End of Support for OpenSSL 1.0.2
--------------------------------
The product no longer includes version 1.0.2 of the OpenSSL library. 
The library has reached the end of its product life cycle and is not 
receiving security updates anymore. Note that continuing to use the 
library could potentially expose you to security vulnerabilities.

Note: As a result of this change, when installing a new version of the 
driver, the installer program will automatically remove version 1.0.2 
of the library from the install directory.

Support for HTTP Mode
---------------------
The driver has been enhanced to support HTTP mode, which allows you to access
Apache Hive data stores using HTTP/HTTPS requests. HTTP mode can be configured
using the new Transport Mode and HTTP Path connection options.

Support for Cookie Based Authentication
---------------------------------------  
The driver has been enhanced to support session cookie based authentication 
for HTTP connections. Cookie based authentication can be configured using the 
new Enable Cookie Authentication and Cookie Name connection options. 

Documentation
-------------
Any product package made available after February 9, 2021 will not include the
HTML help system or user's guide PDF. The full documentation set, including
these items, is available from the Progress Information Hub:
https://docs.progress.com/category/datadirect-apache-spark-sql

While the product packages will not include these documentation items, the
installation Help directory will provide an HTML redirect for direct access
to the HTML help.

Note that all Progress DataDirect for ODBC documentation has been migrated to
the Progress Information Hub:
https://docs.progress.com/
 
Timestamp Logging in Packet Logs
--------------------------------
The drivers using base version B0649 and later have been enhanced to 
include timestamp in the internal packet logs by default. If you want to
disable the timestamp logging in packet logs, set PacketLoggingOptions=1.
The internal packet logging is not enabled by default. To enable it, 
set EnablePacketLogging=1.     
    
AllowedOpenSSLVersions
----------------------
Determines which version of the OpenSSL library file the driver uses for data
encryption when multiple versions are installed with the product. For example, 
when specifying a value of 1.1.1 (AllowedOpenSSLVersions=1.1.1), the driver 
uses the 1.1.1 version of the library stored in the \drivers subdirectory. Refer 
to the user's guide for more information.   

   
    Changes for 8.0.2 GA
 
No features introduced 


   Changes for 8.0.1 GA
  
New Data Type Support
---------------------
The driver has been enhanced to support the Decimal and Varchar data types.

Min Long Varchar Connection Option 
----------------------------------
The new Min Long Varchar Size connection option allows you to fetch
SQL_LONGVARCHAR columns whose size is smaller than the minimum
imposed by some third-party applications. 

Varchar Threshold Connection Option 
-----------------------------------
The new Varchar Threshold connection option allows you to fetch columns
that would otherwise exceed the upper limit of the SQL_VARCHAR type for some
third-party applications. 

New Default Value for the Array Size Connection Option 
------------------------------------------------------
The default value for the Array Size connection option has changed to 20000.
   
For more information about these features, refer to THE PROGRESS DATADIRECT FOR
ODBC FOR APACHE SPARK SQL DRIVER USER'S GUIDE AND REFERENCE.   

   
    Features for 8.0.0 GA  

The Progress DataDirect for ODBC for Apache Spark SQL Wire Protocol Driver
supports standard SQL query language for read-write access to Apache Spark SQL
data stores. By using DataDirect's Wire Protocol technology, the driver 
eliminates the need for client libraries, improving response time and 
throughput. 

Features:
    
* Supports Apache Spark SQL 

* Supports all ODBC Core and Level 1 functions. 

* Supports the core SQL-92 grammar.

* Supports the following data types:
  
  - Bigint           maps to SQL_BIGINT
  - Boolean          maps to SQL_BIT 
  - Date             maps to SQL_DATE 
  - Double           maps to SQL_DOUBLE
  - Float            maps to SQL_REAL 
  - Int              maps to SQL_INTEGER
  - Smallint         maps to SQL_SMALLINT
  - String           maps to SQL_WVARCHAR and SQL_WLONGVARCHAR
  - Timestamp        maps to SQL_TYPE_TIMESTAMP
  - Tinyint          maps to SQL_TINYINT 
  
* Supports advanced security features, including:  
  - Data encryption 
  - Kerberos authentication
    
  
    Driver WorkAround Options

Progress DataDirect has included non-standard connection options (workarounds)
for the driver that enable you to take full advantage of  packaged ODBC-enabled
applications requiring non-standard or extended behavior. Refer to the chapter
"WorkAround options" in THE PROGRESS DATADIRECT FOR ODBC DRIVERS REFERENCE for a
description of these options.


     Notes, Known Problems, and Restrictions 

Specifying values for the same connection option multiple times
--------------------------------------------------------------- 
The driver does not support specifying values for the same connection 
option multiple times in a connection string or DSN. If a value is 
specified using the same attribute multiple times or using both 
long and short attributes, the connection may fail or the driver may 
not behave as intended.

Disabling Diffie-Hellman Cipher Suites
--------------------------------------
If your database has not been fixed to address the Logjam vulnerability, you
can still use the most recent version of the OpenSSL Library by disabling the
Diffie-Hellman cipher suites. To disable the Diffie-Hellman cipher suites, 
specify the following value for the undocumented CipherList connection option:

CipherList=DEFAULT:-DH 

If you have already specified a value for CipherList, add the following to the 
existing value: 

:-DH 

The option-value pair for undocumented options can be specified in the 
odbc.ini, connection string, or the Extended Options field of the GUI. For 
details, refer to "Configuring and Connecting to Data Sources" in driver's 
User's Guide and Reference. 

Varchar Data Type 
-----------------
When returning result set metadata for Varchar columns, the Spark Thrift server
reports the column type as (12) STRING and the precision as 2147483647. This 
issue can cause the settings of the following connection options to produce 
unexpected results: Max String Size, Min Long Varchar Size, 
String Describe Type, and Varchar Threshold. For the latest information about
this issue, refer to the Apache JIRA SPARK-5918 issue Web page: 
https://issues.apache.org/jira/browse/SPARK-5918.        
     
Support for Multiple Simultaneous Connections 
---------------------------------------------
For Spark SQL versions 1.5 and earlier, the Spark SQL Thrift supports only a
single connection from a single application (client) per instance. Multiple 
connections can result in a number of unexpected behaviors, including
corrupting data or crashing the Thrift server. While Spark SQL 1.4 resolved 
some issues related to this limitation, all of the multi-connect issues are 
not expected to be fixed until Spark SQL 1.6 or later. Refer to
https://github.com/apache/spark/pull/8909 for more information.  
     
Rand() Function
---------------
For Spark SQL version 1.4, the rand() function is not supported. If the rand() 
function is used, the driver throws the following exception:
org.apache.spark.sql.AnalysisException: For input string: "TOK_TABLE_OR_COL";

Date/Time Hour() Function
-------------------------
For Spark SQL version 1.5, the Spark Thrift server returns (-17) for the hour()
function.

Installing and Removing Default Data Sources
--------------------------------------------
When you first install a driver, you are given the option to install a
default data source for that driver. We recommend that you select
this option. If you do not install the default data source at this
time, you will be unable to install a default data source for this
driver later. To install a default data source for a driver after
the initial installation, you must uninstall the driver and then
reinstall it.

SQLColAttribute(s)
------------------
The column attributes 1001 and 1002, which were assigned as DataDirect-specific
attributes, were inadvertently used as system attributes by the Microsoft 3.0 
ODBC implementation. Applications using those attributes must now use 1901 and
1902, respectively.

SQL_C_NUMERIC
-------------
Because of inconsistencies in the ODBC specification, users attempting
to use SQL_C_NUMERIC parameters must set the precision and scale values
of the corresponding structure and the descriptor fields in the
Application Parameter Descriptor.


     Documentation

PROGRESS DATADIRECT FOR ODBC FOR APACHE SPARK SQL WIRE PROTOCOL DRIVER
DOCUMENTATION SET
----------------------------------------------------------------------
The driver documentation set is available from the Progress Information Hub:

https://docs.progress.com/category/datadirect-apache-spark-sql

You can access the online help system directly via the HTML redirect in the
installation Help directory.


    Uninstalling the Driver 

You can uninstall the product or individual drivers through the Uninstall 
DataDirect for ODBC 8.0 option in the DataDirect program group.


    Installed Files the 32-bit Driver

This file list assumes a full installation of the driver and 
documentation.

The installer copies the following file to the Windows system 
directory:

ivtrc28.dll                       DataDirect trace library

The installer copies the following files and subdirectories to the 
product installation directory, by default:

For the 32-bit driver on 64-bit machines:

  C:\Program Files (86)\Progress\DataDirect\ODBC

For all other installations:

  C:\Program Files\Progress\DataDirect\ODBC


fixes.txt                         List of fixes since last release
license.txt                       Progress DataDirect license agreement
 
\drivers:
ivcurl28.dll                      Library used for HTTP connection
ivcurl28.pdb                      Debugging symbols for Curl library
ivicu.dll                         Unicode conversion tables
ivicu.pdb                         Debugging symbols for ICU library
ivspark28.dll                     DataDirect Driver for Apache Spark SQL
ivspark28.pdb                     Debugging symbols for DataDirect Driver 
                                  for Apache Spark SQL
ivspark28r.dll                    DataDirect Driver for Apache Spark SQL 
                                  resource file     
IVODBC.LIC                        DataDirect license file
ivopenssl30.dll                   TLS/SSL support file (OpenSSL library file, 
                                  version 3.0)
ivopenssl30.pdb                   Debugging symbols for OpenSSL 3.0 library
ivopenssl.dll                     TLS/SSL support file (OpenSSL library file, 
                                  version 3.5)
ivopenssl.pdb                     Debugging symbols for OpenSSL 3.5 library
ivtrc28.dll                       DataDirect trace library
ivtrc28.pdb                       Debugging symbols for DataDirect trace library
qesqlext.h                        Header file for DataDirect-specific ODBC 
                                  Definitions

\help:
*.html                            HTML redirects to online connector help
                                  systems and documentation resources


\NOTICES:
ODBC for Apache Spark SQL
8.0 NOTICES.TXT                   Third-party vendor license agreements

\READMES:
ODBC FOR Apache Spark SQL 
8.0 README.TXT                    This file

\samples:
\bulk\bulk.c                      Bulk example source
\bulk\bulk.exe                    Bulk application
\bulk\bulk.mak                    Bulk example make file
\bulk\bulk.sln                    Bulk example solution file
\bulk\bulk.vcproj                 Bulk example project file
\bulk\ddlogging.properties        Log configuration file for
                                  the Apache Spark SQL WP driver
                       
\bulkstrm\bulk.cpp                Bulk streaming example source
\bulkstrm\bulk.hpp                Bulk streaming example header
\bulkstrm\bulk.rc                 Bulk streaming example resource file
\bulkstrm\bulkstreaming.sln       Bulk streaming example solution file
\bulkstrm\bulkstreaming.vcproj    Bulk streaming example project file
\bulkstrm\bulkstrm.exe            Bulk streaming example application
\bulkstrm\bulkstrm.txt            Bulk streaming description
\bulkstrm\ddlogging.properties    Log configuration file for the 
                                  Apache Spark SQL WP driver
\bulkstrm\msgprintf.hpp           Bulk streaming example header file
\bulkstrm\ProgressDataDirect.bmp
\bulkstrm\ProgressDataDirect.ico
\bulkstrm\winmain.cpp             Bulk streaming example source file

\example\ddlogging.properties     Log configuration file for the 
                                  Apache Spark SQL WP driver
\example\example.c                Example source
\example\Example.exe              Example application
\example\example.h                Example header
\example\Example.mak              Example make file
\example\Example.sln              Example solution file
\example\Example.vcproj           Example project file

\TOOLS:
ddextwin.exe                      License Extender utility
ddprocinfo.exe                    Processor Information utility
DSNConverterSIL.exe               Data Source Converter utility
XMLP.exe                          A GUI demo tool that persists a result set to 
                                  an XML data file
                                
\UNINSTALL\*.*                    Files used to uninstall the product
    
    
    Installed Files for the 64-bit Driver

This file list assumes a full installation of all drivers and 
documentation. 

The installer copies the following file to the Windows system 
directory:

ddtrc28.dll                       DataDirect trace library

The installer copies the following files and subdirectories to the 
product installation directory, by default:

   C:\Program Files\Progress\DataDirect\ODBC:   
        
fixes.txt                         List of fixes since last release
license.txt                       Progress DataDirect license agreement
 
\drivers:
ddcurl28.dll                      Library used for HTTP connection
ddcurl28.pdb                      Debugging symbols for Curl library
ddicu.dll                         Unicode conversion tables
ddicu.pdb                         Debugging symbols for ICU library
ddspark28.dll                     DataDirect Driver for Apache Spark SQL
ddspark28.pdb                     Debugging symbols for DataDirect Driver 
                                  for Apache Spark SQL
ddspark28r.dll                    DataDirect Driver for Apache Spark SQL 
                                  resource file     
DDODBC.LIC                        DataDirect license file
ddopenssl30.dll                   TLS/SSL support file (OpenSSL library file,
                                  version 3.0)
ddopenssl30.pdb                   Debugging symbols for OpenSSL 3.0 library
ddopenssl.dll                     TLS/SSL support file (OpenSSL library file,
                                  version 3.5) 
ddopenssl.pdb                     Debugging symbols for OpenSSL 3.5 library
ddtrc28.dll                       DataDirect trace library
ddtrc28.pdb                       Debugging symbols for DataDirect trace library
fips.dll                          Support file for FIPS provider
fips.pdb                          Debugging symbols for FIPS provider
openssl.cnf                       Configuration file for FIPS provider
qesqlext.h                        Header file for DataDirect-specific ODBC 
                                  Definitions

\help:
*.html                            HTML redirects to online connector help
                                  systems and documentation resources   


\NOTICES:
ODBC for Apache Spark SQL
8.0 NOTICES.TXT                   Third-party vendor license agreements

\READMES:
ODBC for Apache Spark SQL 
8.0 README.TXT                    This file

\samples:
\bulk\bulk.c                      Bulk example source
\bulk\bulk.exe                    Bulk application
\bulk\bulk.mak                    Bulk example make file
\bulk\bulk.sln                    Bulk example solution file
\bulk\bulk.vcproj                 Bulk example project file
\bulk\ddlogging.properties        Log configuration file for
                                  the Apache Spark SQL WP driver
                       
\bulkstrm\bulk.cpp                Bulk streaming example source
\bulkstrm\bulk.hpp                Bulk streaming example header
\bulkstrm\bulk.rc                 Bulk streaming example resource file
\bulkstrm\bulkstreaming.sln       Bulk streaming example solution file
\bulkstrm\bulkstreaming.vcproj    Bulk streaming example project file
\bulkstrm\bulkstrm.exe            Bulk streaming example application
\bulkstrm\bulkstrm.txt            Bulk streaming description
\bulkstrm\ddlogging.properties    Log configuration file for the 
                                  Apache Spark SQL WP driver
\bulkstrm\msgprintf.hpp           Bulk streaming example header file
\bulkstrm\ProgressDataDirect.bmp
\bulkstrm\ProgressDataDirect.ico
\bulkstrm\winmain.cpp             Bulk streaming example source file

\example\ddlogging.properties     Log configuration file for the 
                                  Apache Spark SQL WP driver
\example\example.c                Example source
\example\Example.exe              Example application
\example\example.h                Example header
\example\Example.mak              Example make file
\example\Example.sln              Example solution file
\example\Example.vcproj           Example project file

\TOOLS:
ddextwin.exe                      License Extender utility
ddprocinfo.exe                    Processor Information utility
DSNConverterSIL.exe               Data Source Converter utility
XMLP.exe                          A GUI demo tool that persists a result set to 
                                  an XML data file
                                
\UNINSTALL\*.*                    Files used to uninstall the product       
        


~~~~~~~~~~~~~~~~
April 2026
End of README.TXT


TitleResults for “How to create a CRG?”Also Available inAlert