Spark Exasol Connector (SEC) supports an integration between Exasol and Apache Spark. It allows creating Spark DataFrame from Exasol queries and saving Spark DataFrame as an Exasol table.
- Creates Spark DataFrame from Exasol query results
- Saves Spark DataFrame to an Exasol table
- Allows configuring the Spark tasks for parallel connection
- Supports Spark DataFrame column pruning and filter push down
At the moment, Spark Exasol Connector does not support integration with Spark Streaming. Please check out the Spark regular JDBC integration.