Search *

10 results

azure/azure-event-hubs-spark 2.1.5

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Scala versions: 2.11

apache-spark streaming azure eventhubs kafka stream scala real-time microsoft spark-streaming bigdata continuous databricks structured-streaming spark apache ingestion connector event-hubs

235 37
qubole/kinesis-sql 1.2.0_spark-2.4

Kinesis Connector for Structured Streaming

Scala versions: 2.11

structured-streaming spark-structured-streaming real-time-processing spark kinesis spark-streaming

137 15
streamnative/pulsar-spark 2.4.5

Spark Connector to read and write with Pulsar

Scala versions: 2.11

structured-streaming apache-spark apache-pulsar flink data-science batch-processing stream-processing spark-sql spark data-processing

113 20
chermenin/spark-states 0.2

Custom state store providers for Apache Spark

Scala versions: 2.12 2.11

structured-streaming apache-spark state spark-structured-streaming stateful state-store spark-streaming spark apache

93 3
heartsavior/spark-sql-kafka-offset-committer 0.2.0

Kafka offset committer for structured streaming query

Scala versions: 2.12 2.11

kafka spark structured-streaming

37 3
heartsavior/spark-state-tools 0.4.0

Spark Structured Streaming State Tools

Scala versions: 2.12 2.11

apache-spark structured-streaming

34 2
qubole/streaminglens 0.5.3

Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines

Scala versions: 2.11

micro-batches structured-streaming streaming sparklens cluster-management spark streaming-pipeline scala spark-streaming sla

17 2
qubole/s3-sqs-connector 0.5.1

A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).

Scala versions: 2.11

streaming scala spark-streaming s3 structured-streaming spark sqs

17 2
qubole/spark-state-store 1.0.0

Rocksdb state storage implementation for Structured Streaming.

Scala versions: 2.11

structured-streaming streaming real-time-processing scalability spark state-management rocksdb performance qubole

16 3
bdoepf/spark-cassandra-sink 2.4.0

spark-cassandra-sink is a Spark Structured Streaming Sink for cassandra

Scala versions: 2.11

cassandra spark streaming structured-streaming

4 1