byzer-org/byzer-lang   2.1.0

Byzer (former MLSQL): A low-code open-source programming language for data pipeline, analytics and AI.

apache/hudi   0.15.0

Upserts, Deletes And Incremental Processing on Big Data.

gearpump/gearpump   0.9.0

Lightweight real-time big data streaming engine over Akka

apache/incubator-livy   0.8.0-incubating

Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.

pingcap/tispark   3.2.3

TiSpark is built for running Apache Spark on top of TiDB/TiKV

apache/celeborn   0.5.2

Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.

mjakubowski84/parquet4s   2.20.0

Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.

azure/azure-event-hubs-spark   2.1.5

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

clustering4ever/clustering4ever   0.11.0

C4E, a JVM friendly library written in Scala for both local and distributed (Spark) Clustering.

minio/spark-select   2.1

A library for Spark DataFrame using MinIO Select API

microsoft/mobius   2.0.200

C# and F# language binding and extensions to Apache Spark

gigahexhq/jetprobe   0.1.0

🚀 Validation DSL for data pipelines

grouzen/zio-apache-parquet   0.1.5

Scala ZIO-powered Apache Parquet library

kotlin/kotlin-spark-api   1.2.4

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

grouzen/zio-apache-arrow   0.1.2

Scala ZIO-powered Apache Arrow library

anicolaspp/jmcli   1.0.1

A remote CLI interface for MapR

zuinnote/hadoopoffice

HadoopOffice - Analyze Office documents using the Hadoop ecosystem (Spark/Flink/Hive)

mvillafuertem/mapflablup   0.1

Mapflablup is a library to flat ➖ and blowup 🎈 Map Collection

sksamuel/kotlin-big-data

Kotlin Bigdata Toolkit

zuinnote/hadoopcryptoledger

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive