absaoss/spark-hats   0.3.0

Nested array transformation helper extensions for Apache Spark

joomcode/trace-analysis   0.1.1

Library for performance bottleneck detection and optimization efficiency prediction

agile-lab-dev/darwin   1.2.2

Avro Schema Evolution made easy

music-of-the-ainur/almaren-framework   0.9.11-3.4

The Almaren Framework provides a simplified consistent minimalistic layer over Apache Spark. While still allowing you to take advantage of native Apache Spark features. You can still combine it with standard Spark code.

sansa-stack/archived-sansa-query   0.7.1

SANSA Query Layer

intenthq/pucket   1.7.3

Bucketing and partitioning system for Parquet

indix/sparkplug   0.2.0

Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌

sansa-stack/archived-sansa-inference   0.7.1

A general Inference API based on two of the most popular Big Data processing engines: Apache Spark and Apache Flink

fsanaulla/chronicler-spark   0.6.0

InfluxDB connector to Apache Spark on top of Chronicler

fsanaulla/chronicler   0.7.2

Scala toolchain for InfluxDB

agile-lab-dev/wasp   2.35.0

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

sansa-stack/archived-sansa-owl   0.7.1

SANSA Stack OWL (Web Ontology Language) API

weaviate/spark-connector   1.3.3

Weaviate connector for Apache Spark

alonsodomin/sbt-spark   0.6.0

Simple SBT plugin to configure Spark applications

locationtech/rasterframes   0.11.1

Geospatial Raster support for Spark DataFrames

pierrenodet/spark-ensemble   0.9.1

Ensemble Learning for Apache Spark 🌲

timgent/data-flare   3.2.0_0.1.14

Data quality control tool built on spark and deequ

absaoss/pramen   1.10.1

Resilient data pipeline framework running on Apache Spark

whylabs/whylogs-java   0.1.3

Profile and monitor your ML data pipeline end-to-end