qubole/spark-state-store   1.0.0

Rocksdb state storage implementation for Structured Streaming.

derrickburns/generalized-kmeans-clustering   1.2.2

Spark library for generalized K-Means clustering. Supports general Bregman divergences. Suitable for clustering probabilistic data, time series data, high dimensional data, and very large data.

data-tools/big-data-types   1.3.4

A library to transform Scala product types and Schemes from different systems into other Schemes. Any implemented type automatically gets methods to convert it into the rest of the types and vice versa. E.g: a Spark Schema can be transformed into a BigQuery table.

phymbert/spark-search   0.2.0

Spark Search - high performance advanced search features based on Apache Lucene

tupol/spark-tools   0.4.1

Executable Apache Spark Tools: Format Converter & SQL Processor

datumo/dataset-logger   0.1.0

Apache Spark Scala utility to track data records during application execution

anskarl/parsimonious   0.5.1

Parsimonious is a helper library for encoding/decoding Apache Thrift and Twitter Scrooge classes to Spark Dataframes and Jackson JSON.

housepower/clickhouse-native-jdbc   2.7.1

ClickHouse Native Protocol JDBC implementation

projectnessie/nessie   0.100.2

Nessie: Transactional Catalog for Data Lakes with Git-like semantics

brayanjuls/diane   0.0.4

Hive helper functions for apache spark users

databeans/lighthouse   0.1.0

Shed light on your data layout in order to monitor the health of your Lakehouse tables and identify when data maintenance operations should be performed.

absaoss/hermes   0.3.3

A E2E test tool for Enceladus. Also general dataframe comparison tool

coxautomotivedatasolutions/vegalite4s   0.4

Vega-Lite4s is a small library over the comprehensive Vega-Lite Javascript visualisation library, allowing you to create beautiful Vega-Lite visualisations in Scala

lewuathe/dllib   0.0.11

dllib is a distributed deep learning library running on Apache Spark

pierrenodet/aruku   0.1.0

A Random Walk Engine for Apache Spark

sadikovi/spark-netflow   2.1.0

NetFlow data source for Spark SQL and DataFrames

dtim-upc/nextiajd   1.0

NextiaJD is a library that supports data discovery based on data profiles and machine learning algorithms to find joinable attributes in heterogeneous datasets

izhangzhihao/sbt-spark-submit   0.0.5

sbt plugin for spark-submit

keks51/spark_plan_as_uml   1.0.0

visualizing spark plan as UML diagram