Search *

setl-framework/setl 1.0.0-SNAPSHOT

A simple Spark-powered ETL framework that just works 🍺

Scala versions: 2.12 2.11

data-engineering etl-pipeline etl pipeline data-science spark scala machine-learning setl framework big-data modularization data-transformation dataset data-analysis

178 7
microsoft/mobius 2.0.200

C# and F# language binding and extensions to Apache Spark

Scala versions: 2.11

bigdata apache-spark streaming mapreduce dataframe eventhubs kafka-streaming rdd dstream spark-streaming near-real-time csharp mobius spark dataset fsharp

941 37
whylabs/whylogs-java 0.1.3

Profile and monitor your ML data pipeline end-to-end

Scala versions: 2.12

whylogs apache-spark calculate-statistics statistics approximate-statistics data-quality java dataset statistical-properties aiops mlops spark ai-pipelines

177 6
isarn/isarn-sketches-spark 0.6.0-sp3.2

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

Scala versions: 2.12

dataframes sketching-algorithm apache-spark aggregator data-sketches dataframe variable-importance datasets t-digest data-sketching spark scala spark-ml pyspark dataset udaf python feature-importance

29 2
whylabs/whylogs 0.7.0

An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈

Scala versions: 2.12

logging calculate-statistics approximate-statistics dataops data-quality ml-pipelines ai-pipelines data-pipeline constraints dataset python mlops model-performance data-science analytics statistical-properties machine-learning data-constraints

2656 23
cdapio/cdap 6.10.1

An open source framework for building data analytic applications.

Scala versions: 2.12

cdap integration mapreduce java-8 java unified spark dataset python middleware platform spark-streaming

761 224 178

Sorting

Filters

setl-framework/setl 1.0.0-SNAPSHOT

microsoft/mobius 2.0.200

whylabs/whylogs-java 0.1.3

isarn/isarn-sketches-spark 0.6.0-sp3.2

whylabs/whylogs 0.7.0

cdapio/cdap 6.10.1