Search *

35 results

apache/spark 3.5.3

Apache Spark - A unified analytics engine for large-scale data processing

Scala versions: 2.13 2.12

sql jdbc big-data java spark scala python r

40056 3978 340
apache/predictionio 0.9.6

PredictionIO, a machine learning server for developers and ML engineers.

Scala versions: 2.10

big-data predictionio scala

12543 130
microsoft/synapseml 1.0.8

Simple and Distributed Machine Learning

Scala versions: 2.12

deep-learning databricks apache-spark onnx lightgbm azure cognitive-services opencv big-data data-science spark ai microsoft machine-learning ml pyspark synapse scala http model-deployment

5069 103
delta-io/delta 3.2.1

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

Scala versions: 2.13 2.12

big-data delta-lake spark acid analytics

7641 332
apache/flink 1.20.0

Apache Flink

Scala versions: 2.12

sql big-data java flink scala python

24169 1618 276
bigdatagenomics/adam 0.23.0

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

Scala versions: 2.11 2.10

parquet genomics big-data java avro spark scala python r bioinformatics

1003 66
nvidia/spark-rapids 24.10.1

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

Scala versions: 2.13 2.12

big-data gpu rapids spark

824 73
h2oai/sparkling-water 2.4.13

Sparkling Water provides H2O functionality inside Spark cluster

Scala versions: 2.11

rsparkling integration big-data pysparkling pyspark spark scala h2o machine-learning

967 49
delta-io/delta-sharing 1.2.2

An open protocol for secure data sharing

Scala versions: 2.13 2.12

data-sharing big-data delta-lake spark pandas

774 37
touk/nussknacker 1.18.0

Low-code tool for automating actions on real time data | Stream processing for the users.

Scala versions: 2.13 2.12

decisioning streaming decision-making low-code big-data automation flink kafka stream-processing scala real-time data-streaming gui decision-engine apache-flink flink-kafka rules-engine lowcode touk

664 65
yotpoltd/metorikku 0.0.156

A simplified, lightweight ETL Framework based on Apache Spark

Scala versions: 2.12 2.11

sql etl big-data spark scala distributed-computing etl-framework etl-pipeline

585 27
microsoft/hyperspace 0.4.0

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

Scala versions: 2.12 2.11

acceleration spark databases analytics indexing big-data

424 17
hydrospheredata/mist 0.6.4

Serverless proxy for Spark cluster

Scala versions: 2.11 2.10

apache-spark api big-data serverless

326 23
qbeast-io/qbeast-spark 0.7.0

Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!

Scala versions: 2.12

big-data spark-sql spark scala sampling datasource data-lakehouse

215 13
setl-framework/setl 1.0.0-SNAPSHOT

A simple Spark-powered ETL framework that just works 🍺

Scala versions: 2.12 2.11

data-engineering etl-pipeline etl pipeline data-science spark scala machine-learning setl framework big-data modularization data-transformation dataset data-analysis

178 7
sparkling-graph/sparkling-graph 0.0.7

SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.

Scala versions: 2.11 2.10

measure graph-algorithms vertex coarsing big-data link-predication comunity-detection-methods spark heuristics graph approximation network-analysis machine-learning dsl

152 5
51zero/eel-sdk 1.2.4

Big Data Toolkit for the JVM

Scala versions: 2.12 2.11

etl big-data kafka hadoop hive scala kudu orc parquet

145 9
clustering4ever/clustering4ever 0.11.0

C4E, a JVM friendly library written in Scala for both local and distributed (Spark) Clustering.

Scala versions: 2.11

big-data scalability spark artificial-intelligence scala ai clustering-evaluation clustering bigdata clustering-algorithm

130 5
apache/samza 1.2.0

Mirror of Apache Samza

Scala versions: 2.12

big-data samza scala

819 132
hablapps/doric 0.0.8

Type safety for spark columns

Scala versions: 2.13 2.12

big dataframe spark-columns big-data spark typesafe scala

77 9