A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support.
Scala versions:
2.10
spark-validator 0.0.1
Group ID:
com.holdenkarau
Artifact ID:
spark-validator_2.10
Version:
0.0.1
Release Date:
Sept 28, 2015
Licenses:
Files:
Full Scala Version:
2.10.4
Developers:
libraryDependencies += "com.holdenkarau" %% "spark-validator" % "0.0.1"
ivy"com.holdenkarau::spark-validator:0.0.1"
//> using dep "com.holdenkarau::spark-validator:0.0.1"
import $ivy.`com.holdenkarau::spark-validator:0.0.1`
<dependency> <groupId>com.holdenkarau</groupId> <artifactId>spark-validator_2.10</artifactId> <version>0.0.1</version> </dependency>
compile group: 'com.holdenkarau', name: 'spark-validator_2.10', version: '0.0.1'