Lineage Checkpoint Approach for Long-lineage Problem in Apache Spark.

Minhyeok Kweun Woo-Yeon Lee Goeun Kim Jisoo Hwang Yoonkyong Lee

Published in: IEEE BigData (2020)

Keyphrases

data lineage
open source
metadata
data quality
scientific data
open source software
digital libraries
fine grained
real time
data sets
machine learning
case study
image sequences
fault tolerance