org.apache.spark.streaming

Class CheckpointReader

Object

org.apache.spark.streaming.CheckpointReader

public class CheckpointReader
extends Object

Constructor Summary

Constructors

Constructor and Description
CheckpointReader()

Method Summary

Modifier and Type	Method and Description
static scala.Option<org.apache.spark.streaming.Checkpoint>	read(String checkpointDir) Read checkpoint files present in the given checkpoint directory.
static scala.Option<org.apache.spark.streaming.Checkpoint>	read(String checkpointDir, SparkConf conf, org.apache.hadoop.conf.Configuration hadoopConf, boolean ignoreReadError) Read checkpoint files present in the given checkpoint directory.

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CheckpointReader

public CheckpointReader()

Method Detail

read

public static scala.Option<org.apache.spark.streaming.Checkpoint> read(String checkpointDir)

Read checkpoint files present in the given checkpoint directory. If there are no checkpoint files, then return None, else try to return the latest valid checkpoint object. If no checkpoint files could be read correctly, then return None.

Parameters:

checkpointDir - (undocumented)

Returns:

(undocumented)

read

public static scala.Option<org.apache.spark.streaming.Checkpoint> read(String checkpointDir,
                                                                       SparkConf conf,
                                                                       org.apache.hadoop.conf.Configuration hadoopConf,
                                                                       boolean ignoreReadError)

Read checkpoint files present in the given checkpoint directory. If there are no checkpoint files, then return None, else try to return the latest valid checkpoint object. If no checkpoint files could be read correctly, then return None (if ignoreReadError = true), or throw exception (if ignoreReadError = false).

Parameters:

checkpointDir - (undocumented)

conf - (undocumented)

hadoopConf - (undocumented)

ignoreReadError - (undocumented)

Returns:

(undocumented)