org.apache.spark.scheduler.local

Class LocalBackend

Object

org.apache.spark.scheduler.local.LocalBackend

All Implemented Interfaces:

org.apache.spark.executor.ExecutorBackend, SchedulerBackend

public class LocalBackend
extends Object
implements SchedulerBackend, org.apache.spark.executor.ExecutorBackend

LocalBackend is used when running a local version of Spark where the executor, backend, and master all run in the same JVM. It sits behind a TaskSchedulerImpl and handles launching tasks on a single Executor (created by the LocalBackend) running locally.

Constructor Summary

Constructors

Constructor and Description
LocalBackend(TaskSchedulerImpl scheduler, int totalCores)

Method Summary

Methods

Modifier and Type	Method and Description
String	applicationId() Get an application ID associated with the job.
int	defaultParallelism()
void	killTask(long taskId, String executorId, boolean interruptThread)
akka.actor.ActorRef	localActor()
void	reviveOffers()
void	start()
void	statusUpdate(long taskId, scala.Enumeration.Value state, java.nio.ByteBuffer serializedData)
void	stop()
int	totalCores()

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.scheduler.SchedulerBackend

isReady

Constructor Detail

LocalBackend

public LocalBackend(TaskSchedulerImpl scheduler,
            int totalCores)

Method Detail

totalCores

public int totalCores()

localActor

public akka.actor.ActorRef localActor()

start

public void start()

Specified by:

start in interface SchedulerBackend

stop

public void stop()

Specified by:

stop in interface SchedulerBackend

reviveOffers

public void reviveOffers()

Specified by:

reviveOffers in interface SchedulerBackend

defaultParallelism

public int defaultParallelism()

Specified by:

defaultParallelism in interface SchedulerBackend

killTask

public void killTask(long taskId,
            String executorId,
            boolean interruptThread)

Specified by:

killTask in interface SchedulerBackend

statusUpdate

public void statusUpdate(long taskId,
                scala.Enumeration.Value state,
                java.nio.ByteBuffer serializedData)

Specified by:

statusUpdate in interface org.apache.spark.executor.ExecutorBackend

applicationId

public String applicationId()

Description copied from interface: SchedulerBackend

Get an application ID associated with the job.

Specified by:

applicationId in interface SchedulerBackend

Returns:

An application ID