org.apache.spark.ml.classification

Class NaiveBayes

java.lang.Object

org.apache.spark.ml.PipelineStage

org.apache.spark.ml.Estimator<M>

org.apache.spark.ml.Predictor<FeaturesType,E,M>

org.apache.spark.ml.classification.Classifier<FeaturesType,E,M>

org.apache.spark.ml.classification.ProbabilisticClassifier<Vector,NaiveBayes,NaiveBayesModel>

org.apache.spark.ml.classification.NaiveBayes

All Implemented Interfaces:

java.io.Serializable, Logging, Params, Identifiable

public class NaiveBayes
extends ProbabilisticClassifier<Vector,NaiveBayes,NaiveBayesModel>

:: Experimental :: Naive Bayes Classifiers. It supports both Multinomial NB (http://nlp.stanford.edu/IR-book/html/htmledition/naive-bayes-text-classification-1.html) which can handle finitely supported discrete data. For example, by converting documents into TF-IDF vectors, it can be used for document classification. By making every vector a binary (0/1) data, it can also be used as Bernoulli NB (http://nlp.stanford.edu/IR-book/html/htmledition/the-bernoulli-model-1.html). The input feature values must be nonnegative.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
NaiveBayes()
NaiveBayes(java.lang.String uid)

Method Summary

Methods

Modifier and Type	Method and Description
NaiveBayes	copy(ParamMap extra) Creates a copy of this instance with the same UID and some extra params.
java.lang.String	getModelType()
double	getSmoothing()
Param<java.lang.String>	modelType() The model type which is a string (case-sensitive).
NaiveBayes	setModelType(java.lang.String value) Set the model type using a string (case-sensitive).
NaiveBayes	setSmoothing(double value) Set the smoothing parameter.
DoubleParam	smoothing() The smoothing parameter.
protected NaiveBayesModel	train(DataFrame dataset) Train a model using the given dataset and parameters.
java.lang.String	uid() An immutable unique ID for the object and its derivatives.
StructType	validateAndTransformSchema(StructType schema, boolean fitting, DataType featuresDataType)
StructType	validateAndTransformSchema(StructType schema, boolean fitting, DataType featuresDataType) Validates and transforms the input schema with the provided param map.

Methods inherited from class org.apache.spark.ml.classification.ProbabilisticClassifier

setProbabilityCol, setThresholds

Methods inherited from class org.apache.spark.ml.classification.Classifier

setRawPredictionCol

Methods inherited from class org.apache.spark.ml.Predictor

extractLabeledPoints, fit, setFeaturesCol, setLabelCol, setPredictionCol, transformSchema

Methods inherited from class org.apache.spark.ml.Estimator

fit, fit, fit, fit

Methods inherited from class org.apache.spark.ml.PipelineStage

transformSchema

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.ml.param.Params

clear, copyValues, defaultCopy, defaultParamMap, explainParam, explainParams, extractParamMap, extractParamMap, get, getDefault, getOrDefault, getParam, hasDefault, hasParam, isDefined, isSet, paramMap, params, set, set, set, setDefault, setDefault, shouldOwn, validateParams

Methods inherited from interface org.apache.spark.ml.util.Identifiable

toString

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

NaiveBayes

public NaiveBayes(java.lang.String uid)

NaiveBayes

public NaiveBayes()

Method Detail

uid

public java.lang.String uid()

Description copied from interface: Identifiable

An immutable unique ID for the object and its derivatives.

Specified by:

uid in interface Identifiable

Returns:

(undocumented)

setSmoothing

public NaiveBayes setSmoothing(double value)

Set the smoothing parameter. Default is 1.0.

Parameters:

value - (undocumented)

Returns:

(undocumented)

setModelType

public NaiveBayes setModelType(java.lang.String value)

Set the model type using a string (case-sensitive). Supported options: "multinomial" and "bernoulli". Default is "multinomial"

Parameters:

value - (undocumented)

Returns:

(undocumented)

train

protected NaiveBayesModel train(DataFrame dataset)

Description copied from class: Predictor

Train a model using the given dataset and parameters. Developers can implement this instead of fit() to avoid dealing with schema validation and copying parameters into the model.

Specified by:

train in class Predictor<Vector,NaiveBayes,NaiveBayesModel>

Parameters:

dataset - Training dataset

Returns:

Fitted model

copy

public NaiveBayes copy(ParamMap extra)

Description copied from interface: Params

Creates a copy of this instance with the same UID and some extra params. Subclasses should implement this method and set the return type properly.

Specified by:

copy in interface Params

Specified by:

copy in class Predictor<Vector,NaiveBayes,NaiveBayesModel>

Parameters:

extra - (undocumented)

Returns:

(undocumented)

See Also:

defaultCopy()

smoothing

public DoubleParam smoothing()

The smoothing parameter. (default = 1.0).

Returns:

(undocumented)

getSmoothing

public double getSmoothing()

modelType

public Param<java.lang.String> modelType()

The model type which is a string (case-sensitive). Supported options: "multinomial" and "bernoulli". (default = multinomial)

Returns:

(undocumented)

getModelType

public java.lang.String getModelType()

validateAndTransformSchema

public StructType validateAndTransformSchema(StructType schema,
                                    boolean fitting,
                                    DataType featuresDataType)

validateAndTransformSchema

public StructType validateAndTransformSchema(StructType schema,
                                    boolean fitting,
                                    DataType featuresDataType)

Validates and transforms the input schema with the provided param map.

Parameters:

schema - input schema

fitting - whether this is in fitting

featuresDataType - SQL DataType for FeaturesType. E.g., VectorUDT for vector features.

Returns:

output schema