org.apache.spark.ml.stat

Class ANOVATest

Object

org.apache.spark.ml.stat.ANOVATest

public class ANOVATest
extends Object

ANOVA Test for continuous data.

See Wikipedia for more information on ANOVA test.

Constructor Summary

Constructors

Constructor and Description
ANOVATest()

Method Summary

Modifier and Type	Method and Description
static Dataset<Row>	test(Dataset<Row> dataset, String featuresCol, String labelCol)
static Dataset<Row>	test(Dataset<Row> dataset, String featuresCol, String labelCol, boolean flatten)

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ANOVATest

public ANOVATest()

Method Detail

test

public static Dataset<Row> test(Dataset<Row> dataset,
                                String featuresCol,
                                String labelCol)

Parameters:

dataset - DataFrame of categorical labels and continuous features.

featuresCol - Name of features column in dataset, of type Vector (VectorUDT)

labelCol - Name of label column in dataset, of any numerical type

Returns:

DataFrame containing the test result for every feature against the label. This DataFrame will contain a single Row with the following fields: - pValues: Vector - degreesOfFreedom: Array[Long] - fValues: Vector Each of these fields has one value per feature.

test

public static Dataset<Row> test(Dataset<Row> dataset,
                                String featuresCol,
                                String labelCol,
                                boolean flatten)

Parameters:

dataset - DataFrame of categorical labels and continuous features.

featuresCol - Name of features column in dataset, of type Vector (VectorUDT)

labelCol - Name of label column in dataset, of any numerical type

flatten - If false, the returned DataFrame contains only a single Row, otherwise, one row per feature.

Returns:

(undocumented)