| Interface | Description |
|---|---|
| Encoder<T> |
:: Experimental ::
Used to convert a JVM object of type
T to and from the internal Spark SQL representation. |
| Row |
Represents one row of output from a relational operator.
|
| Class | Description |
|---|---|
| Column |
:: Experimental ::
A column that will be computed based on the data in a
DataFrame. |
| ColumnName |
:: Experimental ::
A convenient class used for constructing schema.
|
| DataFrame |
:: Experimental ::
A distributed collection of data organized into named columns.
|
| DataFrameHolder |
A container for a
DataFrame, used for implicit conversions. |
| DataFrameNaFunctions |
:: Experimental ::
Functionality for working with missing data in
DataFrames. |
| DataFrameReader |
:: Experimental ::
Interface used to load a
DataFrame from external storage systems (e.g. |
| DataFrameStatFunctions |
:: Experimental ::
Statistic functions for
DataFrames. |
| DataFrameWriter |
:: Experimental ::
Interface used to write a
DataFrame to external storage systems (e.g. |
| Dataset<T> |
:: Experimental ::
A
Dataset is a strongly typed collection of objects that can be transformed in parallel
using functional or relational operations. |
| DatasetHolder<T> |
A container for a
Dataset, used for implicit conversions. |
| Encoders |
:: Experimental ::
Methods for creating an
Encoder. |
| ExperimentalMethods |
:: Experimental ::
Holder for experimental methods for the bravest.
|
| functions | |
| GroupedData |
:: Experimental ::
A set of methods for aggregations on a
DataFrame, created by DataFrame.groupBy. |
| GroupedDataset<K,V> |
:: Experimental ::
A
Dataset has been logically grouped by a user specified grouping key. |
| RowFactory |
A factory class used to construct
Row objects. |
| SQLContext |
The entry point for working with structured data (rows and columns) in Spark.
|
| SQLImplicits |
A collection of implicit methods for converting common Scala objects into
DataFrames. |
| TypedColumn<T,U> | |
| UDFRegistration |
Functions for registering user-defined functions.
|
| UserDefinedFunction |
A user-defined function.
|
| Enum | Description |
|---|---|
| SaveMode |
SaveMode is used to specify the expected behavior of saving a DataFrame to a data source.
|
| Exception | Description |
|---|---|
| AnalysisException |
:: DeveloperApi ::
Thrown when a query fails to analyze, usually because the query itself is invalid.
|