SERDE
HiveOptions
SHORT
Encoders
SHUFFLE
BlockId
SHUFFLE_DATA
BlockId
SHUFFLE_INDEX
BlockId
SPARK_BRANCH
spark
SPARK_BUILD_DATE
spark
SPARK_BUILD_USER
spark
SPARK_REPO_URL
spark
SPARK_REVISION
spark
SPARK_SQL_PREFIX
HiveExternalCatalog
SPARK_VERSION
spark
SPMap
ShortestPaths
SQLContext
sql
SQLDataTypes
linalg
SQLImplicits
sql
SQLTransformer
feature
SQLUserDefinedType
types
STATISTICS_COL_STATS_PREFIX
HiveExternalCatalog
STATISTICS_NUM_ROWS
HiveExternalCatalog
STATISTICS_PREFIX
HiveExternalCatalog
STATISTICS_TOTAL_SIZE
HiveExternalCatalog
STREAM
BlockId
STRING
Encoders
SVDPlusPlus
lib
SVMDataGenerator
util
SVMModel
classification
SVMWithSGD
classification
SYSTEM_DEFAULT
DecimalType
SaveMode
sql
Saveable
util
SchedulingMode
scheduler SchedulingMode
SchemaRelationProvider
sources
ScriptTransformationExec
execution
Seconds
streaming
SequenceFileRDDFunctions
rdd
SerializableWritable
spark
SerializationStream
serializer
Serializer
serializer
SerializerInstance
serializer
ShortType
types
ShortestPaths
lib
ShuffleBlockId
storage
ShuffleDataBlockId
storage
ShuffleDependency
spark
ShuffleIndexBlockId
storage
ShuffleReadMetricDistributions
v1
ShuffleReadMetrics
v1
ShuffleWriteMetricDistributions
v1
ShuffleWriteMetrics
v1
ShuffledRDD
rdd
SimpleConsumerConfig
KafkaCluster
SimpleFutureAction
spark
SimpleUpdater
optimization
SingularValueDecomposition
linalg
SinkProgress
streaming
SizeEstimator
util
SnappyCompressionCodec
io
Sort
QuantileStrategy
SourceProgress
streaming
SparkAWSCredentials
kinesis
SparkAppHandle
launcher
SparkConf
spark
SparkContext
spark
SparkEnv
spark
SparkException
spark
SparkExecutorInfo
spark
SparkFiles
spark
SparkFirehoseListener
spark
SparkFlumeEvent
flume
SparkHadoopMapRedUtil
mapred
SparkJobInfo
spark
SparkLauncher
launcher
SparkListener
scheduler
SparkListenerApplicationEnd
scheduler
SparkListenerApplicationStart
scheduler
SparkListenerBlockManagerAdded
scheduler
SparkListenerBlockManagerRemoved
scheduler
SparkListenerBlockUpdated
scheduler
SparkListenerEnvironmentUpdate
scheduler
SparkListenerEvent
scheduler
SparkListenerExecutorAdded
scheduler
SparkListenerExecutorBlacklisted
scheduler
SparkListenerExecutorMetricsUpdate
scheduler
SparkListenerExecutorRemoved
scheduler
SparkListenerExecutorUnblacklisted
scheduler
SparkListenerJobEnd
scheduler
SparkListenerJobStart
scheduler
SparkListenerNodeBlacklisted
scheduler
SparkListenerNodeUnblacklisted
scheduler
SparkListenerStageCompleted
scheduler
SparkListenerStageSubmitted
scheduler
SparkListenerTaskEnd
scheduler
SparkListenerTaskGettingResult
scheduler
SparkListenerTaskStart
scheduler
SparkListenerUnpersistRDD
scheduler
SparkSession
sql
SparkSessionExtensions
sql
SparkStageInfo
spark
SparkStatusTracker
spark
SparseMatrix
linalg linalg
SparseVector
linalg linalg
Split
tree model
SplitInfo
scheduler
SquaredError
loss
SquaredL2Updater
optimization
StageAttemptId
JobProgressListener
StageData
v1
StageId
JobProgressListener
StageInfo
scheduler
StageStatus
v1
StandardNormalGenerator
random
StandardScaler
feature feature
StandardScalerModel
feature feature
StatCounter
util
State
SparkAppHandle streaming
StateOperatorProgress
streaming
StateSpec
streaming
Statistics
stat
StatsReportListener
scheduler scheduler
StopWordsRemover
feature
StorageLevel
storage
StorageLevels
java
StorageListener
storage
StorageStatus
storage
StorageStatusListener
storage
Strategy
configuration sql
StrategyBuilder
SparkSessionExtensions
StreamBlockId
storage
StreamInputInfo
scheduler
StreamSinkProvider
sources
StreamSourceProvider
sources
StreamingContext
streaming
StreamingContextState
streaming
StreamingKMeans
clustering
StreamingKMeansModel
clustering
StreamingLinearAlgorithm
regression
StreamingLinearRegressionWithSGD
regression
StreamingListener
scheduler
StreamingListenerBatchCompleted
scheduler
StreamingListenerBatchStarted
scheduler
StreamingListenerBatchSubmitted
scheduler
StreamingListenerEvent
scheduler
StreamingListenerOutputOperationCompleted
scheduler
StreamingListenerOutputOperationStarted
scheduler
StreamingListenerReceiverError
scheduler
StreamingListenerReceiverStarted
scheduler
StreamingListenerReceiverStopped
scheduler
StreamingListenerStreamingStarted
scheduler
StreamingLogisticRegressionWithSGD
classification
StreamingQuery
streaming
StreamingQueryException
streaming
StreamingQueryListener
streaming
StreamingQueryManager
streaming
StreamingQueryProgress
streaming
StreamingQueryStatus
streaming
StreamingStatistics
streaming
StreamingTest
test
StringArrayParam
param
StringContains
sources
StringEndsWith
sources
StringIndexer
feature
StringIndexerModel
feature
StringStartsWith
sources
StringToColumn
SQLImplicits
StringType
types
StronglyConnectedComponents
lib
StructField
types
StructType
types
Success
spark
s
SingularValueDecomposition
sample
JavaDoubleRDD JavaPairRDD JavaRDD RDD Dataset BernoulliCellSampler BernoulliSampler PoissonSampler RandomSampler
sampleBy
DataFrameStatFunctions
sampleByKey
JavaPairRDD PairRDDFunctions
sampleByKeyExact
JavaPairRDD PairRDDFunctions
sampleStdev
JavaDoubleRDD DoubleRDDFunctions StatCounter
sampleVariance
JavaDoubleRDD DoubleRDDFunctions StatCounter
save
MLWritable MLWriter LogisticRegressionModel NaiveBayesModel SVMModel BisectingKMeansModel DistributedLDAModel GaussianMixtureModel KMeansModel LocalLDAModel PowerIterationClusteringModel ChiSqSelectorModel Word2VecModel FPGrowthModel PrefixSpanModel MatrixFactorizationModel IsotonicRegressionModel LassoModel LinearRegressionModel RidgeRegressionModel DecisionTreeModel GradientBoostedTreesModel RandomForestModel Saveable DataFrameWriter
saveAsHadoopDataset
JavaPairRDD PairRDDFunctions
saveAsHadoopFile
JavaPairRDD PairRDDFunctions
saveAsHadoopFiles
JavaPairDStream PairDStreamFunctions
saveAsLibSVMFile
MLUtils
saveAsNewAPIHadoopDataset
JavaPairRDD PairRDDFunctions
saveAsNewAPIHadoopFile
JavaPairRDD PairRDDFunctions
saveAsNewAPIHadoopFiles
JavaPairDStream PairDStreamFunctions
saveAsObjectFile
JavaRDDLike RDD
saveAsObjectFiles
DStream
saveAsSequenceFile
SequenceFileRDDFunctions
saveAsTable
DataFrameWriter
saveAsTextFile
JavaRDDLike RDD
saveAsTextFiles
DStream
saveImpl
MLWriter
sc
JavaSparkContext StringToColumn
scalaBoolean
Encoders
scalaByte
Encoders
scalaDouble
Encoders
scalaFloat
Encoders
scalaInt
Encoders
scalaIntToJavaLong
JavaDStreamLike
scalaLong
Encoders
scalaShort
Encoders
scalaToJavaLong
JavaPairDStream
scalaVersion
RuntimeInfo
scalalang
expressions
scale
AFTSurvivalRegressionModel GammaGenerator Decimal DecimalType
scalingVec
ElementwiseProduct ElementwiseProduct
scheduler
spark streaming
schedulingDelay
BatchInfo BatchInfo
schedulingMode
JobProgressListener
schedulingPool
StageData
schema
DataFrameReader Dataset Encoder Row BaseRelation DataStreamReader
schemaLess
HiveScriptIOSchema
scope
RDDInfo
scoreAndLabels
BinaryClassificationMetrics
script
ScriptTransformationExec
second
functions
seconds
Durations
security
spark
securityManager
SparkEnv
seedBrokers
SimpleConsumerConfig
select
Dataset
selectExpr
Dataset
selectUntyped
Dataset
selectedFeatures
ChiSqSelectorModel ChiSqSelectorModel
selectorType
ChiSqSelector
sendToDst
EdgeContext
sendToSrc
EdgeContext
sequence
FreqSequence
sequenceFile
SparkContext JavaSparkContext
serde
HiveOptions
serdeProperties
HiveOptions
serialize
VectorUDT DummySerializerInstance SerializerInstance
serializeStream
DummySerializerInstance SerializerInstance
serializer
ShuffleDependency SparkEnv spark
serializerManager
SparkEnv
session
MLReader MLWriter
sessionCatalog
RelationConversions
sessionState
SparkSession
set
SparkConf SparkEnv EdgeTriplet Params RuntimeConfig Decimal
setActive
SQLContext
setActiveSession
SparkSession
setAggregationDepth
LinearSVC LogisticRegression AFTSurvivalRegression LinearRegression
setAggregator
ShuffledRDD
setAlgo
Strategy
setAll
SparkConf
setAlpha
ALS LDA ALS
setAppName
SparkConf SparkLauncher
setAppResource
SparkLauncher
setBandwidth
KernelDensity
setBeta
LDA
setBinary
CountVectorizer CountVectorizerModel HashingTF HashingTF
setBlockSize
MultilayerPerceptronClassifier
setBlocks
ALS
setBucketLength
BucketedRandomProjectionLSH
setCacheNodeIds
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor
setCallSite
SparkContext JavaSparkContext
setCaseSensitive
StopWordsRemover
setCategoricalFeaturesInfo
Strategy
setCensorCol
AFTSurvivalRegression
setCheckpointDir
SparkContext JavaSparkContext
setCheckpointInterval
DecisionTreeClassifier GBTClassifier RandomForestClassifier LDA ALS DecisionTreeRegressor GBTRegressor RandomForestRegressor LDA ALS Strategy
setClassifier
OneVsRest
setColdStartStrategy
ALS ALSModel
setConf
SparkLauncher SQLContext
setConsumerOffsetMetadata
KafkaCluster
setConsumerOffsets
KafkaCluster
setConvergenceTol
GaussianMixture GradientDescent LBFGS StreamingLinearRegressionWithSGD
setCurrentDatabase
Catalog
setDecayFactor
StreamingKMeans
setDefault
Params
setDefaultClassLoader
Serializer
setDefaultSession
SparkSession
setDegree
PolynomialExpansion
setDeployMode
SparkLauncher
setDocConcentration
LDA LDA
setDropLast
OneHotEncoder
setElasticNetParam
LogisticRegression LinearRegression
setEpsilon
KMeans
setEstimator
CrossValidator TrainValidationSplit
setEstimatorParamMaps
CrossValidator TrainValidationSplit
setEvaluator
CrossValidator TrainValidationSplit
setExecutorEnv
SparkConf
setFamily
LogisticRegression GeneralizedLinearRegression
setFdr
ChiSqSelector ChiSqSelector
setFeatureIndex
IsotonicRegression IsotonicRegressionModel
setFeatureSubsetStrategy
RandomForestClassifier RandomForestRegressor
setFeaturesCol
PredictionModel Predictor OneVsRest OneVsRestModel BisectingKMeans BisectingKMeansModel GaussianMixture GaussianMixtureModel KMeans KMeansModel LDA LDAModel ChiSqSelector ChiSqSelectorModel RFormula AFTSurvivalRegression AFTSurvivalRegressionModel IsotonicRegression IsotonicRegressionModel
setFinalRDDStorageLevel
ALS
setFinalStorageLevel
ALS
setFitIntercept
LinearSVC LogisticRegression AFTSurvivalRegression GeneralizedLinearRegression LinearRegression
setForceIndexLabel
RFormula
setFormula
RFormula
setFpr
ChiSqSelector ChiSqSelector
setFwe
ChiSqSelector ChiSqSelector
setGaps
RegexTokenizer
setGradient
GradientDescent LBFGS
setHalfLife
StreamingKMeans
setHandleInvalid
Bucketizer QuantileDiscretizer StringIndexer StringIndexerModel
setHashAlgorithm
HashingTF
setIfMissing
SparkConf
setImplicitPrefs
ALS ALS
setImpurity
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setIndices
VectorSlicer
setInitMode
KMeans
setInitSteps
KMeans
setInitialCenters
StreamingKMeans
setInitialModel
GaussianMixture KMeans
setInitialWeights
MultilayerPerceptronClassifier StreamingLogisticRegressionWithSGD StreamingLinearRegressionWithSGD
setInitializationMode
KMeans PowerIterationClustering
setInitializationSteps
KMeans
setInputCol
UnaryTransformer Binarizer BucketedRandomProjectionLSH Bucketizer CountVectorizer CountVectorizerModel HashingTF IDF IDFModel IndexToString MaxAbsScaler MaxAbsScalerModel MinHashLSH MinMaxScaler MinMaxScalerModel OneHotEncoder PCA PCAModel QuantileDiscretizer StandardScaler StandardScalerModel StopWordsRemover StringIndexer StringIndexerModel VectorIndexer VectorIndexerModel VectorSlicer Word2Vec Word2VecModel
setInputCols
Imputer ImputerModel Interaction VectorAssembler
setIntercept
GeneralizedLinearAlgorithm
setIntermediateRDDStorageLevel
ALS
setIntermediateStorageLevel
ALS
setInverse
DCT
setIsotonic
IsotonicRegression IsotonicRegression
setItemCol
ALS ALSModel
setItemsCol
FPGrowth FPGrowthModel
setIterations
ALS
setJars
SparkConf
setJavaHome
SparkLauncher
setJobDescription
SparkContext
setJobGroup
SparkContext JavaSparkContext
setK
BisectingKMeans GaussianMixture KMeans LDA PCA BisectingKMeans GaussianMixture KMeans LDA PowerIterationClustering StreamingKMeans
setKappa
OnlineLDAOptimizer
setKeepLastCheckpoint
LDA EMLDAOptimizer
setKeyOrdering
ShuffledRDD
setLabelCol
Predictor OneVsRest BinaryClassificationEvaluator MulticlassClassificationEvaluator RegressionEvaluator ChiSqSelector RFormula AFTSurvivalRegression IsotonicRegression
setLabels
IndexToString
setLambda
NaiveBayes ALS
setLayers
MultilayerPerceptronClassifier
setLearningDecay
LDA
setLearningOffset
LDA
setLearningRate
Word2Vec BoostingStrategy
setLink
GeneralizedLinearRegression
setLinkPower
GeneralizedLinearRegression
setLinkPredictionCol
GeneralizedLinearRegression GeneralizedLinearRegressionModel
setLocalProperty
SparkContext JavaSparkContext
setLogLevel
SparkContext JavaSparkContext
setLoss
BoostingStrategy
setLossType
GBTClassifier GBTRegressor
setLowerBoundsOnCoefficients
LogisticRegression
setLowerBoundsOnIntercepts
LogisticRegression
setMainClass
SparkLauncher
setMapSideCombine
ShuffledRDD
setMaster
SparkConf SparkLauncher
setMax
MinMaxScaler MinMaxScalerModel
setMaxBins
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setMaxCategories
VectorIndexer
setMaxDepth
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setMaxIter
GBTClassifier LinearSVC LogisticRegression MultilayerPerceptronClassifier BisectingKMeans GaussianMixture KMeans LDA Word2Vec ALS AFTSurvivalRegression GBTRegressor GeneralizedLinearRegression LinearRegression
setMaxIterations
BisectingKMeans GaussianMixture KMeans LDA PowerIterationClustering
setMaxLocalProjDBSize
PrefixSpan
setMaxMemoryInMB
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setMaxPatternLength
PrefixSpan
setMaxSentenceLength
Word2Vec Word2Vec
setMetricName
BinaryClassificationEvaluator MulticlassClassificationEvaluator RegressionEvaluator
setMin
MinMaxScaler MinMaxScalerModel
setMinConfidence
FPGrowth FPGrowthModel AssociationRules
setMinCount
Word2Vec Word2Vec
setMinDF
CountVectorizer
setMinDivisibleClusterSize
BisectingKMeans BisectingKMeans
setMinDocFreq
IDF
setMinInfoGain
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setMinInstancesPerNode
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setMinSupport
FPGrowth FPGrowth PrefixSpan
setMinTF
CountVectorizer CountVectorizerModel
setMinTokenLength
RegexTokenizer
setMiniBatchFraction
StreamingLogisticRegressionWithSGD OnlineLDAOptimizer GradientDescent StreamingLinearRegressionWithSGD
setMissingValue
Imputer
setModelType
NaiveBayes NaiveBayes
setN
NGram
setName
JavaDoubleRDD JavaPairRDD JavaRDD EdgeRDDImpl VertexRDDImpl RDD
setNames
VectorSlicer
setNonnegative
ALS ALS
setNumBlocks
ALS
setNumBuckets
QuantileDiscretizer
setNumClasses
LogisticRegressionWithLBFGS Strategy
setNumCorrections
LBFGS
setNumFeatures
HashingTF
setNumFolds
CrossValidator
setNumHashTables
BucketedRandomProjectionLSH MinHashLSH
setNumItemBlocks
ALS
setNumIterations
StreamingLogisticRegressionWithSGD Word2Vec GradientDescent LBFGS StreamingLinearRegressionWithSGD BoostingStrategy
setNumPartitions
Word2Vec FPGrowth Word2Vec FPGrowth
setNumTopFeatures
ChiSqSelector ChiSqSelector
setNumTrees
RandomForestClassifier RandomForestRegressor
setNumUserBlocks
ALS
setOptimizeDocConcentration
LDA OnlineLDAOptimizer
setOptimizer
LDA LDA
setOrNull
Decimal
setOutputCol
UnaryTransformer Binarizer BucketedRandomProjectionLSH Bucketizer ChiSqSelector ChiSqSelectorModel CountVectorizer CountVectorizerModel HashingTF IDF IDFModel IndexToString Interaction MaxAbsScaler MaxAbsScalerModel MinHashLSH MinMaxScaler MinMaxScalerModel OneHotEncoder PCA PCAModel QuantileDiscretizer StandardScaler StandardScalerModel StopWordsRemover StringIndexer StringIndexerModel VectorAssembler VectorIndexer VectorIndexerModel VectorSlicer Word2Vec Word2VecModel
setOutputCols
Imputer ImputerModel
setP
Normalizer
setParent
Model
setPattern
RegexTokenizer
setPeacePeriod
StreamingTest
setPercentile
ChiSqSelector ChiSqSelector
setPredictionCol
PredictionModel Predictor OneVsRest OneVsRestModel BisectingKMeans BisectingKMeansModel GaussianMixture GaussianMixtureModel KMeans KMeansModel MulticlassClassificationEvaluator RegressionEvaluator FPGrowth FPGrowthModel ALS ALSModel AFTSurvivalRegression AFTSurvivalRegressionModel IsotonicRegression IsotonicRegressionModel
setProbabilityCol
ProbabilisticClassificationModel ProbabilisticClassifier GaussianMixture GaussianMixtureModel
setProductBlocks
ALS
setPropertiesFile
SparkLauncher
setQuantileCalculationStrategy
Strategy
setQuantileProbabilities
AFTSurvivalRegression AFTSurvivalRegressionModel
setQuantilesCol
AFTSurvivalRegression AFTSurvivalRegressionModel
setRandomCenters
StreamingKMeans
setRank
ALS ALS
setRatingCol
ALS
setRawPredictionCol
ClassificationModel Classifier BinaryClassificationEvaluator
setRegParam
LinearSVC LogisticRegression ALS GeneralizedLinearRegression LinearRegression StreamingLogisticRegressionWithSGD GradientDescent LBFGS StreamingLinearRegressionWithSGD
setRelativeError
QuantileDiscretizer
setRuns
KMeans
setSample
KernelDensity
setScalingVec
ElementwiseProduct
setSeed
DecisionTreeClassifier GBTClassifier MultilayerPerceptronClassifier RandomForestClassifier BisectingKMeans GaussianMixture KMeans LDA LDAModel BucketedRandomProjectionLSH MinHashLSH Word2Vec ALS DecisionTreeRegressor GBTRegressor RandomForestRegressor CrossValidator TrainValidationSplit BisectingKMeans GaussianMixture KMeans LDA Word2Vec ExponentialGenerator GammaGenerator LogNormalGenerator PoissonGenerator StandardNormalGenerator UniformGenerator WeibullGenerator ALS BernoulliCellSampler BernoulliSampler PoissonSampler Pseudorandom
setSelectorType
ChiSqSelector ChiSqSelector
setSerializer
CoGroupedRDD ShuffledRDD
setSmoothing
NaiveBayes
setSolver
MultilayerPerceptronClassifier GeneralizedLinearRegression LinearRegression
setSparkHome
SparkConf SparkLauncher
setSplits
Bucketizer
setStages
Pipeline
setStandardization
LinearSVC LogisticRegression LinearRegression
setStatement
SQLTransformer
setStepSize
GBTClassifier MultilayerPerceptronClassifier Word2Vec GBTRegressor StreamingLogisticRegressionWithSGD GradientDescent StreamingLinearRegressionWithSGD
setStopWords
StopWordsRemover
setStrategy
Imputer
setSubsamplingRate
GBTClassifier RandomForestClassifier LDA GBTRegressor RandomForestRegressor Strategy
setTaskContext
TaskContext
setTau0
OnlineLDAOptimizer
setTestMethod
StreamingTest
setThreshold
LinearSVC LinearSVCModel LogisticRegression LogisticRegressionModel Binarizer LogisticRegressionModel SVMModel
setThresholds
LogisticRegression LogisticRegressionModel ProbabilisticClassificationModel ProbabilisticClassifier
setTimeoutDuration
GroupState
setTimeoutTimestamp
GroupState
setToLowercase
RegexTokenizer
setTol
LinearSVC LogisticRegression MultilayerPerceptronClassifier GaussianMixture KMeans AFTSurvivalRegression GeneralizedLinearRegression LinearRegression
setTopicConcentration
LDA LDA
setTopicDistributionCol
LDA LDAModel
setTrainRatio
TrainValidationSplit
setTreeStrategy
BoostingStrategy
setUpdater
GradientDescent LBFGS
setUpperBoundsOnCoefficients
LogisticRegression
setUpperBoundsOnIntercepts
LogisticRegression
setUseNodeIdCache
Strategy
setUserBlocks
ALS
setUserCol
ALS ALSModel
setValidateData
GeneralizedLinearAlgorithm
setValidationTol
BoostingStrategy
setValue
Accumulable
setVarianceCol
DecisionTreeRegressionModel DecisionTreeRegressor
setVariancePower
GeneralizedLinearRegression
setVectorSize
Word2Vec Word2Vec
setVerbose
SparkLauncher
setVocabSize
CountVectorizer
setWeightCol
LinearSVC LinearSVCModel LogisticRegression NaiveBayes OneVsRest GeneralizedLinearRegression IsotonicRegression LinearRegression
setWindowSize
Word2Vec Word2Vec StreamingTest
setWithMean
StandardScaler StandardScalerModel
setWithStd
StandardScaler StandardScalerModel
setupCommitter
HadoopMapReduceCommitProtocol
setupJob
FileCommitProtocol HadoopMapReduceCommitProtocol
setupTask
FileCommitProtocol HadoopMapReduceCommitProtocol
sha1
functions
sha2
functions
shape
GammaGenerator
sharedState
SparkSession
shiftLeft
functions
shiftRight
functions
shiftRightUnsigned
functions
short
ColumnName
shortName
HiveFileFormat OrcFileFormat DataSourceRegister
shouldOverwrite
MLWriter
show
Dataset
showMillisDistribution
StatsReportListener
shuffleHandle
ShuffleDependency
shuffleId
FetchFailed ShuffleDependency ShuffleBlockId ShuffleDataBlockId ShuffleIndexBlockId
shuffleManager
SparkEnv
shuffleRead
ExecutorStageSummary
shuffleReadBytes
StageData
shuffleReadMetrics
TaskMetricDistributions TaskMetrics
shuffleReadRecords
StageData
shuffleWrite
ExecutorStageSummary
shuffleWriteBytes
StageData
shuffleWriteMetrics
TaskMetricDistributions TaskMetrics
shuffleWriteRecords
StageData
sigma
MultivariateGaussian
signum
functions
simpleString
ArrayType ByteType CharType DataType DecimalType IntegerType LongType MapType ObjectType ShortType StructType VarcharType
sin
functions
sinh
functions
sink
StreamingQueryProgress
size
AttributeGroup DenseVector SparseVector Vector ParamMap DenseVector SparseVector Vector Row functions
sizeInBytes
BaseRelation
sketch
util
skewness
functions
skip
LZ4BlockInputStream NioBufferedFileInputStream
skippedStages
JobProgressListener
slice
JavaDStreamLike DStream
slideDuration
DStream InputDStream
sliding
RDDFunctions
socketStream
StreamingContext JavaStreamingContext
socketTextStream
StreamingContext JavaStreamingContext
solver
GeneralizedLinearRegressionTrainingSummary
sort
Dataset
sortBy
JavaRDD RDD DataFrameWriter
sortByKey
JavaPairRDD OrderedRDDFunctions
sortWithinPartitions
Dataset
sort_array
functions
soundex
functions
source
metrics ml
sourceName
CodegenMetrics HiveCatalogMetrics
sourceSchema
StreamSourceProvider
sources
sql StreamingQueryProgress
spark
apache VersionInfo
sparkContext
RDD SQLContext SparkSession StreamingContext JavaStreamingContext
sparkProperties
ApplicationEnvironmentInfo EnvironmentListener
sparkSession
Dataset SQLContext StreamingQuery
sparkUser
SparkContext JavaSparkContext SparkListenerApplicationStart ApplicationAttemptInfo
spark_partition_id
functions
sparse
Matrices Vectors Matrices Vectors
sparsity
NumericAttribute
spdiag
SparseMatrix SparseMatrix
speculative
TaskInfo TaskData
speye
Matrices SparseMatrix Matrices SparseMatrix
split
InternalNode Node functions
splitIndex
RDDBlockId
splits
Bucketizer
sprand
Matrices SparseMatrix Matrices SparseMatrix
sprandn
Matrices SparseMatrix Matrices SparseMatrix
sqdist
Vectors Vectors
sql
spark SQLContext SparkSession ArrayType DataType DecimalType MapType StructType
sqlContext
Dataset SparkSession BaseRelation
sqlType
VectorUDT
sqrt
functions
srcAttr
EdgeContext EdgeTriplet
srcId
Edge EdgeContext
srdd
JavaDoubleRDD
ssc
JavaStreamingContext
stackTrace
ExceptionFailure
stageAttemptId
SparkListenerTaskEnd SparkListenerTaskStart
stageAttemptNumber
TaskContext
stageFailed
StageInfo
stageId
SparkStageInfo TaskContext SparkListenerTaskEnd SparkListenerTaskStart StageInfo StageData
stageIdToActiveJobIds
JobProgressListener
stageIdToData
JobProgressListener
stageIdToInfo
JobProgressListener
stageIds
SparkJobInfo SparkListenerJobStart JobData
stageInfo
SparkListenerStageCompleted SparkListenerStageSubmitted
stageInfos
SparkListenerJobStart
stages
Pipeline PipelineModel
starGraph
GraphGenerators
start
DataStreamWriter StreamingContext JavaStreamingContext ConstantInputDStream InputDStream ReceiverInputDStream
startApplication
SparkLauncher
startOffset
SourceProgress StreamingQueryException
startPosition
AnalysisException
startTime
SparkContext JavaSparkContext ApplicationAttemptInfo OutputOperationInfo StreamingStatistics OutputOperationInfo JobProgressListener
startsWith
Column
stat
ml mllib Dataset
stateOperators
StreamingQueryProgress
stateSnapshots
JavaMapWithStateDStream MapWithStateDStream
statement
SQLTransformer
staticPageRank
GraphOps
staticParallelPersonalizedPageRank
GraphOps
staticPersonalizedPageRank
GraphOps
statistic
ChiSqTestResult KolmogorovSmirnovTestResult TestResult
stats
JavaDoubleRDD Node DoubleRDDFunctions
status
SparkJobInfo TaskInfo StreamingQuery spark JobData StageData TaskData BatchInfo
statusTracker
SparkContext JavaSparkContext
std
NumericAttribute StandardScalerModel StandardScalerModel LogNormalGenerator
stddev
functions
stddev_pop
functions
stddev_samp
functions
stdev
JavaDoubleRDD DoubleRDDFunctions StatCounter
stop
SparkContext JavaSparkContext SparkAppHandle SparkSession StreamingQuery StreamingContext JavaStreamingContext ConstantInputDStream InputDStream ReceiverInputDStream Receiver
stopWords
StopWordsRemover
storage
spark ui
storageLevel
Dataset RDDPartitionInfo RDDStorageInfo BlockStatus BlockUpdatedInfo RDDInfo Builder Receiver
storageStatusList
StorageStatusListener
store
Receiver
streamId
ReceiverInfo StreamBlockId Receiver ReceiverInfo
streamIdToInputInfo
BatchInfo
streamName
ReceiverInfo Builder
streaming
sql v1 spark
streamingContext
Builder
streams
SQLContext SparkSession
string
ColumnName
stringWritableConverter
WritableConverter
stringWritableFactory
WritableFactory
stronglyConnectedComponents
GraphOps
struct
ColumnName functions
stsCredentials
Builder
subgraph
Graph GraphImpl
submissionTime
SparkStageInfo StageInfo JobData StageData BatchInfo
submitJob
JobSubmitter SparkContext
subsamplingRate
Strategy
subsetAccuracy
MultilabelMetrics
substr
Column
substring
functions
substring_index
functions
subtract
JavaDoubleRDD JavaPairRDD JavaRDD BlockMatrix RDD
subtractByKey
JavaPairRDD PairRDDFunctions
succeededTasks
ExecutorStageSummary
successful
TaskInfo
sum
JavaDoubleRDD DoubleRDDFunctions RelationalGroupedDataset typed functions DoubleAccumulator LongAccumulator StatCounter
sumApprox
JavaDoubleRDD DoubleRDDFunctions
sumDistinct
functions
sumLong
typed
summary
LogisticRegressionModel BisectingKMeansModel GaussianMixtureModel KMeansModel GeneralizedLinearRegressionModel LinearRegressionModel
supportedFeatureSubsetStrategies
RandomForestClassifier RandomForestRegressor RandomForest
supportedImpurities
DecisionTreeClassifier RandomForestClassifier DecisionTreeRegressor RandomForestRegressor
supportedLossTypes
GBTClassifier GBTRegressor
surrogateDF
ImputerModel
symbolToColumn
SQLImplicits
systemProperties
ApplicationEnvironmentInfo EnvironmentListener