org.apache.spark.io

Class LZ4CompressionCodec

Object

org.apache.spark.io.LZ4CompressionCodec

All Implemented Interfaces:

CompressionCodec

public class LZ4CompressionCodec
extends Object
implements CompressionCodec

:: DeveloperApi :: LZ4 implementation of CompressionCodec. Block size can be configured by spark.io.compression.lz4.blockSize.

Note:

The wire protocol for this codec is not guaranteed to be compatible across versions of Spark. This is intended for use as an internal compression utility within a single Spark application.

Constructor Summary

Constructors

Constructor and Description
LZ4CompressionCodec(SparkConf conf)

Method Summary

Modifier and Type	Method and Description
java.io.InputStream	compressedInputStream(java.io.InputStream s)
java.io.OutputStream	compressedOutputStream(java.io.OutputStream s)

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.io.CompressionCodec

compressedContinuousInputStream, compressedContinuousOutputStream

Constructor Detail

LZ4CompressionCodec

public LZ4CompressionCodec(SparkConf conf)

Method Detail

compressedInputStream

public java.io.InputStream compressedInputStream(java.io.InputStream s)

Specified by:

compressedInputStream in interface CompressionCodec

compressedOutputStream

public java.io.OutputStream compressedOutputStream(java.io.OutputStream s)

Specified by:

compressedOutputStream in interface CompressionCodec