Package org.apache.giraph.io.formats

Class GiraphTextOutputFormat

java.lang.Object

org.apache.hadoop.mapreduce.OutputFormat<K,V>

org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<K,V>

org.apache.hadoop.mapreduce.lib.output.TextOutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

org.apache.giraph.io.formats.GiraphTextOutputFormat

public abstract class GiraphTextOutputFormat
extends org.apache.hadoop.mapreduce.lib.output.TextOutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

The text output format used for Giraph text writing.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat

org.apache.hadoop.mapreduce.lib.output.TextOutputFormat.LineRecordWriter<K extends Object,V extends Object>

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat

org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.Counter

Field Summary

Fields inherited from class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat

SEPARATOR, SEPERATOR

Fields inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat

BASE_OUTPUT_NAME, COMPRESS, COMPRESS_CODEC, COMPRESS_TYPE, OUTDIR, PART

Constructor Summary

Constructors

Constructor	Description
GiraphTextOutputFormat()

Method Summary

Modifier and Type	Method	Description
protected abstract String	getOutputFileName()
org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>	getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext job)	This function returns a record writer according to provided configuration.
protected abstract String	getSubdir()	This function is used to provide an additional path level to keep different text outputs into different directories.

Methods inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat

checkOutputSpecs, getCompressOutput, getDefaultWorkFile, getOutputCommitter, getOutputCompressorClass, getOutputName, getOutputPath, getPathForWorkFile, getUniqueFile, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputName, setOutputPath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GiraphTextOutputFormat

public GiraphTextOutputFormat()

Method Detail

getRecordWriter

public org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text> getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext job)
                                                                                                                    throws IOException,
                                                                                                                           InterruptedException

This function returns a record writer according to provided configuration. Giraph write file to hdfs.

In Grape-Giraph, we write to local file system.

Overrides:

getRecordWriter in class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Parameters:

job - shall be null.

Returns:

created record writer

Throws:

IOException

InterruptedException

getSubdir

protected abstract String getSubdir()

This function is used to provide an additional path level to keep different text outputs into different directories.

Returns:

the subdirectory to be created under the output path

getOutputFileName

protected abstract String getOutputFileName()