Package org.apache.giraph.io.formats

Class TextEdgeInputFormat<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.io.GiraphInputFormat<I,org.apache.hadoop.io.Writable,E>

org.apache.giraph.io.EdgeInputFormat<I,E>

org.apache.giraph.io.formats.TextEdgeInputFormat<I,E>

Type Parameters:

I - Vertex id

E - Edge data

All Implemented Interfaces:

org.apache.giraph.conf.GiraphConfigurationSettable<I,org.apache.hadoop.io.Writable,E>, org.apache.giraph.conf.ImmutableClassesGiraphConfigurable<I,org.apache.hadoop.io.Writable,E>

Direct Known Subclasses:

DatagenEdgeInputFormat, LiveJournalEdgeInputFormat, P2PEdgeInputFormat, P2PEdgeMultipleLongInputFormat

public abstract class TextEdgeInputFormat<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>
extends org.apache.giraph.io.EdgeInputFormat<I,E>

Abstract class that users should subclass to use their own text based edge output format.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
protected class	TextEdgeInputFormat.TextEdgeReader	EdgeReader for TextEdgeInputFormat.
protected class	TextEdgeInputFormat.TextEdgeReaderFromEachLine	Abstract class to be implemented by the user to read an edge from each text line.
protected class	TextEdgeInputFormat.TextEdgeReaderFromEachLineProcessed<T>	Abstract class to be implemented by the user to read an edge from each text line after preprocessing it.

Constructor Summary

Constructors

Constructor	Description
TextEdgeInputFormat()

Method Summary

Modifier and Type	Method	Description
void	checkInputSpecs(org.apache.hadoop.conf.Configuration conf)
List<org.apache.hadoop.mapreduce.InputSplit>	getSplits(org.apache.hadoop.mapreduce.JobContext context, int minSplitCountHint)

Methods inherited from class org.apache.giraph.io.EdgeInputFormat

createEdgeReader

Methods inherited from class org.apache.giraph.io.GiraphInputFormat

readInputSplit, writeInputSplit

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TextEdgeInputFormat

public TextEdgeInputFormat()

Method Detail

checkInputSpecs

public void checkInputSpecs(org.apache.hadoop.conf.Configuration conf)

Specified by:

checkInputSpecs in class org.apache.giraph.io.GiraphInputFormat<I extends org.apache.hadoop.io.WritableComparable,org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

getSplits

public List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext context,
                                                              int minSplitCountHint)
                                                       throws IOException,
                                                              InterruptedException

Specified by:

getSplits in class org.apache.giraph.io.GiraphInputFormat<I extends org.apache.hadoop.io.WritableComparable,org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Throws:

IOException

InterruptedException