Constructor Detail

• AggregatorManagerImpl

  public AggregatorManagerImpl​(ImmutableClassesGiraphConfiguration<?,​?,​?> conf,
                               int workerId,
                               int workerNum)

Method Detail

• init

  public void init​(FFICommunicator communicator)

  Description copied from interface: AggregatorManager
  Init the manager with Grape::Communicator, the actual logic depends on implementation.

  Specified by:

  init in interface AggregatorManager

  Parameters:

  communicator - communicator.

• acceptNettyMessage

  public void acceptNettyMessage​(NettyMessage aggregatorMessage)

  Accept a message from other worker, aggregate to me.

  Specified by:

  acceptNettyMessage in interface AggregatorManager

  Parameters:

  aggregatorMessage - received message.

• getWorkerId

  public int getWorkerId()

  Specified by:

  getWorkerId in interface AggregatorManager

• getNumWorkers

  public int getNumWorkers()

  Specified by:

  getNumWorkers in interface AggregatorManager

• registerAggregator

  public <A extends org.apache.hadoop.io.Writable> boolean registerAggregator​(String name,
                                                                              Class<? extends org.apache.giraph.aggregators.Aggregator<A>> aggregatorClass)
                                                                       throws InstantiationException,
                                                                              IllegalAccessException

  Register an aggregator with a unique name

  Specified by:

  registerAggregator in interface AggregatorManager

  Type Parameters:

  A - type param

  Parameters:

  name - aggregator name

  aggregatorClass - the class

  Throws:

  InstantiationException

  IllegalAccessException

• registerPersistentAggregator

  public <A extends org.apache.hadoop.io.Writable> boolean registerPersistentAggregator​(String name,
                                                                                        Class<? extends org.apache.giraph.aggregators.Aggregator<A>> aggregatorClass)
                                                                                 throws InstantiationException,
                                                                                        IllegalAccessException

  Register a persistent aggregator with a unique name.

  Specified by:

  registerPersistentAggregator in interface AggregatorManager

  Type Parameters:

  A - type param

  Parameters:

  name - aggregator name

  aggregatorClass - the implementation class

  Throws:

  InstantiationException

  IllegalAccessException

• getAggregatedValue

  public <A extends org.apache.hadoop.io.Writable> A getAggregatedValue​(String name)

  Return current aggregated value. Needs to be initialized if aggregate or setAggregatedValue have not been called before.

  Specified by:

  getAggregatedValue in interface AggregatorManager

  Specified by:

  getAggregatedValue in interface org.apache.giraph.aggregators.AggregatorUsage

  Parameters:

  name - name for the aggregator

  Returns:

  Aggregated

• getBroadcast

  public <B extends org.apache.hadoop.io.Writable> B getBroadcast​(String name)

  Get value broadcasted from master

  Specified by:

  getBroadcast in interface org.apache.giraph.worker.WorkerBroadcastUsage

  Parameters:

  name - Name of the broadcasted value

  Returns:

  Broadcasted value

• reduce

  public void reduce​(String name,
                     Object value)

  Reduce given value.

  Specified by:

  reduce in interface AggregatorManager

  Specified by:

  reduce in interface org.apache.giraph.worker.WorkerReduceUsage

  Parameters:

  name - Name of the reducer

  value - Single value to reduce

• reduceMerge

  public void reduceMerge​(String name,
                          org.apache.hadoop.io.Writable value)

  Reduce given partial value.

  Specified by:

  reduceMerge in interface org.apache.giraph.worker.WorkerReduceUsage

  Parameters:

  name - Name of the reducer

  value - Single value to reduce

• setAggregatedValue

  public <A extends org.apache.hadoop.io.Writable> void setAggregatedValue​(String name,
                                                                           A value)

  Set aggregated value. Can be used for initialization or reset.

  Specified by:

  setAggregatedValue in interface AggregatorManager

  Parameters:

  name - name for the aggregator

  value - Value to be set.

• aggregate

  public <A extends org.apache.hadoop.io.Writable> void aggregate​(String name,
                                                                  A value)

  Add a new value. Needs to be commutative and associative

  Specified by:

  aggregate in interface AggregatorManager

  Specified by:

  aggregate in interface org.apache.giraph.worker.WorkerAggregatorUsage

  Parameters:

  name - a unique name refer to an aggregator

  value - Value to be aggregated.

• registerReducer

  public <S,​R extends org.apache.hadoop.io.Writable> void registerReducer​(String name,
                                                                                org.apache.giraph.reducers.ReduceOperation<S,​R> reduceOp)

  Register reducer to be reduced in the next worker computation, using given name and operations.

  Specified by:

  registerReducer in interface AggregatorManager

  Type Parameters:

  S - Single value type

  R - Reduced value type

  Parameters:

  name - Name of the reducer

  reduceOp - Reduce operations

• registerReducer

  public <S,​R extends org.apache.hadoop.io.Writable> void registerReducer​(String name,
                                                                                org.apache.giraph.reducers.ReduceOperation<S,​R> reduceOp,
                                                                                R globalInitialValue)

  Register reducer to be reduced in the next worker computation, using given name and operations, starting globally from globalInitialValue. (globalInitialValue is reduced only once, each worker will still start from neutral initial value)

  Specified by:

  registerReducer in interface AggregatorManager

  Type Parameters:

  S - Single value type

  R - Reduced value type

  Parameters:

  name - Name of the reducer

  reduceOp - Reduce operations

  globalInitialValue - Global initial value

• getReduced

  public <R extends org.apache.hadoop.io.Writable> R getReduced​(String name)

  Get reduced value from previous worker computation.

  Specified by:

  getReduced in interface AggregatorManager

  Type Parameters:

  R - Reduced value type

  Parameters:

  name - Name of the reducer

  Returns:

  Reduced value

• broadcast

  public void broadcast​(String name,
                        org.apache.hadoop.io.Writable value)

  Broadcast given value to all workers for next computation.

  Specified by:

  broadcast in interface AggregatorManager

  Parameters:

  name - Name of the broadcast object

  value - Value

• preSuperstep

  public void preSuperstep()

  Specified by:

  preSuperstep in interface AggregatorManager

• postSuperstep

  public void postSuperstep()

  Synchronize aggregator values between workers after superstep.

  Specified by:

  postSuperstep in interface AggregatorManager

• postMasterCompute

  public void postMasterCompute()