Class MasterBatchCoordinator
- java.lang.Object
-
- org.apache.storm.topology.base.BaseComponent
-
- org.apache.storm.topology.base.BaseRichSpout
-
- org.apache.storm.trident.topology.MasterBatchCoordinator
-
- All Implemented Interfaces:
Serializable,ISpout,IComponent,IRichSpout
public class MasterBatchCoordinator extends BaseRichSpout
- See Also:
- Serialized Form
-
-
Field Summary
Fields Modifier and Type Field Description static StringBATCH_STREAM_IDstatic StringCOMMIT_STREAM_IDstatic longINIT_TXIDstatic org.slf4j.LoggerLOGstatic StringSUCCESS_STREAM_ID
-
Constructor Summary
Constructors Constructor Description MasterBatchCoordinator(List<String> spoutIds, List<ITridentSpout> spouts)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description voidack(Object msgId)Storm has determined that the tuple emitted by this spout with the msgId identifier has been fully processed.voidactivate()Called when a spout has been activated out of a deactivated mode.voidclose()Called when an ISpout is going to be shutdown.voiddeactivate()Called when a spout has been deactivated.voiddeclareOutputFields(OutputFieldsDeclarer declarer)Declare the output schema for all the streams of this topology.voidfail(Object msgId)The tuple emitted by this spout with the msgId identifier has failed to be fully processed.Map<String,Object>getComponentConfiguration()Declare configuration specific to this component.List<String>getManagedSpoutIds()voidnextTuple()When this method is called, Storm is requesting that the Spout emit tuples to the output collector.voidopen(Map<String,Object> conf, TopologyContext context, SpoutOutputCollector collector)Called when a task for this component is initialized within a worker on the cluster.StringtoString()
-
-
-
Field Detail
-
LOG
public static final org.slf4j.Logger LOG
-
INIT_TXID
public static final long INIT_TXID
- See Also:
- Constant Field Values
-
BATCH_STREAM_ID
public static final String BATCH_STREAM_ID
- See Also:
- Constant Field Values
-
COMMIT_STREAM_ID
public static final String COMMIT_STREAM_ID
- See Also:
- Constant Field Values
-
SUCCESS_STREAM_ID
public static final String SUCCESS_STREAM_ID
- See Also:
- Constant Field Values
-
-
Constructor Detail
-
MasterBatchCoordinator
public MasterBatchCoordinator(List<String> spoutIds, List<ITridentSpout> spouts)
-
-
Method Detail
-
activate
public void activate()
Description copied from interface:ISpoutCalled when a spout has been activated out of a deactivated mode. nextTuple will be called on this spout soon. A spout can become activated after having been deactivated when the topology is manipulated using the `storm` client.- Specified by:
activatein interfaceISpout- Overrides:
activatein classBaseRichSpout
-
deactivate
public void deactivate()
Description copied from interface:ISpoutCalled when a spout has been deactivated. nextTuple will not be called while a spout is deactivated. The spout may or may not be reactivated in the future.- Specified by:
deactivatein interfaceISpout- Overrides:
deactivatein classBaseRichSpout
-
open
public void open(Map<String,Object> conf, TopologyContext context, SpoutOutputCollector collector)
Description copied from interface:ISpoutCalled when a task for this component is initialized within a worker on the cluster. It provides the spout with the environment in which the spout executes.This includes the:
- Parameters:
conf- The Storm configuration for this spout. This is the configuration provided to the topology merged in with cluster configuration on this machine.context- This object can be used to get information about this task's place within the topology, including the task id and component id of this task, input and output information, etc.collector- The collector is used to emit tuples from this spout. Tuples can be emitted at any time, including the open and close methods. The collector is thread-safe and should be saved as an instance variable of this spout object.
-
close
public void close()
Description copied from interface:ISpoutCalled when an ISpout is going to be shutdown. There is no guarentee that close will be called, because the supervisor kill -9's worker processes on the cluster.The one context where close is guaranteed to be called is a topology is killed when running Storm in local mode.
- Specified by:
closein interfaceISpout- Overrides:
closein classBaseRichSpout
-
nextTuple
public void nextTuple()
Description copied from interface:ISpoutWhen this method is called, Storm is requesting that the Spout emit tuples to the output collector. This method should be non-blocking, so if the Spout has no tuples to emit, this method should return. nextTuple, ack, and fail are all called in a tight loop in a single thread in the spout task. When there are no tuples to emit, it is courteous to have nextTuple sleep for a short amount of time (like a single millisecond) so as not to waste too much CPU.
-
ack
public void ack(Object msgId)
Description copied from interface:ISpoutStorm has determined that the tuple emitted by this spout with the msgId identifier has been fully processed. Typically, an implementation of this method will take that message off the queue and prevent it from being replayed.- Specified by:
ackin interfaceISpout- Overrides:
ackin classBaseRichSpout
-
fail
public void fail(Object msgId)
Description copied from interface:ISpoutThe tuple emitted by this spout with the msgId identifier has failed to be fully processed. Typically, an implementation of this method will put that message back on the queue to be replayed at a later time.- Specified by:
failin interfaceISpout- Overrides:
failin classBaseRichSpout
-
declareOutputFields
public void declareOutputFields(OutputFieldsDeclarer declarer)
Description copied from interface:IComponentDeclare the output schema for all the streams of this topology.- Parameters:
declarer- this is used to declare output stream ids, output fields, and whether or not each output stream is a direct stream
-
getComponentConfiguration
public Map<String,Object> getComponentConfiguration()
Description copied from interface:IComponentDeclare configuration specific to this component. Only a subset of the "topology.*" configs can be overridden. The component configuration can be further overridden when constructing the topology usingTopologyBuilder- Specified by:
getComponentConfigurationin interfaceIComponent- Overrides:
getComponentConfigurationin classBaseComponent
-
-