cascading.flow.hadoop
Class HadoopFlowStep
java.lang.Object
cascading.flow.planner.BaseFlowStep<JobConf>
cascading.flow.hadoop.HadoopFlowStep
- All Implemented Interfaces:
- FlowStep<JobConf>, Serializable
- Direct Known Subclasses:
- MapReduceFlowStep
public class HadoopFlowStep
- extends BaseFlowStep<JobConf>
- See Also:
- Serialized Form
Methods inherited from class cascading.flow.planner.BaseFlowStep |
addAccumulatedSourceFor, addGroup, addListener, addSink, addSource, addStreamedSourceFor, clean, commitSinks, containsPipeNamed, createClientState, equals, fireOnCompleted, fireOnRunning, fireOnStarting, fireOnStopping, fireOnThrowable, getAllAccumulatedSources, getAllOperations, getConfig, getFlow, getFlowID, getFlowName, getFlowStepJob, getFlowStepStats, getGraph, getGroup, getGroups, getID, getJoinTributariesBetween, getName, getNextFlowElement, getNextScope, getNextScopes, getPreviousScopes, getScopeFor, getSink, getSinkName, getSinks, getSinkWith, getSourceName, getSources, getSourceWith, getStepDisplayName, getStepDisplayName, getStepNum, getStreamedSourceByJoin, getSubmitPriority, getSuccessors, getTopologicalOrderIterator, hashCode, hasListeners, initConfFromProcessConfigDef, isDebugEnabled, isInfoEnabled, logDebug, logError, logInfo, logWarn, logWarn, removeListener, rollbackSinks, setConf, setFlow, setFlowName, setSubmitPriority, toString |
HadoopFlowStep
public HadoopFlowStep(String name,
int stepNum)
getInitializedConfig
public JobConf getInitializedConfig(FlowProcess<JobConf> flowProcess,
JobConf parentConfig)
- Specified by:
getInitializedConfig
in class BaseFlowStep<JobConf>
isHadoopLocalMode
public boolean isHadoopLocalMode(JobConf conf)
createFlowStepJob
protected FlowStepJob<JobConf> createFlowStepJob(FlowProcess<JobConf> flowProcess,
JobConf parentConfig)
- Specified by:
createFlowStepJob
in class BaseFlowStep<JobConf>
clean
public void clean(JobConf config)
- Method clean removes any temporary files used by this FlowStep instance. It will log any IOExceptions thrown.
- Specified by:
clean
in class BaseFlowStep<JobConf>
- Parameters:
config
- of type JobConf
initFromSources
protected void initFromSources(FlowProcess<JobConf> flowProcess,
JobConf conf)
getTapForID
public Tap getTapForID(Set<Tap> taps,
String id)
initFromSink
protected void initFromSink(FlowProcess<JobConf> flowProcess,
JobConf conf)
initFromTraps
protected void initFromTraps(FlowProcess<JobConf> flowProcess,
JobConf conf)
getTraps
public Set<Tap> getTraps()
getTrap
public Tap getTrap(String name)
getMapperTraps
public Map<String,Tap> getMapperTraps()
getReducerTraps
public Map<String,Tap> getReducerTraps()
getMapperTrap
public Tap getMapperTrap(String name)
getReducerTrap
public Tap getReducerTrap(String name)
Copyright © 2007-2013 Concurrent, Inc. All Rights Reserved.