cascading.flow.hadoop.planner
Class HadoopFlowStepJob
java.lang.Object
cascading.flow.planner.FlowStepJob<JobConf>
cascading.flow.hadoop.planner.HadoopFlowStepJob
- All Implemented Interfaces:
- Callable<Throwable>
public class HadoopFlowStepJob
- extends FlowStepJob<JobConf>
Methods inherited from class cascading.flow.planner.FlowStepJob |
blockOnJob, blockOnPredecessors, blockTillCompleteOrStopped, call, getStepStats, isSkipFlowStep, isStarted, isSuccessful, setPredecessors, sleepForPollingInterval, start, stop |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
HadoopFlowStepJob
public HadoopFlowStepJob(ClientState clientState,
BaseFlowStep flowStep,
JobConf currentConf)
getJobPollingInterval
public static long getJobPollingInterval(JobConf jobConf)
getConfig
public JobConf getConfig()
- Specified by:
getConfig
in class FlowStepJob<JobConf>
createStepStats
protected FlowStepStats createStepStats(ClientState clientState)
- Specified by:
createStepStats
in class FlowStepJob<JobConf>
internalBlockOnStop
protected void internalBlockOnStop()
throws IOException
- Specified by:
internalBlockOnStop
in class FlowStepJob<JobConf>
- Throws:
IOException
internalNonBlockingStart
protected void internalNonBlockingStart()
throws IOException
- Specified by:
internalNonBlockingStart
in class FlowStepJob<JobConf>
- Throws:
IOException
internalNonBlockingIsSuccessful
protected boolean internalNonBlockingIsSuccessful()
throws IOException
- Specified by:
internalNonBlockingIsSuccessful
in class FlowStepJob<JobConf>
- Throws:
IOException
isRemoteExecution
protected boolean isRemoteExecution()
- Specified by:
isRemoteExecution
in class FlowStepJob<JobConf>
getThrowable
protected Throwable getThrowable()
- Specified by:
getThrowable
in class FlowStepJob<JobConf>
internalJobId
protected String internalJobId()
- Specified by:
internalJobId
in class FlowStepJob<JobConf>
internalNonBlockingIsComplete
protected boolean internalNonBlockingIsComplete()
throws IOException
- Specified by:
internalNonBlockingIsComplete
in class FlowStepJob<JobConf>
- Throws:
IOException
dumpDebugInfo
protected void dumpDebugInfo()
- Specified by:
dumpDebugInfo
in class FlowStepJob<JobConf>
internalIsStarted
protected boolean internalIsStarted()
- Specified by:
internalIsStarted
in class FlowStepJob<JobConf>
reportLocalError
public static void reportLocalError(Throwable throwable)
- Internal method to report errors that happen on hadoop local mode. Hadoops local
JobRunner does not give access to TaskReports, but we want to be able to capture
the exception and not just print it to stderr. FlowMapper and FlowReducer use this method.
- Parameters:
throwable
- the throwable to be reported.
Copyright © 2007-2013 Concurrent, Inc. All Rights Reserved.