public class FlowProps extends Props
Flow
specific properties through
a FlowConnector
.AppProps
,
CascadeProps
,
FlowConnectorProps
Modifier and Type | Field and Description |
---|---|
static java.lang.String |
DEFAULT_ELEMENT_COMPARATOR |
static java.lang.String |
JOB_POLLING_INTERVAL |
static java.lang.String |
MAX_CONCURRENT_STEPS |
static java.lang.String |
PRESERVE_TEMPORARY_FILES |
static java.lang.String |
STOP_JOBS_ON_EXIT |
Constructor and Description |
---|
FlowProps() |
Modifier and Type | Method and Description |
---|---|
protected void |
addPropertiesTo(java.util.Properties properties) |
static FlowProps |
flowProps()
Creates a new FlowProps instance.
|
java.lang.String |
getDefaultTupleElementComparator() |
int |
getJobPollingInterval() |
int |
getMaxConcurrentSteps() |
boolean |
isPreserveTemporaryFiles() |
boolean |
isStopJobsOnExit() |
static void |
setDefaultTupleElementComparator(java.util.Map<java.lang.Object,java.lang.Object> properties,
java.lang.String className)
Sets a default
Comparator to be used if no Comparator can be found for the class via the
Comparison interface. |
FlowProps |
setDefaultTupleElementComparator(java.lang.String defaultTupleElementComparator)
Sets a default
Comparator to be used if no Comparator can be found for the class via the
Comparison interface. |
FlowProps |
setJobPollingInterval(int jobPollingInterval)
Property jobPollingInterval will set the time to wait between polling the remote server for the status of a job.
|
static void |
setJobPollingInterval(java.util.Map<java.lang.Object,java.lang.Object> properties,
long interval)
Property jobPollingInterval will set the time to wait between polling the remote server for the status of a job.
|
FlowProps |
setMaxConcurrentSteps(int maxConcurrentSteps)
Method setMaxConcurrentSteps sets the maximum number of steps that a Flow can run concurrently.
|
static void |
setMaxConcurrentSteps(java.util.Map<java.lang.Object,java.lang.Object> properties,
int numConcurrentSteps)
Method setMaxConcurrentSteps sets the maximum number of steps that a Flow can run concurrently.
|
FlowProps |
setPreserveTemporaryFiles(boolean preserveTemporaryFiles)
Property preserveTemporaryFiles forces the Flow instance to keep any temporary intermediate data sets.
|
static void |
setPreserveTemporaryFiles(java.util.Map<java.lang.Object,java.lang.Object> properties,
boolean preserveTemporaryFiles)
Property preserveTemporaryFiles forces the Flow instance to keep any temporary intermediate data sets.
|
FlowProps |
setStopJobsOnExit(boolean stopJobsOnExit)
Property stopJobsOnExit will tell the Flow to add a JVM shutdown hook that will kill all running processes if the
underlying computing system supports it.
|
static void |
setStopJobsOnExit(java.util.Map<java.lang.Object,java.lang.Object> properties,
boolean stopJobsOnExit)
Property stopJobsOnExit will tell the Flow to add a JVM shutdown hook that will kill all running processes if the
underlying computing system supports it.
|
buildProperties, buildProperties, buildProperties, buildProperties, setProperties, setProperties
public static final java.lang.String DEFAULT_ELEMENT_COMPARATOR
public static final java.lang.String PRESERVE_TEMPORARY_FILES
public static final java.lang.String JOB_POLLING_INTERVAL
public static final java.lang.String MAX_CONCURRENT_STEPS
public static final java.lang.String STOP_JOBS_ON_EXIT
public FlowProps()
public static void setDefaultTupleElementComparator(java.util.Map<java.lang.Object,java.lang.Object> properties, java.lang.String className)
Comparator
to be used if no Comparator can be found for the class via the
Comparison
interface.
In the case of Hadoop, if the Comparator instance also implements org.apache.hadoop.conf.Configurable
, the
org.apache.hadoop.conf.Configurable#setConf(org.apache.hadoop.conf.Configuration)
will be called.
In local mode, only the default constructor will be called for the comparator.
properties
- className
- public static void setPreserveTemporaryFiles(java.util.Map<java.lang.Object,java.lang.Object> properties, boolean preserveTemporaryFiles)
false
.properties
- of type MappreserveTemporaryFiles
- of type booleanpublic static void setJobPollingInterval(java.util.Map<java.lang.Object,java.lang.Object> properties, long interval)
properties
- of type Mapinterval
- of type longpublic static void setMaxConcurrentSteps(java.util.Map<java.lang.Object,java.lang.Object> properties, int numConcurrentSteps)
By default a Flow will attempt to run all give steps at the same time. But there are occasions where limiting the number of steps helps manages resources.
properties
- of type MapnumConcurrentSteps
- of type intpublic static void setStopJobsOnExit(java.util.Map<java.lang.Object,java.lang.Object> properties, boolean stopJobsOnExit)
true
.properties
- of type MapstopJobsOnExit
- of type booleanpublic static FlowProps flowProps()
public java.lang.String getDefaultTupleElementComparator()
public FlowProps setDefaultTupleElementComparator(java.lang.String defaultTupleElementComparator)
Comparator
to be used if no Comparator can be found for the class via the
Comparison
interface.
In the case of Hadoop, if the Comparator instance also implements org.apache.hadoop.conf.Configurable
, the
org.apache.hadoop.conf.Configurable#setConf(org.apache.hadoop.conf.Configuration)
will be called.
In local mode, only the default constructor will be called for the comparator.
defaultTupleElementComparator
- public boolean isPreserveTemporaryFiles()
public FlowProps setPreserveTemporaryFiles(boolean preserveTemporaryFiles)
false
.preserveTemporaryFiles
- of type booleanpublic int getJobPollingInterval()
public FlowProps setJobPollingInterval(int jobPollingInterval)
jobPollingInterval
- of type longpublic int getMaxConcurrentSteps()
public FlowProps setMaxConcurrentSteps(int maxConcurrentSteps)
By default a Flow will attempt to run all give steps at the same time. But there are occasions where limiting the number of steps helps manages resources.
maxConcurrentSteps
- of type intpublic boolean isStopJobsOnExit()
public FlowProps setStopJobsOnExit(boolean stopJobsOnExit)
true
.stopJobsOnExit
- of type booleanprotected void addPropertiesTo(java.util.Properties properties)
addPropertiesTo
in class Props
Copyright © 2007-2017 Cascading Maintainers. All Rights Reserved.