public class HadoopFlowConnector extends FlowConnector
Tap
instances with an assembly of Pipe
instances into
an executable HadoopFlow
for execution on an Apache Hadoop cluster.AppProps
,
FlowConnectorProps
,
FlowDef
,
MapReduceFlow
properties
Constructor and Description |
---|
HadoopFlowConnector()
Constructor HadoopFlowConnector creates a new HadoopFlowConnector instance.
|
HadoopFlowConnector(Map<Object,Object> properties)
Constructor HadoopFlowConnector creates a new HadoopFlowConnector instance using the given
Properties instance as
default value for the underlying jobs. |
HadoopFlowConnector(Map<Object,Object> properties,
RuleRegistrySet ruleRegistrySet)
Constructor HadoopFlowConnector creates a new HadoopFlowConnector instance using the given
Properties instance as
default value for the underlying jobs. |
HadoopFlowConnector(RuleRegistrySet ruleRegistrySet)
Constructor HadoopFlowConnector creates a new HadoopFlowConnector instance.
|
Modifier and Type | Method and Description |
---|---|
protected RuleRegistrySet |
createDefaultRuleRegistrySet() |
protected FlowPlanner |
createFlowPlanner() |
protected Class<? extends Scheme> |
getDefaultIntermediateSchemeClass() |
connect, connect, connect, connect, connect, connect, connect, connect, connect, connect, connect, connect, connect, connect, connect, getIntermediateSchemeClass, getPlatformInfo, getProperties, getRuleRegistrySet
public HadoopFlowConnector()
JobConf
which pulls all properties from the local CLASSPATH.@ConstructorProperties(value="properties") public HadoopFlowConnector(Map<Object,Object> properties)
Properties
instance as
default value for the underlying jobs. All properties are copied to a new native configuration instance.properties
- of type Map@ConstructorProperties(value="ruleRegistrySet") public HadoopFlowConnector(RuleRegistrySet ruleRegistrySet)
JobConf
which pulls all properties from the local CLASSPATH.ruleRegistrySet
- of type RuleRegistry@ConstructorProperties(value={"properties","ruleRegistrySet"}) public HadoopFlowConnector(Map<Object,Object> properties, RuleRegistrySet ruleRegistrySet)
Properties
instance as
default value for the underlying jobs. All properties are copied to a new native configuration instance.properties
- of type MapruleRegistrySet
- of type RuleRegistryprotected Class<? extends Scheme> getDefaultIntermediateSchemeClass()
getDefaultIntermediateSchemeClass
in class FlowConnector
protected FlowPlanner createFlowPlanner()
createFlowPlanner
in class FlowConnector
protected RuleRegistrySet createDefaultRuleRegistrySet()
createDefaultRuleRegistrySet
in class FlowConnector
Copyright © 2007-2015 Concurrent, Inc. All Rights Reserved.