public static class BasePartitionTap.PartitionScheme<Config,Input,Output> extends Scheme<Config,Input,Output,Void,Void>
Constructor and Description |
---|
BasePartitionTap.PartitionScheme(Scheme scheme) |
BasePartitionTap.PartitionScheme(Scheme scheme,
Fields partitionFields) |
Modifier and Type | Method and Description |
---|---|
int |
getNumSinkParts()
Method getNumSinkParts returns the numSinkParts of this Scheme object.
|
Fields |
getSinkFields()
Method getSinkFields returns the sinkFields of this Scheme object.
|
Fields |
getSourceFields()
Method getSourceFields returns the sourceFields of this Scheme object.
|
void |
setNumSinkParts(int numSinkParts)
Method setNumSinkParts sets the numSinkParts of this Scheme object.
|
void |
setSinkFields(Fields sinkFields)
Method setSinkFields sets the sinkFields of this Scheme object.
|
void |
setSourceFields(Fields sourceFields)
Method setSourceFields sets the sourceFields of this Scheme object.
|
void |
sink(FlowProcess<? extends Config> flowProcess,
SinkCall<Void,Output> sinkCall)
Method sink writes out the given
Tuple found on SinkCall.getOutgoingEntry() to
the SinkCall.getOutput() . |
void |
sinkCleanup(FlowProcess<? extends Config> flowProcess,
SinkCall<Void,Output> sinkCall)
Method sinkCleanup is used to destroy resources created by
Scheme.sinkPrepare(cascading.flow.FlowProcess, SinkCall) . |
void |
sinkConfInit(FlowProcess<? extends Config> flowProcess,
Tap<Config,Input,Output> tap,
Config conf)
Method sinkInit initializes this instance as a sink.
|
void |
sinkPrepare(FlowProcess<? extends Config> flowProcess,
SinkCall<Void,Output> sinkCall)
Method sinkPrepare is used to initialize resources needed during each call of
Scheme.sink(cascading.flow.FlowProcess, SinkCall) . |
boolean |
source(FlowProcess<? extends Config> flowProcess,
SourceCall<Void,Input> sourceCall)
Method source will read a new "record" or value from
SourceCall.getInput() and populate
the available Tuple via SourceCall.getIncomingEntry() and return true
on success or false if no more values available. |
void |
sourceCleanup(FlowProcess<? extends Config> flowProcess,
SourceCall<Void,Input> sourceCall)
Method sourceCleanup is used to destroy resources created by
Scheme.sourcePrepare(cascading.flow.FlowProcess, SourceCall) . |
void |
sourceConfInit(FlowProcess<? extends Config> flowProcess,
Tap<Config,Input,Output> tap,
Config conf)
Method sourceInit initializes this instance as a source.
|
void |
sourcePrepare(FlowProcess<? extends Config> flowProcess,
SourceCall<Void,Input> sourceCall)
Method sourcePrepare is used to initialize resources needed during each call of
Scheme.source(cascading.flow.FlowProcess, SourceCall) . |
equals, getTrace, hashCode, isSink, isSource, isSymmetrical, presentSinkFields, presentSinkFieldsInternal, presentSourceFields, presentSourceFieldsInternal, retrieveSinkFields, retrieveSourceFields, toString
public BasePartitionTap.PartitionScheme(Scheme scheme)
public BasePartitionTap.PartitionScheme(Scheme scheme, Fields partitionFields)
public Fields getSinkFields()
Scheme
public void setSinkFields(Fields sinkFields)
Scheme
public Fields getSourceFields()
Scheme
public void setSourceFields(Fields sourceFields)
Scheme
public int getNumSinkParts()
Scheme
public void setNumSinkParts(int numSinkParts)
Scheme
public void sourceConfInit(FlowProcess<? extends Config> flowProcess, Tap<Config,Input,Output> tap, Config conf)
Scheme
Scheme.sourcePrepare(cascading.flow.FlowProcess, SourceCall)
if resources much be initialized
before use. And Scheme.sourceCleanup(cascading.flow.FlowProcess, SourceCall)
if resources must be
destroyed after use.public void sourcePrepare(FlowProcess<? extends Config> flowProcess, SourceCall<Void,Input> sourceCall) throws IOException
Scheme
Scheme.source(cascading.flow.FlowProcess, SourceCall)
.
Be sure to place any initialized objects in the SourceContext
so each instance
will remain threadsafe.sourcePrepare
in class Scheme<Config,Input,Output,Void,Void>
flowProcess
- of type FlowProcesssourceCall
- of type SourceCallIOException
public boolean source(FlowProcess<? extends Config> flowProcess, SourceCall<Void,Input> sourceCall) throws IOException
Scheme
SourceCall.getInput()
and populate
the available Tuple
via SourceCall.getIncomingEntry()
and return true
on success or false
if no more values available.
It's ok to set a new Tuple instance on the incomingEntry
TupleEntry
, or
to simply re-use the existing instance.
Note this is only time it is safe to modify a Tuple instance handed over via a method call.
This method may optionally throw a TapException
if it cannot process a particular
instance of data. If the payload Tuple is set on the TapException, that Tuple will be written to
any applicable failure trap Tap.public void sourceCleanup(FlowProcess<? extends Config> flowProcess, SourceCall<Void,Input> sourceCall) throws IOException
Scheme
Scheme.sourcePrepare(cascading.flow.FlowProcess, SourceCall)
.sourceCleanup
in class Scheme<Config,Input,Output,Void,Void>
flowProcess
- of ProcesssourceCall
- of type SourceCallIOException
public void sinkConfInit(FlowProcess<? extends Config> flowProcess, Tap<Config,Input,Output> tap, Config conf)
Scheme
Scheme.sinkPrepare(cascading.flow.FlowProcess, SinkCall)
if resources much be initialized
before use. And Scheme.sinkCleanup(cascading.flow.FlowProcess, SinkCall)
if resources must be
destroyed after use.public void sinkPrepare(FlowProcess<? extends Config> flowProcess, SinkCall<Void,Output> sinkCall) throws IOException
Scheme
Scheme.sink(cascading.flow.FlowProcess, SinkCall)
.
Be sure to place any initialized objects in the SinkContext
so each instance
will remain threadsafe.sinkPrepare
in class Scheme<Config,Input,Output,Void,Void>
flowProcess
- of type FlowProcesssinkCall
- of type SinkCallIOException
public void sink(FlowProcess<? extends Config> flowProcess, SinkCall<Void,Output> sinkCall) throws IOException
Scheme
Tuple
found on SinkCall.getOutgoingEntry()
to
the SinkCall.getOutput()
.
This method may optionally throw a TapException
if it cannot process a particular
instance of data. If the payload Tuple is set on the TapException, that Tuple will be written to
any applicable failure trap Tap. If not set, the incoming Tuple will be written instead.public void sinkCleanup(FlowProcess<? extends Config> flowProcess, SinkCall<Void,Output> sinkCall) throws IOException
Scheme
Scheme.sinkPrepare(cascading.flow.FlowProcess, SinkCall)
.sinkCleanup
in class Scheme<Config,Input,Output,Void,Void>
flowProcess
- of type FlowProcesssinkCall
- of type SinkCallIOException
Copyright © 2007-2015 Concurrent, Inc. All Rights Reserved.