public class Lfs extends Hfs
Tap
class that provides access to the Local File System via Hadoop.
Note that using a Lfs Tap
instance in a Flow
will force a portion of not the whole Flow to be executed
in "local" mode forcing the Flow to execute in the current JVM. Mixing with Dfs
and other Tap
types is possible, providing a means to implement complex file/data management functions.
Use Hfs
if you need a Tap instance that inherits the default FileSystem
used by Hadoop.
stringPath
CASCADING_SOURCE_PATH
Constructor and Description |
---|
Lfs(Scheme scheme,
java.lang.String stringPath)
Constructor Lfs creates a new Lfs instance.
|
Lfs(Scheme scheme,
java.lang.String stringPath,
SinkMode sinkMode)
Constructor Lfs creates a new Lfs instance.
|
Modifier and Type | Method and Description |
---|---|
protected FileSystem |
getFileSystem(Configuration conf) |
protected void |
setStringPath(java.lang.String stringPath) |
applySourceConfInitIdentifiers, create, createResource, deleteChildResource, deleteChildResource, deleteResource, getBlockSize, getBlockSize, getChildIdentifiers, getChildIdentifiers, getChildIdentifiers, getChildIdentifiers, getCombinedInputSafeMode, getDefaultFileSystem, getDefaultFileSystemURIScheme, getFileStatus, getFullIdentifier, getIdentifier, getLocalModeScheme, getModifiedTime, getPath, getReplication, getReplication, getSize, getSize, getTempPath, getURIScheme, getUseCombinedInput, isDirectory, isDirectory, makeTemporaryPathDirString, makeURIScheme, openForRead, openForWrite, resetFileStatuses, resourceExists, setUriScheme, sinkConfInit, sourceConfInit, sourceConfInitAddInputPath, sourceConfInitAddInputPaths, sourceConfInitComplete, verifyNoDuplicates, withChildIdentifier, withScheme, withSinkMode
commitResource, createResource, deleteResource, entryStream, entryStream, entryStreamCopy, entryStreamCopy, equals, flowConfInit, getConfigDef, getFullIdentifier, getModifiedTime, getNodeConfigDef, getScheme, getSinkFields, getSinkMode, getSourceFields, getStepConfigDef, getTrace, hasConfigDef, hashCode, hasNodeConfigDef, hasStepConfigDef, id, isKeep, isReplace, isSink, isSource, isTemporary, isUpdate, openForRead, openForReadUnchecked, openForWrite, outgoingScopeFor, prepareResourceForRead, prepareResourceForWrite, presentSinkFields, presentSourceFields, resolveIncomingOperationArgumentFields, resolveIncomingOperationPassThroughFields, resourceExists, retrieveSinkFields, retrieveSourceFields, rollbackResource, setScheme, spliterator, splititerator, taps, toString, tupleStream, tupleStream, tupleStreamCopy, tupleStreamCopy
@ConstructorProperties(value={"scheme","stringPath"}) public Lfs(Scheme scheme, java.lang.String stringPath)
scheme
- of type SchemestringPath
- of type Stringprotected void setStringPath(java.lang.String stringPath)
setStringPath
in class Hfs
protected FileSystem getFileSystem(Configuration conf)
getFileSystem
in class Hfs
Copyright © 2007-2017 Cascading Maintainers. All Rights Reserved.