public class Dfs extends Hfs
Tap
class that provides access to the Hadoop Distributed File System.
Use the URI
constructors to specify a different HDFS cluster than the default.stringPath
Constructor and Description |
---|
Dfs(Scheme scheme,
java.lang.String stringPath)
Constructor Dfs creates a new Dfs instance.
|
Dfs(Scheme scheme,
java.lang.String stringPath,
SinkMode sinkMode)
Constructor Dfs creates a new Dfs instance.
|
Dfs(Scheme scheme,
java.net.URI uri)
Constructor Dfs creates a new Dfs instance.
|
Dfs(Scheme scheme,
java.net.URI uri,
SinkMode sinkMode)
Constructor Dfs creates a new Dfs instance.
|
Modifier and Type | Method and Description |
---|---|
protected FileSystem |
getDefaultFileSystem(Configuration configuration) |
protected void |
setStringPath(java.lang.String stringPath) |
applySourceConfInitIdentifiers, createResource, deleteChildResource, deleteChildResource, deleteResource, getBlockSize, getBlockSize, getChildIdentifiers, getChildIdentifiers, getChildIdentifiers, getChildIdentifiers, getCombinedInputSafeMode, getDefaultFileSystemURIScheme, getFileStatus, getFileSystem, getFullIdentifier, getIdentifier, getLocalModeScheme, getModifiedTime, getPath, getReplication, getReplication, getSize, getSize, getTempPath, getURIScheme, getUseCombinedInput, isDirectory, isDirectory, makeTemporaryPathDirString, makeURIScheme, openForRead, openForWrite, resetFileStatuses, resourceExists, setUriScheme, sinkConfInit, sourceConfInit, sourceConfInitAddInputPath, sourceConfInitAddInputPaths, sourceConfInitComplete, verifyNoDuplicates
commitResource, createResource, deleteResource, equals, flowConfInit, getConfigDef, getFullIdentifier, getModifiedTime, getNodeConfigDef, getScheme, getSinkFields, getSinkMode, getSourceFields, getStepConfigDef, getTrace, hasConfigDef, hashCode, hasNodeConfigDef, hasStepConfigDef, id, isKeep, isReplace, isSink, isSource, isTemporary, isUpdate, openForRead, openForWrite, outgoingScopeFor, prepareResourceForRead, prepareResourceForWrite, presentSinkFields, presentSourceFields, resolveIncomingOperationArgumentFields, resolveIncomingOperationPassThroughFields, resourceExists, retrieveSinkFields, retrieveSourceFields, rollbackResource, setScheme, taps, toString
@ConstructorProperties(value={"scheme","uri"}) public Dfs(Scheme scheme, java.net.URI uri)
scheme
- of type Schemeuri
- of type URI@ConstructorProperties(value={"scheme","uri","sinkMode"}) public Dfs(Scheme scheme, java.net.URI uri, SinkMode sinkMode)
scheme
- of type Schemeuri
- of type URIsinkMode
- of type SinkMode@ConstructorProperties(value={"scheme","stringPath"}) public Dfs(Scheme scheme, java.lang.String stringPath)
scheme
- of type SchemestringPath
- of type Stringprotected void setStringPath(java.lang.String stringPath)
setStringPath
in class Hfs
protected FileSystem getDefaultFileSystem(Configuration configuration)
getDefaultFileSystem
in class Hfs
Copyright © 2007-2015 Xplenty, Inc. All Rights Reserved.