cascading.tap.hadoop
Class Lfs

java.lang.Object
  cascading.tap.Tap<JobConf,RecordReader,OutputCollector>
      cascading.tap.hadoop.Hfs
          cascading.tap.hadoop.Lfs

All Implemented Interfaces:

FlowElement, FileType<JobConf>, Serializable

public class Lfs
extends Hfs

Class Lfs is a Tap class that provides access to the Local File System via Hadoop.

Note that using a Lfs Tap instance in a Flow will force a portion of not the whole Flow to be executed in "local" mode forcing the Flow to execute in the current JVM. Mixing with Dfs and other Tap types is possible, providing a means to implement complex file/data management functions.

Use Hfs if you need a Tap instance that inherits the default FileSystem used by Hadoop.

See Also:

Serialized Form

Field Summary

Fields inherited from class cascading.tap.hadoop.Hfs

stringPath, TEMPORARY_DIRECTORY

Constructor Summary

Lfs(Fields fields, String stringPath)
Deprecated.

Lfs(Fields fields, String stringPath, SinkMode sinkMode)
Deprecated.

Lfs(Scheme scheme, String stringPath)
Constructor Lfs creates a new Lfs instance.

Lfs(Scheme scheme, String stringPath, boolean replace)
Deprecated.

Lfs(Scheme scheme, String stringPath, SinkMode sinkMode)
Constructor Lfs creates a new Lfs instance.

Method Summary

protected FileSystem	getFileSystem(JobConf conf)
protected void	setStringPath(String stringPath)

Methods inherited from class cascading.tap.hadoop.Hfs

applySourceConfInitIdentifiers, createResource, deleteChildResource, deleteResource, getBlockSize, getChildIdentifiers, getChildIdentifiers, getCombinedInputSafeMode, getDefaultFileSystem, getDefaultFileSystemURIScheme, getFullIdentifier, getIdentifier, getLocalModeScheme, getModifiedTime, getPath, getReplication, getSize, getTemporaryDirectory, getTempPath, getURIScheme, getUseCombinedInput, isDirectory, makeTemporaryPathDirString, makeURIScheme, openForRead, openForWrite, resourceExists, setTemporaryDirectory, setUriScheme, sinkConfInit, sourceConfInit, sourceConfInitAddInputPath, sourceConfInitComplete, verifyNoDuplicates

Methods inherited from class cascading.tap.Tap

commitResource, createResource, deleteResource, equals, flowConfInit, getConfigDef, getFullIdentifier, getModifiedTime, getScheme, getSinkFields, getSinkMode, getSourceFields, getStepConfigDef, getTrace, hasConfigDef, hashCode, hasStepConfigDef, id, isEquivalentTo, isKeep, isReplace, isSink, isSource, isTemporary, isUpdate, openForRead, openForWrite, outgoingScopeFor, presentSinkFields, presentSourceFields, resolveIncomingOperationArgumentFields, resolveIncomingOperationPassThroughFields, resourceExists, retrieveSinkFields, retrieveSourceFields, rollbackResource, setScheme, taps, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

Lfs

@ConstructorProperties(value={"fields","stringPath"})
@Deprecated
public Lfs(Fields fields,
                                                 String stringPath)

Deprecated.

Constructor Lfs creates a new Lfs instance.

Parameters:

fields - of type Fields

stringPath - of type String

Lfs

@ConstructorProperties(value={"scheme","stringPath"})
public Lfs(Scheme scheme,
                                      String stringPath)

Constructor Lfs creates a new Lfs instance.

Parameters:

scheme - of type Scheme

stringPath - of type String

Lfs

@ConstructorProperties(value={"scheme","stringPath","replace"})
@Deprecated
public Lfs(Scheme scheme,
                                                 String stringPath,
                                                 boolean replace)

Deprecated.

Constructor Lfs creates a new Lfs instance.

Parameters:

scheme - of type Scheme

stringPath - of type String

replace - of type boolean

Lfs

@ConstructorProperties(value={"fields","stringPath","sinkMode"})
@Deprecated
public Lfs(Fields fields,
                                                 String stringPath,
                                                 SinkMode sinkMode)

Deprecated.

Constructor Lfs creates a new Lfs instance.

Parameters:

fields - of type Fields

stringPath - of type String

sinkMode - of type SinkMode

Lfs

@ConstructorProperties(value={"scheme","stringPath","sinkMode"})
public Lfs(Scheme scheme,
                                      String stringPath,
                                      SinkMode sinkMode)

Constructor Lfs creates a new Lfs instance.

Parameters:

scheme - of type Scheme

stringPath - of type String

sinkMode - of type SinkMode

Method Detail

setStringPath

protected void setStringPath(String stringPath)

Overrides:

setStringPath in class Hfs

getFileSystem

protected FileSystem getFileSystem(JobConf conf)

Overrides:

getFileSystem in class Hfs