Package org.apache.flink.state.forst.fs

Class ForStFileSystemTrackingCreatedDirDecorator

java.lang.Object

org.apache.flink.core.fs.FileSystem

org.apache.flink.state.forst.fs.ForStFlinkFileSystem

org.apache.flink.state.forst.fs.ForStFileSystemTrackingCreatedDirDecorator

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.flink.core.fs.IFileSystem

public class ForStFileSystemTrackingCreatedDirDecorator
extends ForStFlinkFileSystem

A decorator of ForStFlinkFileSystem to adapt ForSt to the underlying FileSystems which are implemented with incomplete mkdir(), i.e., such FileSystem implementation does not actually create the directory when mkdir() completes. This can lead to unexpected behavior when ForSt tries to assert the existence of directories by calling exists(). Therefore, we track the paths of the should-be-created directories and subsequently return true for existence checks.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.state.forst.fs.ForStFlinkFileSystem

ForStFlinkFileSystem.FileStatusWrapper

Nested classes/interfaces inherited from class org.apache.flink.core.fs.FileSystem

org.apache.flink.core.fs.FileSystem.FSKey, org.apache.flink.core.fs.FileSystem.WriteMode

Method Summary

Modifier and Type	Method	Description
boolean	exists(org.apache.flink.core.fs.Path f)
boolean	mkdirs(org.apache.flink.core.fs.Path path)

Methods inherited from class org.apache.flink.state.forst.fs.ForStFlinkFileSystem

close, create, create, delete, get, get, getDelegateFS, getFileBasedCache, getFileBlockLocations, getFileStatus, getHomeDirectory, getMappingEntry, getRemoteBase, getUri, getWorkingDirectory, giveUpOwnership, isDistributedFS, link, link, listStatus, open, open, registerReusedRestoredFile, rename

Methods inherited from class org.apache.flink.core.fs.FileSystem

create, create, createRecoverableWriter, createRecoverableWriter, getDefaultBlockSize, getDefaultFsUri, getLocalFileSystem, getUnguardedFileSystem, initialize, initialize, initOutPathDistFS, initOutPathLocalFS

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.core.fs.IFileSystem

canCopyPaths

Method Detail

mkdirs

public boolean mkdirs(org.apache.flink.core.fs.Path path)
               throws IOException

Specified by:

mkdirs in interface org.apache.flink.core.fs.IFileSystem

Overrides:

mkdirs in class ForStFlinkFileSystem

Throws:

IOException

exists

public boolean exists(org.apache.flink.core.fs.Path f)
               throws IOException

Specified by:

exists in interface org.apache.flink.core.fs.IFileSystem

Overrides:

exists in class ForStFlinkFileSystem

Throws:

IOException