Package org.apache.flink.fs.azurefs

Class AzureBlobRecoverableWriter

  • All Implemented Interfaces:
    org.apache.flink.core.fs.RecoverableWriter
    public class AzureBlobRecoverableWriter
extends org.apache.flink.runtime.fs.hdfs.HadoopRecoverableWriter
    Recoverable writer for AzureBlob file system.

    • Nested Class Summary

      • Nested classes/interfaces inherited from interface org.apache.flink.core.fs.RecoverableWriter

        org.apache.flink.core.fs.RecoverableWriter.CommitRecoverable, org.apache.flink.core.fs.RecoverableWriter.ResumeRecoverable

    • Field Summary

      • Fields inherited from class org.apache.flink.runtime.fs.hdfs.HadoopRecoverableWriter

        fs

    • Constructor Summary

      Constructors 
      Constructor Description
      AzureBlobRecoverableWriter​(org.apache.hadoop.fs.FileSystem fs)
      Creates a new Recoverable writer.

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      protected void checkSupportedFSSchemes​(org.apache.hadoop.fs.FileSystem fs)  
      protected org.apache.flink.core.fs.RecoverableFsDataOutputStream getRecoverableFsDataOutputStream​(org.apache.hadoop.fs.Path targetFile, org.apache.hadoop.fs.Path tempFile)  
      org.apache.flink.core.fs.RecoverableFsDataOutputStream recover​(org.apache.flink.core.fs.RecoverableWriter.ResumeRecoverable recoverable)  
      org.apache.flink.core.fs.RecoverableFsDataOutputStream.Committer recoverForCommit​(org.apache.flink.core.fs.RecoverableWriter.CommitRecoverable recoverable)  

      • Methods inherited from class org.apache.flink.runtime.fs.hdfs.HadoopRecoverableWriter

        cleanupRecoverableState, getCommitRecoverableSerializer, getResumeRecoverableSerializer, open, requiresCleanupOfRecoverableState, supportsResume

    • Constructor Detail

      • AzureBlobRecoverableWriter

        public AzureBlobRecoverableWriter​(org.apache.hadoop.fs.FileSystem fs)
        Creates a new Recoverable writer.
        Parameters:
        fs - The AzureBlob file system on which the writer operates.

    • Method Detail

      • checkSupportedFSSchemes

        protected void checkSupportedFSSchemes​(org.apache.hadoop.fs.FileSystem fs)
        Overrides:
        checkSupportedFSSchemes in class org.apache.flink.runtime.fs.hdfs.HadoopRecoverableWriter

      • getRecoverableFsDataOutputStream

        protected org.apache.flink.core.fs.RecoverableFsDataOutputStream getRecoverableFsDataOutputStream​(org.apache.hadoop.fs.Path targetFile,
                                                                                                  org.apache.hadoop.fs.Path tempFile)
                                                                                           throws IOException
        Overrides:
        getRecoverableFsDataOutputStream in class org.apache.flink.runtime.fs.hdfs.HadoopRecoverableWriter
        Throws:
        IOException

      • recover

        public org.apache.flink.core.fs.RecoverableFsDataOutputStream recover​(org.apache.flink.core.fs.RecoverableWriter.ResumeRecoverable recoverable)
                                                               throws IOException
        Specified by:
        recover in interface org.apache.flink.core.fs.RecoverableWriter
        Overrides:
        recover in class org.apache.flink.runtime.fs.hdfs.HadoopRecoverableWriter
        Throws:
        IOException

      • recoverForCommit

        public org.apache.flink.core.fs.RecoverableFsDataOutputStream.Committer recoverForCommit​(org.apache.flink.core.fs.RecoverableWriter.CommitRecoverable recoverable)
                                                                                  throws IOException
        Specified by:
        recoverForCommit in interface org.apache.flink.core.fs.RecoverableWriter
        Overrides:
        recoverForCommit in class org.apache.flink.runtime.fs.hdfs.HadoopRecoverableWriter
        Throws:
        IOException