[FLINK-11419][filesystem] For recovery, wait until lease is revoked before truncate file

[EAlexRojas]

What is the purpose of the change

This pull request performs the truncate of the hadoop file only after waiting for the lease to be revoked.

Brief change log

• When resuming execution after a failure, wait until lease is revoked before performing truncate on the file.

Verifying this change

This change is already covered by existing tests, such as testRecoverWithState, testRecoverAfterMultiplePersistsState, etc in AbstractRecoverableWriterTest class.

An additional integration test could be added to test the case when this is used with a StreamingFileSink and simulate a taskmanager failure (?)

Does this pull request potentially affect one of the following parts:

• Dependencies (does it add or upgrade a dependency): no
• The public API, i.e., is any changed class annotated with @Public(Evolving): no
• The serializers: no
• The runtime per-record code paths (performance sensitive): no
• Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: no
• The S3 file system connector: no

Documentation

• Does this pull request introduce a new feature? no
• If yes, how is the feature documented? not applicable

[kl0u]

Hi @EAlexRojas, I will have a look on this PR today.

[kl0u]

By the way, try to rebase on the master and relaunch the build on Travis. I will do the same, but if the tests do not pass for whatever reason, then we cannot merge the PR.

[kl0u]

Thanks for the work @EAlexRojas . I will merge as soon as Travis gives green.

[EAlexRojas]

@kl0u Travis test in my branch is green now :)
Looks like the errors in your branch are not related to the changes in this PR either (?)