Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: apache/flink Loading
base: 74e6e125feaeac4fd8b997b5df5eb4b43d405c88
Choose a base ref
...
head repository: apache/flink Loading
compare: 8418b10579f1cd8e48af78ced7d7101debbd7d1f
Choose a head ref
  • 1 commit
  • 63 files changed
  • 1 contributor

Commits on Sep 8, 2015

  1. [FLINK-2097][core] implement a job session management 

    Sessions make sure that the JobManager does not immediately discard a
JobGraph after execution, but keeps it around for further operations to
be attached to the graph. That is the basis for interactive sessions.

This pull request implements a rudimentary session management. Together
with the backtracking #640, this will enable users to submit jobs to the
cluster and access intermediate results. Session handling ensures that
the results are cleared eventually.

ExecutionGraphs are kept as long as
  - no timeout occurred or
  - the session has not been explicitly ended

The following changes have also been made in this pull request:

- The Job ID is created through the ExecutionEnvironment and passed through

- Sessions can be termined by the ExecutionEnvironment or directly
  through the executor

- The environments use reapers (local) and shutdown hooks (remote) to
  ensure session termination when the environment runs out of scope

- The Client manages only connections to the JobManager, it is not job
  specific

This closes #858.
    @mxm
    mxm committed Sep 8, 2015
    Configuration menu
    Copy the full SHA
    8418b10 View commit details
    Browse the repository at this point in the history
Loading