Upgrade arrow to include the plasma TensorFlow op

[pcmoritz]

The main change in arrow relevant here is apache/arrow#2104

Can be built in the following way:

import ray
import pyarrow.plasma as plasma

plasma.build_plasma_tensorflow_op()

and then used as shown in https://github.com/pschafhalter/arrow/blob/50c66352ea87aa985ac0d70f6ea97c1f7423bd92/python/pyarrow/tests/test_plasma_tf_op.py

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/6677/
Test FAILed.

[robertnishihara]

@pcmoritz Does this build the TF op? How does the user use the op?

[pcmoritz]

I activated compiling the op now, an example usage is here: https://github.com/apache/arrow/blob/master/python/pyarrow/tests/test_plasma_tf_op.py

It should be tested out/maybe a test added before this is merged.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/6682/
Test FAILed.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/6687/
Test FAILed.

[AmplabJenkins]

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/6690/
Test PASSed.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/6691/
Test FAILed.

[pcmoritz]

jenkins retest this please

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/6693/
Test FAILed.

[pcmoritz]

jenkins retest this please

[robertnishihara]

document

[robertnishihara]

Looks good to me! Please address the minor comments and then we can merge it.

[AmplabJenkins]

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/6697/
Test PASSed.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/6698/
Test FAILed.