Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Moved parallel docs out of helpDB, updated and improved them #17681

Merged
merged 3 commits into from
Aug 3, 2016

Conversation

kshyatt
Copy link
Contributor

@kshyatt kshyatt commented Jul 28, 2016

Moved a bunch of docstrings inline. Changed things to reflect
the code that's actually in multi.jl. Documented RemoteException.

cc: @amitmurthy (again, sorry!)

@kshyatt kshyatt added domain:docs This change adds or pertains to documentation domain:parallelism Parallel or distributed computation labels Jul 28, 2016
@kshyatt
Copy link
Contributor Author

kshyatt commented Jul 29, 2016

Mac failure seems unrelated. Anybody have thoughts on this?

"""
Base.cluster_cookie() -> cookie

Returns the cluster cookie, by default the `LocalProcess` cookie.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reference to LocalProcess can be removed. It is not really mentioned in the docs anywhere and should also be probably unexported - not really relevant/useful in user code.

@amitmurthy
Copy link
Contributor

Thanks for doing this.

@@ -59,6 +78,12 @@ end

shift!(c::Channel) = take!(c)

"""
isready(c::Channel)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this isn't in the rst?

@kshyatt kshyatt force-pushed the ksh/docparallel branch 2 times, most recently from efcbb33 to ed2f97f Compare August 1, 2016 01:59
@@ -299,8 +299,6 @@ General Parallel Computing Support

Called by cluster managers using custom transports. It should be called when the custom transport implementation receives the first message from a remote worker. The custom transport must manage a logical connection to the remote worker and provide two ``IO`` objects, one for incoming messages and the other for messages addressed to the remote worker. If ``incoming`` is ``true``\ , the remote peer initiated the connection. Whichever of the pair initiates the connection sends the cluster cookie and its Julia version number to perform the authentication handshake.

.. function:: Future()
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

where did this go?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Eaten by a rebase, I think.

On Jul 31, 2016, at 19:17, Tony Kelman [email protected] wrote:

In doc/stdlib/parallel.rst #17681 (comment):

@@ -299,8 +299,6 @@ General Parallel Computing Support

Called by cluster managers using custom transports. It should be called when the custom transport implementation receives the first message from a remote worker. The custom transport must manage a logical connection to the remote worker and provide two ``IO`` objects, one for incoming messages and the other for messages addressed to the remote worker. If ``incoming`` is ``true``\ , the remote peer initiated the connection. Whichever of the pair initiates the connection sends the cluster cookie and its Julia version number to perform the authentication handshake.

-.. function:: Future()
where did this go?


You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/JuliaLang/julia/pull/17681/files/c5307064cef6a7b31f0ea8c3e4e8c69d5fe9b240..ed2f97f71ed7b876a6989284cffefb8250baeaa2#r72917653, or mute the thread https://github.com/notifications/unsubscribe-auth/AAyk47Iek7ZNt8vYmH8GesblknEEWny1ks5qbVdUgaJpZM4JXmvy.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh, actually, it's extraneous now that I have the default argument shown in the other Future docstring.

@kshyatt
Copy link
Contributor Author

kshyatt commented Aug 1, 2016

@tkelman thoughts? Good to go?

@amitmurthy as well

"""
procs(pid::Integer)

Returns a list of all process identifiers visible to worker `pid`.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Returns a list of all process identifiers on the same physical node. Specifically all workers bound to the same ip-address as pid are returned.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is used by shared arrays to identify the subset of workers on remote nodes.

@@ -121,7 +121,7 @@ own such constructs.)

An important thing to remember is that, once fetched, a :class:`Future` will cache its value
locally. Further :func:`fetch` calls do not entail a network hop. Once all referencing
:class:`Future`\ s have fetched, the remote stored value is deleted.
:class:`Future` s have fetched, the remote stored value is deleted.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This might have been necessary? Not sure how it changes the rendering.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, \ is needed if the character after a backtick isn't whitespace.


.. Docstring generated from Julia source

Returns a list of all process identifiers visible to worker ``pid``\ . The result depends on the topology of the workgroup.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

missing a make docs run. should squash this too, probably

Moved a bunch of docstrings inline. Changed things to reflect
the code that's actually in `multi.jl`. Documented `RemoteException`.
@kshyatt
Copy link
Contributor Author

kshyatt commented Aug 3, 2016

Ran make docs and make check-whitespace post-squash

@tkelman tkelman merged commit 2638c64 into master Aug 3, 2016
@tkelman tkelman deleted the ksh/docparallel branch August 3, 2016 15:46
@kshyatt
Copy link
Contributor Author

kshyatt commented Aug 3, 2016

Thanks for all the help & review, @tkelman and @amitmurthy.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
domain:docs This change adds or pertains to documentation domain:parallelism Parallel or distributed computation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants