Add notebook on concurrent tasks #81
Conversation
|
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
There was a problem hiding this comment.
I think we should avoid any language that implies this can represent a substitute of asynchronous pipelines. Let's frame the message around something like "you can improve a pipeline's performance by running multiple jobs concurrently inside a custom component"
Co-authored-by: Massimiliano Pippi <[email protected]>
| @@ -0,0 +1,1226 @@ | |||
| { | |||
There was a problem hiding this comment.
Is asyncio technically using threading? I thought it was single-threaded execution.
Reply via ReviewNB
There was a problem hiding this comment.
I'm using asyncio.to_thread: it creates separate threads. In this case, asyncio is only used as a high-level API.
|
Lovely work!! Could we replace the "workaround" vocab to maybe "optimisation"? |
Result of https://github.com/deepset-ai/haystack-private/issues/73
@masci: I need your technical review
@mrm1001 @deepset-ai/devrel: please review the messaging