Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor communication between Pipeline Components #1321

Merged
merged 55 commits into from
Sep 10, 2021
Merged
Changes from 1 commit
Commits
Show all changes
55 commits
Select commit Hold shift + click to select a range
324e615
Add POC for extractive-qa pipeline
oryx1729 Aug 5, 2021
09eabbc
Remove kwargs from run
oryx1729 Aug 16, 2021
b431e3d
Remove kwargs from reader run
oryx1729 Aug 16, 2021
73739e4
Add handling of debug information from nodes
oryx1729 Aug 16, 2021
97d6ab1
Fix type hints
oryx1729 Aug 16, 2021
4de5f13
Fix standard pipelines
oryx1729 Aug 16, 2021
0b1e8e1
Handle null params
oryx1729 Aug 16, 2021
8d0af9f
Refactor run() for all components
oryx1729 Aug 16, 2021
9e078eb
Fix type hint
oryx1729 Aug 16, 2021
9406cda
Fix EvalDocuments
oryx1729 Aug 16, 2021
525486e
Fix typing
oryx1729 Aug 17, 2021
4466c54
Fix EvalAnswers
oryx1729 Aug 17, 2021
7108c5f
Fix Summarizer test
oryx1729 Aug 17, 2021
79cbb2e
Fix EvalAnswers
oryx1729 Aug 17, 2021
a4ab9b4
Fix test
oryx1729 Aug 17, 2021
de1cd30
Fix Ray test
oryx1729 Aug 17, 2021
50f90be
Fix QueryClassifier
oryx1729 Aug 17, 2021
76d82ed
Fix TransformersQueryClassifier
oryx1729 Aug 17, 2021
bbb7886
Fix SklearnQueryClassifier
oryx1729 Aug 17, 2021
d6ab5c1
Add support for more types as Pipeline inputs
oryx1729 Aug 18, 2021
e2b750a
Fix eval test
oryx1729 Aug 18, 2021
2d7ddbf
Fix RayPipeline
oryx1729 Aug 18, 2021
94cdd59
Fix QuestionGenerator
oryx1729 Aug 18, 2021
af03490
Cast Reader.run_batch() results to dict
oryx1729 Aug 18, 2021
e8a9eb4
Fix Retriever.run()
oryx1729 Aug 18, 2021
2bb3603
Fix translator
oryx1729 Aug 18, 2021
d2a3763
Fix JoinDocuments
oryx1729 Aug 18, 2021
0a9855c
Allows dicts as run params
oryx1729 Aug 18, 2021
6658042
Fix typing
oryx1729 Aug 18, 2021
5014db5
Udpate Pipeline tests
oryx1729 Aug 18, 2021
b71c791
Adjust Pipeline tests
oryx1729 Aug 18, 2021
b0b045d
Refactor REST APIs
oryx1729 Aug 19, 2021
9d05f97
Subclass dict for primititves
oryx1729 Aug 19, 2021
032b977
Revert dict cast for primitives
oryx1729 Aug 19, 2021
28ae659
Update tests for rest_api
oryx1729 Aug 19, 2021
9498fea
Fix pipeline test
oryx1729 Aug 19, 2021
9fa4252
Fix Eval
oryx1729 Aug 19, 2021
a960bf7
Add tests for invalid input to Pipelines
oryx1729 Aug 19, 2021
d673516
Add docstring for _dispatch_run()
oryx1729 Aug 20, 2021
266ba37
Adapt UI query endpoint
oryx1729 Aug 20, 2021
6eeb4ac
Update tutorials
oryx1729 Aug 20, 2021
fb82bb3
Fix filters dict access in query API
oryx1729 Aug 20, 2021
b383000
Update tutorial
oryx1729 Sep 2, 2021
45c1d55
Add type hints for run() in eval.py
oryx1729 Sep 2, 2021
cfbcc05
Fix docstring
oryx1729 Sep 2, 2021
7bd549c
Add explicit args for run() in BaseComponent
oryx1729 Sep 2, 2021
8cf409a
Update docstrings for standard pipelines
oryx1729 Sep 2, 2021
1c28554
Add missing import
oryx1729 Sep 2, 2021
ef46880
Add test for _debug
oryx1729 Sep 2, 2021
f97acb4
Update example in README
oryx1729 Sep 2, 2021
c8ff595
Update Pipelines README
oryx1729 Sep 9, 2021
d2c9755
Update Pipeline Tutorial
oryx1729 Sep 9, 2021
ca1c214
Remove kwargs from crawler run()
oryx1729 Sep 9, 2021
49f5d8a
Remove kwargs from FileTypeClassifier run()
oryx1729 Sep 9, 2021
32b6aae
Fix QueryClassifier in tutorial
oryx1729 Sep 9, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update example in README
  • Loading branch information
oryx1729 committed Sep 2, 2021
commit f97acb4ebbeeaca4030c9b465e153b9fcd53bcd4
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -510,7 +510,7 @@ A minimal Open-Domain QA Pipeline:
p = Pipeline()
p.add_node(component=retriever, name="ESRetriever1", inputs=["Query"])
p.add_node(component=reader, name="QAReader", inputs=["ESRetriever1"])
res = p.run(query="What did Einstein work on?", top_k_retriever=1)
res = p.run(query="What did Einstein work on?", params={"retriever": {"top_k": 1}})

```
You can **draw the DAG** to inspect better what you are building:
Expand Down