Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Passing params to spider #80

Open
memwey opened this issue Aug 24, 2018 · 3 comments
Open

Passing params to spider #80

memwey opened this issue Aug 24, 2018 · 3 comments

Comments

@memwey
Copy link

memwey commented Aug 24, 2018

Hi, according to the following links

https://doc.scrapy.org/en/latest/topics/spiders.html#spiderargs
https://scrapyd.readthedocs.io/en/stable/api.html#schedule-json

Params can be sent to Spider class during initialization, I can't see any place for me to input them.
It will be thankful if this feature added.

@Germey
Copy link
Member

Germey commented Sep 4, 2018

Thanks for you suggestion, I've add this feature in the later version.

Please keep this issue open until I add this feature, thanks~

@Cally99
Copy link

Cally99 commented Jul 22, 2020

@Germey how do you override control of command of spider params? This is a must when running a spider. Especially in development mode. For example if I want my output to be in csv or json and I pass the args like scrapy crawl myspider -o output.json -t json within the user interface this isn't available to create a run.py file using os lib. and their's no way to point to a run script. I don't see this documented either. I think this is a very important feature. Would like to know you thoughts.

@mxdev88
Copy link

mxdev88 commented Jan 18, 2021

is this feature on radar for near implementation? I agree with @Cally99. Being able to modify/pass spider args and settings args on scheduling or creating tasks is a must have.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants