Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how to view traceback? #107

Open
mohamadiank opened this issue Apr 8, 2018 · 0 comments
Open

how to view traceback? #107

mohamadiank opened this issue Apr 8, 2018 · 0 comments

Comments

@mohamadiank
Copy link

mohamadiank commented Apr 8, 2018

I create new spider class in my app
when i want to test in return Unhandled error in Deferred without any traceback
how can i see trace back?

spider class:

class DetailSpider(DjangoSpider):
    name = 'detail_spider'
    def __init__(self, *args, **kwargs):
        self._set_ref_object(Movie, **kwargs)
        self.scraper = self.ref_object.scraper
        self.scrape_url = self.ref_object.url
        self.scheduler_runtime = self.ref_object.scraper_runtime
        self.scraped_obj_class = Details
        self.scraped_obj_item_class = DetailItem
        super(DetailSpider, self).__init__(self, *args, **kwargs)

I execute this commad:
scrapy crawl detail_spider -a id=id

and return this

2018-04-08 18:33:23 [scrapy.utils.log] INFO: Versions: lxml 4.2.1.0, libxml2 2.9.8, cssselect 1.0.3, parsel 1.4.0, w3lib 1.19.0, Twisted 17.9.0, Python 3.6.3 (default, Oct  3 2017, 21:45:48) - [GCC 7.2.0], pyOpenSSL 17.5.0 (OpenSSL 1.1.0h  27 Mar 2018), cryptography 2.2.2, Platform Linux-4.13.0-32-generic-x86_64-with-Ubuntu-17.10-artful
2018-04-08 18:33:23 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'open_news', 'SPIDER_MODULES': ['dynamic_scraper.spiders', 'web.scraper'], 'USER_AGENT': 'open_news/1.0'}
2018-04-08 18:33:23 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.logstats.LogStats']
Unhandled error in Deferred:
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant