You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
During development and testing of scrapers I often find myself deleting tasks for reasons such as them being faulty due to my code or some other issues. At the same time Crawlab keeps statistics of how much data was scraped despite me deleting the tasks in question.
In general I think it would be nice for scraped data stats and other task related statistics to be deleted once the task itself is deleted. That way I could easily monitor the real or the actually valuable to me state of my operations rather than statistic accumulating everything I've ever done no matter what which quickly makes it so the stat in question becomes useless.
The text was updated successfully, but these errors were encountered:
During development and testing of scrapers I often find myself deleting tasks for reasons such as them being faulty due to my code or some other issues. At the same time Crawlab keeps statistics of how much data was scraped despite me deleting the tasks in question.
In general I think it would be nice for scraped data stats and other task related statistics to be deleted once the task itself is deleted. That way I could easily monitor the real or the actually valuable to me state of my operations rather than statistic accumulating everything I've ever done no matter what which quickly makes it so the stat in question becomes useless.
The text was updated successfully, but these errors were encountered: