Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

爬虫删除，未级联删除相关数据，数据库冗余 #1416

Closed
glacierck opened this issue Oct 26, 2023 · 0 comments
Closed

爬虫删除，未级联删除相关数据，数据库冗余 #1416

glacierck opened this issue Oct 26, 2023 · 0 comments
Labels
bug Something isn't working performance Performance related

Comments

@glacierck
Copy link

Bug 描述
删除爬虫后，查看后台数据库发现爬虫的相关统计数据记录，任务记录表等信息都还在表里。冗余非常严重

复现步骤
该 Bug 复现步骤如下

  1. 创建爬虫，执行若干任务
  2. 删除爬虫
  3. 查看后台数据库

期望结果
按级，完成级联数据清理，如解耦的数据则除外，但前端也应该曝露curd界面才对。

截屏
image

老实说其实都没多少业务表。。。为啥10k的项目后台搞成这样了的。。。短板太过严重啊，，，，
@glacierck glacierck added the bug Something isn't working label Oct 26, 2023
@tikazyq tikazyq added the performance Performance related label Oct 31, 2023
tikazyq added a commit to crawlab-team/crawlab-core that referenced this issue Dec 3, 2023
@tikazyq
fix: uncleaned spider/task stats objects crawlab-team/crawlab#1416
62c135b
@tikazyq tikazyq closed this as completed Dec 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working performance Performance related
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@tikazyq @glacierck