Skip to content

Pull requests: HubGrep/hubgrep_crawlers

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Assignee
Filter by who’s assigned
Sort

Pull requests list

add note about alphaversion
#23 by puhoy was merged Aug 21, 2021 Loading… updated Aug 21, 2021
add logos to readme
#21 by puhoy was merged Aug 13, 2021 Loading… updated Aug 13, 2021
add license
#20 by puhoy was merged Aug 12, 2021 Loading… updated Aug 12, 2021
fix: add b64 encoding for api key
#19 by puhoy was merged Aug 9, 2021 Loading… updated Aug 9, 2021
update block key
#16 by geoheelias was merged Aug 6, 2021 Loading… updated Aug 6, 2021
add a default timeout to all requests
#18 by puhoy was merged Aug 5, 2021 Loading… updated Aug 5, 2021
crawler uuid
#15 by geoheelias was merged Jul 21, 2021 Loading… updated Jul 21, 2021
general refactoring and to fit to new block dict from indexer
#14 by geoheelias was merged Jul 18, 2021 Loading… updated Jul 18, 2021
Fix/handle ratelimit many crawlers
#13 by geoheelias was merged Jul 13, 2021 Loading… updated Jul 13, 2021
Fix/GitHub retry on abuse
#12 by geoheelias was merged Jul 13, 2021 Loading… updated Jul 13, 2021
exclude GH topics from crawling query
#9 by geoheelias was merged Jul 13, 2021 Loading… updated Jul 13, 2021
reduce spam on abuse trigger for GH
#11 by geoheelias was merged Jul 13, 2021 Loading… updated Jul 13, 2021
add api_key auth against hubgrep_indexer
#8 by geoheelias was merged Jul 11, 2021 Loading… updated Jul 11, 2021
fix repeated github id crawling
#7 by geoheelias was merged Jul 4, 2021 Loading… updated Jul 4, 2021
update github crawler to handle parallel crawlers ratelimiting
#6 by geoheelias was merged Jul 2, 2021 Loading… updated Jul 2, 2021
avoid emitting results on response.ok == False
#5 by geoheelias was merged Jul 1, 2021 Loading… updated Jul 1, 2021
split up crawl command, add sleep check
#4 by puhoy was merged Jul 1, 2021 Loading… updated Jul 1, 2021
Feature/refactor gitlab
#3 by geoheelias was merged Jun 26, 2021 Loading… updated Jun 26, 2021
Feature/refactor all
#2 by geoheelias was merged Jun 25, 2021 Loading… updated Jun 25, 2021
network preparations
#1 by puhoy was merged Jun 19, 2021 Loading… updated Jun 19, 2021
ProTip! What’s not been updated in a month: updated:<2024-06-12.