Skip to content
This repository has been archived by the owner on Feb 1, 2023. It is now read-only.

Speed-ups (shasum + poetry install caching) #91

Merged
merged 8 commits into from
Mar 3, 2021
Merged

Speed-ups (shasum + poetry install caching) #91

merged 8 commits into from
Mar 3, 2021

Conversation

skovhus
Copy link
Contributor

@skovhus skovhus commented Mar 3, 2021

A few speed up improvements:

  • use the fastest available shasum command, which produces the same output. This yields a 30% speedup (context: Changes to shasum package #50)
  • poetry install caching similar to yarn install caching. Install time is reduced by 50% for a library

We now also logs a message if hashing the input dependencies takes too long. Ideally, it should take < 1 second, but I identified some cases where we wasted ~20 seconds hashing as the input dependencies were too relaxed (e.g. hashing the entire contrib folder!)

Closes #86

@skovhus skovhus changed the title Speed ups (shasum + poetry install caching) Speed-ups (shasum + poetry install caching) Mar 3, 2021
Copy link
Member

@madsnedergaard madsnedergaard left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👏

@skovhus skovhus merged commit 6220835 into master Mar 3, 2021
@skovhus skovhus deleted the ks/speedups branch March 3, 2021 11:02
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Utilize Poetry package cache
2 participants