Utilize Poetry package cache

[skovhus]

Similar to how we use a shared yarn cache, we could utilize the Poetry or pip cache.

Instead of relying on image name, we would maybe do something even simpler. The only concern would be binary dependencies, which we do not want to share across machine architecture.