Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pangeo test example #32

Open
Boes-man opened this issue May 22, 2019 · 1 comment
Open

pangeo test example #32

Boes-man opened this issue May 22, 2019 · 1 comment
Labels
question Further information is requested

Comments

@Boes-man
Copy link

Boes-man commented May 22, 2019

Hello, I have upgraded from 0.1.1-86665a6 to 19.03.05 in doing so I notice the example notebooks are gone. Specifically the dask-array.ipynb was very useful, since it allows for a easy, lightweight test of pangeo. Since the upgrade running this notebook errors as per below. Are you able to point me in the direction of how to fix it? Thanks

from dask_kubernetes import KubeCluster
cluster = KubeCluster(n_workers=10)
cluster

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-1-00757e3889c1> in <module>
      1 from dask_kubernetes import KubeCluster
----> 2 cluster = KubeCluster(n_workers=10)
      3 cluster

/srv/conda/lib/python3.6/site-packages/dask_kubernetes/core.py in __init__(self, pod_template, name, namespace, n_workers, host, port, env, **kwargs)
    178             msg = ("Worker pod specification not provided. See KubeCluster "
    179                    "docstring for ways to specify workers")
--> 180             raise ValueError(msg)
    181 
    182         self.cluster = LocalCluster(ip=host or socket.gethostname(),

ValueError: Worker pod specification not provided. See KubeCluster docstring for ways to specify workers
@jhamman
Copy link
Member

jhamman commented May 22, 2019

We've decoupled the example notebooks (https://github.com/pangeo-data/pangeo-example-notebooks) from the helm chart and the pangeo-stacks images. This is really to help with long term maintenance and extensibility.

Your error seems to be saying you don't have a dask-kubernetes specification set. Can you report what print(dask.config.config['kubernetes']) reports? If you don't have a pod spec, perhaps you are missing a dask config in your setup (https://kubernetes.dask.org/en/latest/#quickstart)?

@jhamman jhamman added the question Further information is requested label May 22, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants