Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Switch to model2.json and latest gpt4all #16

Closed
simonw opened this issue Oct 24, 2023 · 2 comments
Closed

Switch to model2.json and latest gpt4all #16

simonw opened this issue Oct 24, 2023 · 2 comments
Labels
enhancement New feature or request

Comments

@simonw
Copy link
Owner

simonw commented Oct 24, 2023

The latest gpt4all no longer works with models from the old models.json file. It needs models from models2.json instead.

Details here:

@simonw simonw added the enhancement New feature or request label Oct 24, 2023
@simonw
Copy link
Owner Author

simonw commented Oct 24, 2023

This seems to work:

diff --git a/llm_gpt4all.py b/llm_gpt4all.py
index a4568d4..0b0e8e0 100644
--- a/llm_gpt4all.py
+++ b/llm_gpt4all.py
@@ -24,8 +24,8 @@ class GPT4All(_GPT4All):
 
 def get_gpt4all_models():
     return fetch_cached_json(
-        url="https://gpt4all.io/models/models.json",
-        path=llm.user_dir() / "gpt4all_models.json",
+        url="https://gpt4all.io/models/models2.json",
+        path=llm.user_dir() / "gpt4all_models2.json",
         cache_timeout=3600,
     )

Should bump the minimum version of gpt4all too.

simonw added a commit that referenced this issue Oct 24, 2023
simonw added a commit that referenced this issue Oct 24, 2023
simonw added a commit that referenced this issue Oct 24, 2023
simonw added a commit to simonw/llm that referenced this issue Oct 24, 2023
@simonw simonw closed this as completed Oct 24, 2023
@simonw
Copy link
Owner Author

simonw commented Oct 24, 2023

Added upgrade instructions to the 0.2 release notes:

The new version of gpt4all uses models in the gguf format. You may have existing ggml models - these will no longer be used by the plugin, so it's safe to delete those files from your ~/.cache/gpt4all directory.

simonw added a commit to simonw/llm that referenced this issue Nov 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant