feat: also show undownloaded models in Model Tab > Model Selector Dropdown

[imtuyethan]

• I have searched the existing issues

Is your feature request related to a problem? Please describe it

Right now search result only shows what model i have downloaded

Describe the solution

I should be able to search by configured model
Ex:

• I search "Llama"
• Show all related models: model i downloaded first -> model i havent downloaded

Teachability, documentation, adoption, migration strategy

No response

What is the motivation / use case for changing the behavior?

Original design was i dont need to go to Hub
Hub is for when i want to read model info more in details
if i already knew what model i want -> search -> download

[Van-QA]

@urmauur, current UI is: n‌ot‌ downloaded modeld > downloa‌‌‌ded models, can you double che‌ck? I think @imtuyethan w‌ant the downloaded models on top

[Van-QA]

Af‌ter the rollback of Jan x Cortex, only whe‌‌n users is not ‌having any m‌odel‌, th‌e‌y can search via the dropdown. But w‌hen there are models a‌‌vailable, then the re‌com‌‌mendation for download is n‌o longer visible ❌ @urmauur

[0xSage]

@imtuyethan I think this issue needs a bit more planning and is currently not well thought out.

It sounds like you want to:

Goal: improve discoverability from the Model Selector Dropdown , without users having to navigate to Hub.

Questions:

1. Then shouldn't we also allow users to set up remote model API keys in the dropdown?
2. When users click download from within dropdown, what does UI look like?
3. Do we show all quantizations? It will be a long list...
4. What if users want to see more information? How will they get to hub from model selector

[imtuyethan]

@imtuyethan I think this issue needs a bit more planning and is currently not well thought out.

It sounds like you want to:

Goal: improve discoverability from the Model Selector Dropdown , without users having to navigate to Hub.

Questions:

1. Then shouldn't we also allow users to set up remote model API keys in the dropdown?
2. When users click download from within dropdown, what does UI look like?
3. Do we show all quantizations? It will be a long list...
4. What if users want to see more information? How will they get to hub from model selector

Ah this one is done on v0.5.3-628.

I think this one is a killing feature because of how convenient it is:

Scenario 1:

• I have a list of available model
• I have a specific model in mind that i don't have yet
• I search for it -> download it directly without having to go to Hub
  Hub is for model discovery, not for when i already have a specific model in mind.

Scenario 2:

• I want to use Mistral Instruct because i though i had it
• I search for it then realize I haven't downloaded it yet -> Download it directly
  Normally when i search for it and don't see it, i have to go to Hub & search & download & then come back to threads, so many steps...

Screen.Recording.2024-09-11.at.8.20.21.PM.mov