Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add agentic applications #488

Open
tituslhy opened this issue Jun 7, 2024 · 0 comments
Open

Add agentic applications #488

tituslhy opened this issue Jun 7, 2024 · 0 comments

Comments

@tituslhy
Copy link

tituslhy commented Jun 7, 2024

Is your feature request related to a problem? Please describe.
The Vanna AI library is great. I just can't help noticing that the tool is best suited for easier questions (what are my top 10 customers, etc.) instead of harder questions. This can be:

  1. Nested questions: Who are my top 10 customers, is there anything common between them and what products do they buy?
  2. Broad questions: Describe my sales trend from 2020-2023. The SQL statement here is very simple but the challenge is in having the LLM analyze the data describe the analysis qualitatively.
  3. Challenging questions that require other tools: Compute the CAGR of my sales from 2020-2024.

These question types are best addressed by LLM agents because agents can write and execute multiple SQL queries upon reflection. Examples of agentic libraries include llamaindex, langchain, crewAI and autogen, but in my opinion VannaAI's fundamental SQL analysis abilities is ahead of these libraries.

Describe the solution you'd like
I'm hoping for VannaAI to implement:

  1. The use of LLM agents within the library (for example ReAct), so that the agents can reflect to generate better answers, and generate multiple plots and sql tables (if needed) as well as a qualitative answer to address the user's question.
  2. An integration with the agentic libraries if possible (especially langchain and llamaindex) so that users can also exploit the agentic capabilities in these libraries to extend chat assistant functionalities even further. There is currently one integration written by llamaindex but this integration can definitely be improved.

Describe alternatives you've considered
Using the llamaindex integration (https://llamahub.ai/l/llama-packs/llama-index-packs-vanna?from=all), I wrapped it a LlamaIndex ReAct agent around it and attempted to use it. Worked in a notebook but there are still a few kinks to fix though.

Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant