Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DSPy for code generation #1124

Closed
SaiKrishnaBala opened this issue Jun 8, 2024 · 3 comments
Closed

DSPy for code generation #1124

SaiKrishnaBala opened this issue Jun 8, 2024 · 3 comments

Comments

@SaiKrishnaBala
Copy link

I was exploring different use cases which can be addressed using DSPy programming. I could see use cases from question-answering, classification, sentiment analysis, document summarisation,. But I could not see any examples or use cases which are close to code generation tasks. I wanted to generate code(testing the system) using a given paragraph. Is it possible to address it using DSPy programming?
I'm also searching for approaches where i can feed the context from the complete repository(or dependent repos) to LLM during the retrieve stage.

@tom-doerr
Copy link
Contributor

For indexing your code base you might want to look into ragatouille https://github.com/bclavie/ragatouille .
It is based on the ColBERT and seems to have a focus on ease of use.
I don't see why you shouldn't be able to use DSPy for generating and executing code. You could even use DSPy Assert/Suggest to give feedback to the LM in case there are issues/errors.
DSPy als has a Module that generates and executes code for reasoning, maybe you can find some inspiration there: https://dspy-docs.vercel.app/docs/deep-dive/modules/program-of-thought

@arnavsinghvi11
Copy link
Collaborator

@SaiKrishnaBala relevant example for using PoT for code generation

@Deanozk
Copy link

Deanozk commented Jul 1, 2024

Well I would just say that you obviously need to use a powerful LLM with strong code generation capabilities as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants