[INS-2201] [Feature] CSV Operator

[praharshjain]

Is There an Existing Issue for This?

• I have searched the existing issues

Project

Instill VDP

Is your Proposal Related to a Problem?

No, it is a new feature request.

Describe Your Proposed Solution

We can have an operator to extract/query data from a CSV file, and write structured data (maybe JSON data) to it.

Highlight the Benefits

VDP will have support for working with CSV format.

Anything Else?

Ref - https://pkg.go.dev/encoding/csv

_INS-2201

[github-actions]

This issue is available for anyone to work on.

• Read our Contributing Guidelines
• Make sure to reference this issue in your pull request

✨ Thank you for your contribution! ✨

[miguel-ortiz-marin]

I think I can tackle this one too! (If someone wants this one before I merge the previous PR please give it to them)

QQ: How can we make sure that the PRs to the operator repo will interface correctly with the UI? Are we assuming that the csv file is uploaded to the backend and then we pass the csv path to this operator ?

Thank you!

[harshsoni7]

Hi @miguel-ortiz-marin! Absolutely, we’re thrilled about your interest in our project! 🚀 Here’s the Contributing Guideline for Instill VDP to get you started on your journey! Please refer to the Contributing Guidelines for components as well. Don’t forget to link your pull request to the corresponding issue, and after your PR gets merged, please complete this form to claim your well-deserved points! If you ever have any questions or need a hand along the way, don’t hesitate to drop a message in this thread or hop into our Discord. Happy contributing! 😊🌟

[harshsoni7]

@donch1989 please help answer @miguel-ortiz-marin's question above.

[miguel-ortiz-marin]

Hi @donch1989 does it make sense to proceed with an implementation like what I mentioned?

Are we assuming that the csv file is uploaded to the backend and then we pass the csv path to this operator ?

If so I can try to submit a PR today or tomorrow

[donch1989]

Hi @miguel-ortiz-marin,

The current requirement of the CSV operator is not clear yet. We are planning the new roadmap for these operators, and will update the feature description next week.

cc @harshsoni7