Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement an information schema table to inspect flow node's internal state. #4023

Open
1 task
waynexia opened this issue May 23, 2024 · 6 comments
Open
1 task
Labels
C-feature Category Features

Comments

@waynexia
Copy link
Member

What problem does the new feature solve?

Provide an information schema table like cluster_info to inspect flow node's internal state. Things like assigned tasks, handled rows etc can be reported in this way.

What does the feature do?

  • Implement a system table for flow node

Implementation challenges

No response

@waynexia waynexia added the C-feature Category Features label May 23, 2024
@sunng87
Copy link
Member

sunng87 commented May 24, 2024

We will also need to build a dashboard module to display this type of information.

@waynexia
Copy link
Member Author

This reminds me that the allocation (task to flownode) info is also requested in meet-up

@sunng87
Copy link
Member

sunng87 commented May 31, 2024

yes, we also need to track lifecycle and status of tasks.

@Kelvinyu1117
Copy link
Contributor

Kelvinyu1117 commented Jun 5, 2024

Can I work on it?
I have briefly looked at the code, should I start with FlownodeManager? It seems that I can get most of the information of the task from it.

@waynexia
Copy link
Member Author

Sorry for the delay...

FlownodeManager should contain the info we need. The requested system table needs to read that info from FlownodeManager and then construct a temporary table from those data like other tables in information_schema.

Are you still interested in this task?

@Kelvinyu1117
Copy link
Contributor

Yes, let me take it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-feature Category Features
Projects
None yet
Development

No branches or pull requests

3 participants