Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support to partition graph with topological order #27

Open
yiakwy-xpu-ml-framework-team opened this issue Nov 26, 2021 · 0 comments

Comments

@yiakwy-xpu-ml-framework-team

Background

Hello METIS team, I write a simple bert model and test partition with METIS , it seems that the partition does not include topological order in consideration. I am going to add such support for native partition algorithms inside mutli-level framework. I suppose we are using KL algorithm inside ML framework:

METIS partition

The problem

The partition does not include topological order, hence part a graph [a, b, c, d] into 2 devices alternating, which is unacceptable, because across device communication with off chip memory is expensive. Hence in our native algorithm , we apply partition upon topological sorted array with divide and conquer solver bottom up.

Does METIS support this? If I want add such support in METIS, how should I start off?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant