You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello METIS team, I write a simple bert model and test partition with METIS , it seems that the partition does not include topological order in consideration. I am going to add such support for native partition algorithms inside mutli-level framework. I suppose we are using KL algorithm inside ML framework:
The problem
The partition does not include topological order, hence part a graph [a, b, c, d] into 2 devices alternating, which is unacceptable, because across device communication with off chip memory is expensive. Hence in our native algorithm , we apply partition upon topological sorted array with divide and conquer solver bottom up.
Does METIS support this? If I want add such support in METIS, how should I start off?
The text was updated successfully, but these errors were encountered:
Background
Hello METIS team, I write a simple bert model and test partition with METIS , it seems that the partition does not include topological order in consideration. I am going to add such support for native partition algorithms inside mutli-level framework. I suppose we are using KL algorithm inside ML framework:
The problem
The partition does not include topological order, hence part a graph [a, b, c, d] into 2 devices alternating, which is unacceptable, because across device communication with off chip memory is expensive. Hence in our native algorithm , we apply partition upon topological sorted array with divide and conquer solver bottom up.
Does METIS support this? If I want add such support in METIS, how should I start off?
The text was updated successfully, but these errors were encountered: