Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Why the order of input variables has impact on the performance of Multikan? #410

Open
chen-erqi opened this issue Aug 18, 2024 · 3 comments

Comments

@chen-erqi
Copy link

In my case, the mape results among different orders of input variables are huge different.
Such as:

col_array = np.array([0, 5, 1, 4, 2, 3]) # 8.69%

col_array = np.array([0, 1, 2, 3, 4, 5]) # 19.67%

col_array = np.array([5, 0, 1, 2, 3, 4]) # 14.50%

Could anyone please to discuss this interesting phenomenon?
Thanks a lot!!

@chen-erqi
Copy link
Author

I can not see this phenomenon in the KAN without multi operation.

@chen-erqi
Copy link
Author

chen-erqi commented Aug 18, 2024

The width of multiKan is [6, [0, 1]].
When I add a KANLayer before input layer, this phenomenon has weaken but not disappeared.
Such as:
col_array = np.array([0, 5, 1, 4, 2, 3]) # 3.34%
col_array = np.array([0, 1, 2, 3, 4, 5]) # 3.13%
col_array = np.array([5, 0, 1, 2, 3, 4]) # 3.18%

@KindXiaoming
Copy link
Owner

KindXiaoming commented Aug 22, 2024

maybe I didn't get the point, but I think change the order of input variables = change initialization, which makes results different.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants