Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how to train own data for multivarite time series forcasting task? #1

Open
luoolu opened this issue May 1, 2024 · 5 comments
Open

Comments

@luoolu
Copy link

luoolu commented May 1, 2024

MLPs already used in time-series forecasting

@KindXiaoming
Copy link
Owner

KindXiaoming commented May 1, 2024

Interesting application! Both MLPs and KANs are models which cannot do time series immediately. Like one needs to turn MLPs to RNNs/LSTMs/transformers first, we also need to turn KANs into counterparts, which are not supported yet, but hopefully not too hard to implement with KANs as building blocks!

@luoolu
Copy link
Author

luoolu commented May 2, 2024

Yes, I understand. I look forward to the application of KAN in this time multivariate sequence prediction task. Thank you very much

@Somdudewillson
Copy link

Technically, there is the basic method of simply providing a fixed window to the network, which is one I've been experimenting with as part of trying to get a feel for KANs. (Kaggle notebook here if you're curious.)

@yuedajiong
Copy link

Years ago, I designed a TNN (Temporal Neural Network) based on the concept of Fourier-series. It was intended for time series prediction and anomaly detection, considering that the composition of a time series includes: trend, various periods, and noise. The trend component was calculated using moving averages at different scales, while fitting for multiple periods could be achieved through TNN. The core of TNN involved introducing sin and cos functions as activation functions, with the option to include coefficients to represent amplitude and frequency variations.

@2017wxyzwxyz
Copy link

@Somdudewillson,May I ask, based on your previous experience, has KAN significantly improved the prediction accuracy of time series data compared to other models such as LSTM?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants