Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add GPU support for Android #77

Merged
merged 4 commits into from
Jul 13, 2024
Merged

Add GPU support for Android #77

merged 4 commits into from
Jul 13, 2024

Conversation

TkTioNG
Copy link
Contributor

@TkTioNG TkTioNG commented Jul 13, 2024

Had tested on Redmi X3, POCO X6 and Samsung Galaxy M.

The improvement on the example app is not really big but had notice significant improvement on larger model by 12~16 times compared to default CPU delegate, in exchange with slightly longer initial model load time. For my personal model, it takes twice the time need to load the model with GPU compared to CPU, but definitely still preferable over due to the much faster inference time

Though it is not tested on iOS yet. I meant for error raised only XD

Closes #47

@mrousavy
Copy link
Owner

Amazing work dude!!! Thank you so much for your contribution here. The code looks good to me !! 💪

@mrousavy
Copy link
Owner

Can you make sure to run yarn check-all? C++ linter is not happy

@mrousavy mrousavy merged commit b8cd552 into mrousavy:main Jul 13, 2024
6 of 7 checks passed
@mrousavy
Copy link
Owner

Released in 1.3.0! Thanks again.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

How to use GPU Acceleration on Android?
2 participants