Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

gpt-2 : use ggml-alloc #486

Merged
merged 3 commits into from
Aug 28, 2023
Merged

gpt-2 : use ggml-alloc #486

merged 3 commits into from
Aug 28, 2023

Conversation

slaren
Copy link
Collaborator

@slaren slaren commented Aug 27, 2023

Modifies the gpt-2 example to use ggml-alloc to allocate the compute buffer.

Additionally, moves GGML_MEM_ALIGN to ggml.h to use as the tensor alignment value with ggml-alloc.

Fixes #480

ggerganov
ggerganov approved these changes Aug 28, 2023
View reviewed changes
Copy link
Owner

@ggerganov ggerganov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice

@ggerganov ggerganov merged commit 3e551c0 into master Aug 28, 2023
2 checks passed
@ggerganov ggerganov deleted the ggml-alloc-gpt2 branch August 28, 2023 08:31
@rmc135 rmc135 mentioned this pull request Oct 5, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ggerganov ggerganov ggerganov approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
2 participants
@slaren @ggerganov