Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

(Question) How can I fully utilize the number of cores in my CPU? #1576

Open
WCSY-YG opened this issue Mar 14, 2024 · 0 comments
Open

(Question) How can I fully utilize the number of cores in my CPU? #1576

WCSY-YG opened this issue Mar 14, 2024 · 0 comments

Comments

@WCSY-YG
Copy link

WCSY-YG commented Mar 14, 2024

My current hardware configuration consists of an 8-core CPU with 32 GB of RAM. When I run the lm-eval command-line script for inference on the CPU, I observe that only a single core is being utilized (as indicated by %CPU reaching 100% in the top utility). However, when using the simple_evaluate() API within Python, I find that all CPU cores are fully utilized (with my %CPU showing up to 800%). Therefore, I would like to inquire about how I can best leverage all of my CPU cores while running the lm-eval command through the command line. Thank you very much!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant