Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Question on Evaluation #94

Open
Ting-Justin-Jiang opened this issue Jul 13, 2024 · 0 comments
Open

Question on Evaluation #94

Ting-Justin-Jiang opened this issue Jul 13, 2024 · 0 comments

Comments

@Ting-Justin-Jiang
Copy link

Thank you so much for the amazing work.
When calculating FID with an off-the-shelf XL/2 512 model, I generated 10K images (cfg=1.5) and obtained the following results:

Inception Score: 243.23751831054688
FID: 6.0483700680604215
sFID: 18.34898058428621
Precision: 0.8374
Recall: 0.621

which doesn't align with any benchmark result provided.
Is it because I sampled too few images?
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Ting-Justin-Jiang