Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Decrease inference steps lead to crush of output #6

Closed
Wangchentong opened this issue Jul 7, 2024 · 2 comments
Closed

Decrease inference steps lead to crush of output #6

Wangchentong opened this issue Jul 7, 2024 · 2 comments

Comments

@Wangchentong
Copy link

Hi Yeqing, congratulations on your great work!

I am testing the ability of Genie2 to generate scaffolds with fewer steps. When I reset Genie2's diffusion steps to 100, the output scaffold seems to fail to be a reasonable protein. Have you tested a similar setting? In other words, I am interested in the necessity of 1000 steps during inference, but based on my trials, it seems required. Is such many steps a feature brought by 2d motif input or something else?

image
image

@yeqinglin
Copy link
Collaborator

Thank you very much and sorry for the late reply. We tested with some different sampling strategies before with reduced number of inference steps and got back similar results. At this current point, it seems to us that 1000 diffusion steps are necessary during inference. We don’t think this is a result of 2D motif input since this behavior is also observed in unconditional generation, and we suspect this could be related to the use of lower sampling temperature. One of our future direction is to improve the sampling efficiency of Genie 2 and we would investigating further with the possibility of reduced inference steps.

@Wangchentong
Copy link
Author

Thank you for your comment!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants