-
Notifications
You must be signed in to change notification settings - Fork 226
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Draw Phase Diagram for CNTK #164
Comments
@SiuMath and @sschoenholz may answer better, but I can give some brief comments:
One other comment, this notebook relies on being able to determine a fixed-point variance Finally, note that these diagrams study the forward propagation of the signal, so they are only working with the CNN-GP kernel (and not the CNTK), so the Hope this helps! |
I'm curious about the initialization for CNTK, so I replace the
kernel_fn
inc_map(W_var, b_var)
function in colab with:However, it seems that there's a bottom layer error when I tried to plot, with the error msg as follow:
Is there any misunderstanding of me to the Phase Diagram? (Is CNTK fundamentally un-drawn-able?
Also, I've also found that there's totally no difference in Phase Diagram when I simply deeper an FC network, e.g.
Does it mean that the depth of NNs won't affect the initialization?
The text was updated successfully, but these errors were encountered: