Discussions

• 1 You must be logged in to vote

  #️⃣

  Fused AdamW

  AakashKumarNain asked Jul 30, 2024 in General · Unanswered

  

  

  5
• 1 You must be logged in to vote

  🙏

  Logging gradients norms before clipping

  AakashKumarNain asked Jul 25, 2024 in Q&A · Closed · Answered

  

  

  2
• 2 You must be logged in to vote

  🙏

  Reload opt_state and modify learning rate

  borisdayma asked Dec 9, 2021 in Q&A · Closed · Answered

  

  

  

  

  8
• 2 You must be logged in to vote

  🙌

  access the learning rate of an (arbitrary) optax optimizer

  FAQ

  fabianp asked May 10, 2024 in Show and tell · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙌

  Random Subspace Training using a custom GradientTransformation

  SauravMaheshkar asked Nov 24, 2023 in Show and tell · Closed · Answered

  

  

  5
• 1 You must be logged in to vote

  #️⃣

  Optax vs Cvxpy

  pushkar5586 asked Mar 24, 2024 in General · Answered

  

  

  2
• 1 You must be logged in to vote

  #️⃣

  Optax 0.2.0 on PyPI

  adam-hartshorne asked Mar 6, 2024 in General · Closed · Unanswered

  

  

  1
• 1 You must be logged in to vote

  #️⃣

  Different learning rates for different parts of an array

  ajithmoola asked Feb 24, 2024 in General · Answered

  

  

  

  

  2
• 1 You must be logged in to vote

  🙏

  Constrained optimization with a given l1 norm

  pvasired asked Feb 2, 2024 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Later iterations of training loop running much faster?

  pvasired asked Jun 3, 2023 in Q&A · Answered

  

  

  1
• 2 You must be logged in to vote

  🙏

  How to use a adamw optimizer with gradient clipping?

  aniquetahir asked Oct 25, 2022 in Q&A · Closed · Answered

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  Mechanize cannot work with Dropout?

  neel04 asked Jan 24, 2024 in Q&A · Unanswered

  

  

  3
• 2 You must be logged in to vote

  💡

  General and Adaptive Robust Loss Function

  chrisflesher asked Sep 5, 2023 in Ideas · Closed · Answered

  

  

  

  

  5
• 1 You must be logged in to vote

  🙏

  mechanize + ema usage

  aaarrti asked Sep 14, 2023 in Q&A · Closed · Answered

  

  

  

  

  2
• 1 You must be logged in to vote

  🙏

  Help: How to prevent params of a hybrid module from becoming dynamic or traced array by optax?

  BraveDrXuTF asked Jan 15, 2024 in Q&A · Closed · Answered

  

  

  3
• 2 You must be logged in to vote

  🙏

  How should optax be cited?

  jobrachem asked Nov 25, 2023 in Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Saving an optimizer?

  HHalva asked Aug 31, 2021 in Q&A · Closed · Answered

  

  

  

  

  11
• 2 You must be logged in to vote

  #️⃣

  How does optax.MultiSteps handle the last few steps?

  ayaka14732 asked Jul 25, 2023 in General · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Reptile implementation on sine

  MichaelMMeskhi asked Jun 15, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Implementation of custom Optax optimizers

  MarioAuditore asked Apr 19, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Weight decay norm

  cemde asked Apr 13, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙌

  Combining Optax with probabilistic ODE solvers

  pnkraemer asked Feb 27, 2023 in Show and tell · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Question about constrained problem solving.

  DoTulip asked Feb 10, 2023 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  How to access objective function value?

  pvasired asked Jan 26, 2023 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Bi-level optimization and Adam causing NaNs

  averageFlaxUser asked Feb 3, 2023 in Q&A · Unanswered

  

  

  0