Run document update again (#1216)

* misc changes to neox_args

* Update NeoXArgs docs automatically

---------

Co-authored-by: github-actions <[email protected]>

configs/neox_arguments.md

@@ -111,7 +111,7 @@ Logging Arguments
 
 - **git_hash**: str
 
- Default = 6fb840e
+ Default = 8d175ed
 
  current git hash of repository
 
@@ -1201,7 +1201,7 @@ Text Generation arguments
 
 
 
-- **num_experts**: int
+- **moe_num_experts**: int
 
  Default = 1
 
@@ -1243,7 +1243,7 @@ Text Generation arguments
 
 - **moe_token_dropping**: bool
 
- Default = True
+ Default = False
 
  Whether to drop tokens when exceeding capacity
 
@@ -1273,6 +1273,47 @@ Text Generation arguments
 
 
 
+- **moe_type**: str
+
+ Default = megablocks
+
+ Either `deepspeed` or `megablocks`
+
+
+
+- **moe_glu**: bool
+
+ Default = False
+
+ Use gated linear units in MoE
+
+
+
+- **moe_lbl_in_fp32**: bool
+
+ Default = False
+
+ Whether to compute the load balancing loss in fp32.
+
+
+
+- **moe_jitter_eps**: float
+
+ Default = None
+
+ Coefficient for MoE routing jitter. Jitter is
+ not used if set to None
+
+
+
+- **enable_expert_tensor_parallelism**: bool
+
+ Default = False
+
+ Enable expert tensor parallelism
+
+
+
 ## NeoXArgsTokenizer
 
 Tokenizer Arguments