Update README.md

SchwabischesBauernbrot · Oct 15, 2023 · a954885 · a954885
1 parent 0f81940
commit a954885
Showing 1 changed file with 2 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -249,6 +249,8 @@ xr = x * time_mix_r + xx * (1 - time_mix_r)
 xg = x * time_mix_g + xx * (1 - time_mix_g)
 ```
 
+### RWKV-7
+
 Use parallelized mode to quickly generate the state, then use a finetuned full RNN (the layers of token n can use outputs of all layer of token n-1) for sequential generation.
 
 ### Some old ideas