Skip to content

Commit

Permalink
Update align.md
Browse files Browse the repository at this point in the history
  • Loading branch information
Harahan committed Jun 7, 2024
1 parent 51cf17a commit 8d3c499
Showing 1 changed file with 17 additions and 17 deletions.
34 changes: 17 additions & 17 deletions benchmark/align.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,27 +15,27 @@

#### Weight-Only Asymmetric Quantization Results

| | w4a16g128 | w3a16g128 | w2a16g64 |
|--------------|--------|--------|--------|
| GPTQ | 5.623 | 6.318 | 14.968 |
| GPTQ-LLMC | 5.623 | 6.318 | 14.968 |
| AWQ | | | |
| AWQ-LLMC | | | |
| Omniquant | 5.590 | 6.092 | 9.525 |
| Omniquant-LLMC | 5.590 | 6.092 | 9.525 |
| | w4a16g128 | w3a16g128 | w2a16g64 |
|---------------|-----------|-----------|-----------|
| GPTQ | 5.623 | 6.318 | 14.968 |
| GPTQ-LLMC | 5.623 | 6.318 | 14.968 |
| AWQ | 5.601 | 6.243 | 2.16e5 |
| AWQ-LLMC | 5.601 | 6.238 | 2.16e5 |
| Omniquant | 5.590 | 6.092 | 9.525 |
| Omniquant-LLMC | 5.590 | 6.092 | 9.525 |

#### Weight-Activation Asymmetric Quantization Results

| | w8a8 | w6a6 | w4a4 |
|---------------|--------|--------|--------|
| Omniquant | 5.491 | 5.703 | 12.212 |
| | w8a8 | w6a6 | w4a4 |
|----------------|--------|--------|--------|
| Omniquant | 5.491 | 5.703 | 12.212 |
| Omniquant-LLMC | 5.490 | 5.703 | 12.239 |

#### Weight-Activation Symmetric Quantization Results

| | w8a8 |
|---------------|-------|
| SmoothQuant | |
| SmoothQuant-LLMC | |
| Os_plus | |
| Os_plus-LLMC | |
| | w8a8 |
|------------------|-------|
| SmoothQuant | 5.589 |
| SmoothQuant-LLMC | 5.589 |
| Os_plus | 5.511 |
| Os_plus-LLMC | 5.517 |

0 comments on commit 8d3c499

Please sign in to comment.