We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent cf8dd5b commit 1547d22Copy full SHA for 1547d22
LLM/Quantization/readme.md
@@ -321,5 +321,5 @@ Number of tokens: 176
321
322
Throughput: 9.00 Tokens/sec
323
324
-Latency: 162.83 ms/token
+Latency: 111.11 ms/token
325
0 commit comments