INT8 with an INT32 accumulator

Quantized inference. Never rate-limited by the fuse, so the row reads 1.00× and that is the correct result.

s8/s32 · TF/s · never rate-limited

1rows

0changed

1.00×peak gain

How this mode was measured

Every card measured on this mode

Mode	Stock	Unlocked	Gain	Card
`s8/s32`	661.60 TOP/s	659.50 TOP/s	1.00×	GeForce RTX 4090 · 128 SMs

Same card, same driver, same binary. The unlocked figure is the only variable.

Which cards this covers

Only cards with a same-card measurement on this mode appear in the table. A card missing from it has not been measured on this path, which is not the same as failing.

Other measured modes

FP16 with an FP16 accumulator · 1
FP16 with an FP32 accumulator · 2
BF16 with an FP32 accumulator · 1
TF32 with an FP32 accumulator · 1
INT4 with an INT32 accumulator · 1
FP8 E4M3 through CUTLASS · 1
The dp4a integer dot product · 1
Scalar FP32 fused multiply-add · 1
FP16/FP32 as a cuBLAS GEMM · 4