SAME autoencoder: VRAM, latency, accuracy

Eight configurations — {SAME-S, SAME-L} × {16-bit, fp8} × {chunked, single-shot} — measured across 32 latent lengths from L=1 to L=8192 (244 points). Accuracy is a full round trip against real music — seven mastered tracks from the 806k-track corpus (rock, jazz, classical, electronic, hip hop, piano, folk) concatenated to 762 s, because L=8192 is longer than any single song and tiling one track would be artificially self-similar. Never noise: the autoencoder is content-dependent and noise fabricates numbers that do not hold on music. 16-bit means fp16 on SAME-L and bf16 on SAME-S. Hover any point for its value.

Encoder — VRAM scratch reserved

TensorRT commits a context's scratch from its PROFILE CEILING, not from the shape you bind — so these are flat in L. That is the whole point of the low band. SAME-L's two precisions reserve identical scratch, so those lines overlap exactly.

5001,0002,0005,000141664256102440968192latent length L  (L×4096 samples ≈ L×0.093 s)scratch (MB, log)SAME-L · 16-bit · chunked — L=1: 496.50 MBSAME-L · 16-bit · chunked — L=2: 496.50 MBSAME-L · 16-bit · chunked — L=3: 496.50 MBSAME-L · 16-bit · chunked — L=4: 496.50 MBSAME-L · 16-bit · chunked — L=7: 496.50 MBSAME-L · 16-bit · chunked — L=8: 496.50 MBSAME-L · 16-bit · chunked — L=15: 496.50 MBSAME-L · 16-bit · chunked — L=16: 496.50 MBSAME-L · 16-bit · chunked — L=17: 496.50 MBSAME-L · 16-bit · chunked — L=31: 496.50 MBSAME-L · 16-bit · chunked — L=32: 496.50 MBSAME-L · 16-bit · chunked — L=33: 496.50 MBSAME-L · 16-bit · chunked — L=63: 496.50 MBSAME-L · 16-bit · chunked — L=64: 496.50 MBSAME-L · 16-bit · chunked — L=127: 496.50 MBSAME-L · 16-bit · chunked — L=128: 496.50 MBSAME-L · 16-bit · chunked — L=255: 496.50 MBSAME-L · 16-bit · chunked — L=256: 496.50 MBSAME-L · 16-bit · chunked — L=257: 496.50 MBSAME-L · 16-bit · chunked — L=511: 496.50 MBSAME-L · 16-bit · chunked — L=512: 496.50 MBSAME-L · 16-bit · chunked — L=1023: 496.50 MBSAME-L · 16-bit · chunked — L=1024: 496.50 MBSAME-L · 16-bit · chunked — L=1291: 496.50 MBSAME-L · 16-bit · chunked — L=1292: 496.50 MBSAME-L · 16-bit · chunked — L=2047: 496.50 MBSAME-L · 16-bit · chunked — L=2048: 496.50 MBSAME-L · 16-bit · chunked — L=4095: 496.50 MBSAME-L · 16-bit · chunked — L=4096: 496.50 MBSAME-L · 16-bit · chunked — L=4097: 496.50 MBSAME-L · 16-bit · chunked — L=6144: 496.50 MBSAME-L · 16-bit · chunked — L=8192: 496.50 MBSAME-L · 16-bit · single-shot — L=1: 7,944.00 MBSAME-L · 16-bit · single-shot — L=2: 7,944.00 MBSAME-L · 16-bit · single-shot — L=3: 7,944.00 MBSAME-L · 16-bit · single-shot — L=4: 7,944.00 MBSAME-L · 16-bit · single-shot — L=7: 7,944.00 MBSAME-L · 16-bit · single-shot — L=8: 7,944.00 MBSAME-L · 16-bit · single-shot — L=15: 7,944.00 MBSAME-L · 16-bit · single-shot — L=16: 7,944.00 MBSAME-L · 16-bit · single-shot — L=17: 7,944.00 MBSAME-L · 16-bit · single-shot — L=31: 7,944.00 MBSAME-L · 16-bit · single-shot — L=32: 7,944.00 MBSAME-L · 16-bit · single-shot — L=33: 7,944.00 MBSAME-L · 16-bit · single-shot — L=63: 7,944.00 MBSAME-L · 16-bit · single-shot — L=64: 7,944.00 MBSAME-L · 16-bit · single-shot — L=127: 7,944.00 MBSAME-L · 16-bit · single-shot — L=128: 7,944.00 MBSAME-L · 16-bit · single-shot — L=255: 7,944.00 MBSAME-L · 16-bit · single-shot — L=256: 7,944.00 MBSAME-L · 16-bit · single-shot — L=257: 7,944.00 MBSAME-L · 16-bit · single-shot — L=511: 7,944.00 MBSAME-L · 16-bit · single-shot — L=512: 7,944.00 MBSAME-L · 16-bit · single-shot — L=1023: 7,944.00 MBSAME-L · 16-bit · single-shot — L=1024: 7,944.00 MBSAME-L · 16-bit · single-shot — L=1291: 7,944.00 MBSAME-L · 16-bit · single-shot — L=1292: 7,944.00 MBSAME-L · 16-bit · single-shot — L=2047: 7,944.00 MBSAME-L · 16-bit · single-shot — L=2048: 7,944.00 MBSAME-L · 16-bit · single-shot — L=4095: 7,944.00 MBSAME-L · 16-bit · single-shot — L=4096: 7,944.00 MBSAME-L · 16-bit · single-shot — L=4097: 7,944.00 MBSAME-L · 16-bit · single-shot — L=6144: 7,944.00 MBSAME-L · 16-bit · single-shot — L=8192: 7,944.00 MBSAME-L · fp8 · chunked — L=1: 496.50 MBSAME-L · fp8 · chunked — L=2: 496.50 MBSAME-L · fp8 · chunked — L=3: 496.50 MBSAME-L · fp8 · chunked — L=4: 496.50 MBSAME-L · fp8 · chunked — L=7: 496.50 MBSAME-L · fp8 · chunked — L=8: 496.50 MBSAME-L · fp8 · chunked — L=15: 496.50 MBSAME-L · fp8 · chunked — L=16: 496.50 MBSAME-L · fp8 · chunked — L=17: 496.50 MBSAME-L · fp8 · chunked — L=31: 496.50 MBSAME-L · fp8 · chunked — L=32: 496.50 MBSAME-L · fp8 · chunked — L=33: 496.50 MBSAME-L · fp8 · chunked — L=63: 496.50 MBSAME-L · fp8 · chunked — L=64: 496.50 MBSAME-L · fp8 · chunked — L=127: 496.50 MBSAME-L · fp8 · chunked — L=128: 496.50 MBSAME-L · fp8 · chunked — L=255: 496.50 MBSAME-L · fp8 · chunked — L=256: 496.50 MBSAME-L · fp8 · chunked — L=257: 496.50 MBSAME-L · fp8 · chunked — L=511: 496.50 MBSAME-L · fp8 · chunked — L=512: 496.50 MBSAME-L · fp8 · chunked — L=1023: 496.50 MBSAME-L · fp8 · chunked — L=1024: 496.50 MBSAME-L · fp8 · chunked — L=1291: 496.50 MBSAME-L · fp8 · chunked — L=1292: 496.50 MBSAME-L · fp8 · chunked — L=2047: 496.50 MBSAME-L · fp8 · chunked — L=2048: 496.50 MBSAME-L · fp8 · chunked — L=4095: 496.50 MBSAME-L · fp8 · chunked — L=4096: 496.50 MBSAME-L · fp8 · chunked — L=4097: 496.50 MBSAME-L · fp8 · chunked — L=6144: 496.50 MBSAME-L · fp8 · chunked — L=8192: 496.50 MBSAME-L · fp8 · single-shot — L=1: 7,944.00 MBSAME-L · fp8 · single-shot — L=2: 7,944.00 MBSAME-L · fp8 · single-shot — L=3: 7,944.00 MBSAME-L · fp8 · single-shot — L=4: 7,944.00 MBSAME-L · fp8 · single-shot — L=7: 7,944.00 MBSAME-L · fp8 · single-shot — L=8: 7,944.00 MBSAME-L · fp8 · single-shot — L=15: 7,944.00 MBSAME-L · fp8 · single-shot — L=16: 7,944.00 MBSAME-L · fp8 · single-shot — L=17: 7,944.00 MBSAME-L · fp8 · single-shot — L=31: 7,944.00 MBSAME-L · fp8 · single-shot — L=32: 7,944.00 MBSAME-L · fp8 · single-shot — L=33: 7,944.00 MBSAME-L · fp8 · single-shot — L=63: 7,944.00 MBSAME-L · fp8 · single-shot — L=64: 7,944.00 MBSAME-L · fp8 · single-shot — L=127: 7,944.00 MBSAME-L · fp8 · single-shot — L=128: 7,944.00 MBSAME-L · fp8 · single-shot — L=255: 7,944.00 MBSAME-L · fp8 · single-shot — L=256: 7,944.00 MBSAME-L · fp8 · single-shot — L=257: 7,944.00 MBSAME-L · fp8 · single-shot — L=511: 7,944.00 MBSAME-L · fp8 · single-shot — L=512: 7,944.00 MBSAME-L · fp8 · single-shot — L=1023: 7,944.00 MBSAME-L · fp8 · single-shot — L=1024: 7,944.00 MBSAME-L · fp8 · single-shot — L=1291: 7,944.00 MBSAME-L · fp8 · single-shot — L=1292: 7,944.00 MBSAME-L · fp8 · single-shot — L=2047: 7,944.00 MBSAME-L · fp8 · single-shot — L=2048: 7,944.00 MBSAME-L · fp8 · single-shot — L=4095: 7,944.00 MBSAME-L · fp8 · single-shot — L=4096: 7,944.00 MBSAME-L · fp8 · single-shot — L=4097: 7,944.00 MBSAME-L · fp8 · single-shot — L=6144: 7,944.00 MBSAME-L · fp8 · single-shot — L=8192: 7,944.00 MBSAME-S · 16-bit · chunked — L=1: 348.45 MBSAME-S · 16-bit · chunked — L=2: 348.45 MBSAME-S · 16-bit · chunked — L=3: 348.45 MBSAME-S · 16-bit · chunked — L=4: 348.45 MBSAME-S · 16-bit · chunked — L=7: 348.45 MBSAME-S · 16-bit · chunked — L=8: 348.45 MBSAME-S · 16-bit · chunked — L=15: 348.45 MBSAME-S · 16-bit · chunked — L=16: 348.45 MBSAME-S · 16-bit · chunked — L=17: 348.45 MBSAME-S · 16-bit · chunked — L=31: 348.45 MBSAME-S · 16-bit · chunked — L=32: 348.45 MBSAME-S · 16-bit · chunked — L=33: 348.45 MBSAME-S · 16-bit · chunked — L=63: 348.45 MBSAME-S · 16-bit · chunked — L=64: 348.45 MBSAME-S · 16-bit · chunked — L=127: 348.45 MBSAME-S · 16-bit · chunked — L=128: 348.45 MBSAME-S · 16-bit · chunked — L=255: 348.45 MBSAME-S · 16-bit · chunked — L=256: 348.45 MBSAME-S · 16-bit · chunked — L=257: 348.45 MBSAME-S · 16-bit · chunked — L=511: 348.45 MBSAME-S · 16-bit · chunked — L=512: 348.45 MBSAME-S · 16-bit · chunked — L=1023: 348.45 MBSAME-S · 16-bit · chunked — L=1024: 348.45 MBSAME-S · 16-bit · chunked — L=1291: 348.45 MBSAME-S · 16-bit · chunked — L=1292: 348.45 MBSAME-S · 16-bit · chunked — L=2047: 348.45 MBSAME-S · 16-bit · chunked — L=2048: 348.45 MBSAME-S · 16-bit · chunked — L=4095: 348.45 MBSAME-S · 16-bit · chunked — L=4096: 348.45 MBSAME-S · 16-bit · chunked — L=4097: 348.45 MBSAME-S · 16-bit · chunked — L=6144: 348.45 MBSAME-S · 16-bit · chunked — L=8192: 348.45 MBSAME-S · 16-bit · single-shot — L=1: 5,530.95 MBSAME-S · 16-bit · single-shot — L=2: 5,530.95 MBSAME-S · 16-bit · single-shot — L=3: 5,530.95 MBSAME-S · 16-bit · single-shot — L=4: 5,530.95 MBSAME-S · 16-bit · single-shot — L=7: 5,530.95 MBSAME-S · 16-bit · single-shot — L=8: 5,530.95 MBSAME-S · 16-bit · single-shot — L=15: 5,530.95 MBSAME-S · 16-bit · single-shot — L=16: 5,530.95 MBSAME-S · 16-bit · single-shot — L=17: 5,530.95 MBSAME-S · 16-bit · single-shot — L=31: 5,530.95 MBSAME-S · 16-bit · single-shot — L=32: 5,530.95 MBSAME-S · 16-bit · single-shot — L=33: 5,530.95 MBSAME-S · 16-bit · single-shot — L=63: 5,530.95 MBSAME-S · 16-bit · single-shot — L=64: 5,530.95 MBSAME-S · 16-bit · single-shot — L=127: 5,530.95 MBSAME-S · 16-bit · single-shot — L=128: 5,530.95 MBSAME-S · 16-bit · single-shot — L=255: 5,530.95 MBSAME-S · 16-bit · single-shot — L=256: 5,530.95 MBSAME-S · 16-bit · single-shot — L=257: 5,530.95 MBSAME-S · 16-bit · single-shot — L=511: 5,530.95 MBSAME-S · 16-bit · single-shot — L=512: 5,530.95 MBSAME-S · 16-bit · single-shot — L=1023: 5,530.95 MBSAME-S · 16-bit · single-shot — L=1024: 5,530.95 MBSAME-S · 16-bit · single-shot — L=1291: 5,530.95 MBSAME-S · 16-bit · single-shot — L=1292: 5,530.95 MBSAME-S · 16-bit · single-shot — L=2047: 5,530.95 MBSAME-S · 16-bit · single-shot — L=2048: 5,530.95 MBSAME-S · 16-bit · single-shot — L=4095: 5,530.95 MBSAME-S · 16-bit · single-shot — L=4096: 5,530.95 MBSAME-S · 16-bit · single-shot — L=4097: 5,530.95 MBSAME-S · 16-bit · single-shot — L=6144: 5,530.95 MBSAME-S · 16-bit · single-shot — L=8192: 5,530.95 MBSAME-S · fp8 · chunked — L=1: 329.17 MBSAME-S · fp8 · chunked — L=2: 329.17 MBSAME-S · fp8 · chunked — L=3: 329.17 MBSAME-S · fp8 · chunked — L=4: 329.17 MBSAME-S · fp8 · chunked — L=7: 329.17 MBSAME-S · fp8 · chunked — L=8: 329.17 MBSAME-S · fp8 · chunked — L=15: 329.17 MBSAME-S · fp8 · chunked — L=16: 329.17 MBSAME-S · fp8 · chunked — L=17: 329.17 MBSAME-S · fp8 · chunked — L=31: 329.17 MBSAME-S · fp8 · chunked — L=32: 329.17 MBSAME-S · fp8 · chunked — L=33: 329.17 MBSAME-S · fp8 · chunked — L=63: 329.17 MBSAME-S · fp8 · chunked — L=64: 329.17 MBSAME-S · fp8 · chunked — L=127: 329.17 MBSAME-S · fp8 · chunked — L=128: 329.17 MBSAME-S · fp8 · chunked — L=255: 329.17 MBSAME-S · fp8 · chunked — L=256: 329.17 MBSAME-S · fp8 · chunked — L=257: 329.17 MBSAME-S · fp8 · chunked — L=511: 329.17 MBSAME-S · fp8 · chunked — L=512: 329.17 MBSAME-S · fp8 · chunked — L=1023: 329.17 MBSAME-S · fp8 · chunked — L=1024: 329.17 MBSAME-S · fp8 · chunked — L=1291: 329.17 MBSAME-S · fp8 · chunked — L=1292: 329.17 MBSAME-S · fp8 · chunked — L=2047: 329.17 MBSAME-S · fp8 · chunked — L=2048: 329.17 MBSAME-S · fp8 · chunked — L=4095: 329.17 MBSAME-S · fp8 · chunked — L=4096: 329.17 MBSAME-S · fp8 · chunked — L=4097: 329.17 MBSAME-S · fp8 · chunked — L=6144: 329.17 MBSAME-S · fp8 · chunked — L=8192: 329.17 MBSAME-S · fp8 · single-shot — L=1: 5,224.80 MBSAME-S · fp8 · single-shot — L=2: 5,224.80 MBSAME-S · fp8 · single-shot — L=3: 5,224.80 MBSAME-S · fp8 · single-shot — L=4: 5,224.80 MBSAME-S · fp8 · single-shot — L=7: 5,224.80 MBSAME-S · fp8 · single-shot — L=8: 5,224.80 MBSAME-S · fp8 · single-shot — L=15: 5,224.80 MBSAME-S · fp8 · single-shot — L=16: 5,224.80 MBSAME-S · fp8 · single-shot — L=17: 5,224.80 MBSAME-S · fp8 · single-shot — L=31: 5,224.80 MBSAME-S · fp8 · single-shot — L=32: 5,224.80 MBSAME-S · fp8 · single-shot — L=33: 5,224.80 MBSAME-S · fp8 · single-shot — L=63: 5,224.80 MBSAME-S · fp8 · single-shot — L=64: 5,224.80 MBSAME-S · fp8 · single-shot — L=127: 5,224.80 MBSAME-S · fp8 · single-shot — L=128: 5,224.80 MBSAME-S · fp8 · single-shot — L=255: 5,224.80 MBSAME-S · fp8 · single-shot — L=256: 5,224.80 MBSAME-S · fp8 · single-shot — L=257: 5,224.80 MBSAME-S · fp8 · single-shot — L=511: 5,224.80 MBSAME-S · fp8 · single-shot — L=512: 5,224.80 MBSAME-S · fp8 · single-shot — L=1023: 5,224.80 MBSAME-S · fp8 · single-shot — L=1024: 5,224.80 MBSAME-S · fp8 · single-shot — L=1291: 5,224.80 MBSAME-S · fp8 · single-shot — L=1292: 5,224.80 MBSAME-S · fp8 · single-shot — L=2047: 5,224.80 MBSAME-S · fp8 · single-shot — L=2048: 5,224.80 MBSAME-S · fp8 · single-shot — L=4095: 5,224.80 MBSAME-S · fp8 · single-shot — L=4096: 5,224.80 MBSAME-S · fp8 · single-shot — L=4097: 5,224.80 MBSAME-S · fp8 · single-shot — L=6144: 5,224.80 MBSAME-S · fp8 · single-shot — L=8192: 5,224.80 MB
SAME-L · 16-bit · chunkedSAME-L · 16-bit · single-shotSAME-L · fp8 · chunkedSAME-L · fp8 · single-shotSAME-S · 16-bit · chunkedSAME-S · 16-bit · single-shotSAME-S · fp8 · chunkedSAME-S · fp8 · single-shot

Encoder — latency

Best of three, after warm-up. Single-shot lines stop at L=4096: that is the wide band's ceiling. Chunked keeps going because it windows.

0.5125102050100200500141664256102440968192latent length L  (L×4096 samples ≈ L×0.093 s)milliseconds (log)SAME-L · 16-bit · chunked — L=1: 4.65 msSAME-L · 16-bit · chunked — L=2: 4.56 msSAME-L · 16-bit · chunked — L=3: 4.52 msSAME-L · 16-bit · chunked — L=4: 4.39 msSAME-L · 16-bit · chunked — L=7: 4.45 msSAME-L · 16-bit · chunked — L=8: 4.97 msSAME-L · 16-bit · chunked — L=15: 5.08 msSAME-L · 16-bit · chunked — L=16: 6.30 msSAME-L · 16-bit · chunked — L=17: 6.29 msSAME-L · 16-bit · chunked — L=31: 8.74 msSAME-L · 16-bit · chunked — L=32: 8.83 msSAME-L · 16-bit · chunked — L=33: 8.83 msSAME-L · 16-bit · chunked — L=63: 12.33 msSAME-L · 16-bit · chunked — L=64: 12.34 msSAME-L · 16-bit · chunked — L=127: 20.56 msSAME-L · 16-bit · chunked — L=128: 20.65 msSAME-L · 16-bit · chunked — L=255: 37.34 msSAME-L · 16-bit · chunked — L=256: 36.40 msSAME-L · 16-bit · chunked — L=257: 50.64 msSAME-L · 16-bit · chunked — L=511: 64.83 msSAME-L · 16-bit · chunked — L=512: 63.90 msSAME-L · 16-bit · chunked — L=1023: 89.52 msSAME-L · 16-bit · chunked — L=1024: 90.61 msSAME-L · 16-bit · chunked — L=1291: 102.62 msSAME-L · 16-bit · chunked — L=1292: 102.97 msSAME-L · 16-bit · chunked — L=2047: 141.64 msSAME-L · 16-bit · chunked — L=2048: 142.88 msSAME-L · 16-bit · chunked — L=4095: 245.93 msSAME-L · 16-bit · chunked — L=4096: 245.15 msSAME-L · 16-bit · chunked — L=4097: 245.69 msSAME-L · 16-bit · chunked — L=6144: 351.65 msSAME-L · 16-bit · chunked — L=8192: 455.03 msSAME-L · 16-bit · single-shot — L=1: 1.57 msSAME-L · 16-bit · single-shot — L=2: 1.55 msSAME-L · 16-bit · single-shot — L=3: 1.55 msSAME-L · 16-bit · single-shot — L=4: 1.49 msSAME-L · 16-bit · single-shot — L=7: 1.53 msSAME-L · 16-bit · single-shot — L=8: 1.64 msSAME-L · 16-bit · single-shot — L=15: 1.71 msSAME-L · 16-bit · single-shot — L=16: 2.18 msSAME-L · 16-bit · single-shot — L=17: 2.09 msSAME-L · 16-bit · single-shot — L=31: 2.92 msSAME-L · 16-bit · single-shot — L=32: 2.97 msSAME-L · 16-bit · single-shot — L=33: 2.97 msSAME-L · 16-bit · single-shot — L=63: 4.15 msSAME-L · 16-bit · single-shot — L=64: 4.13 msSAME-L · 16-bit · single-shot — L=127: 6.86 msSAME-L · 16-bit · single-shot — L=128: 6.90 msSAME-L · 16-bit · single-shot — L=255: 12.25 msSAME-L · 16-bit · single-shot — L=256: 12.16 msSAME-L · 16-bit · single-shot — L=257: 12.93 msSAME-L · 16-bit · single-shot — L=511: 24.05 msSAME-L · 16-bit · single-shot — L=512: 24.00 msSAME-L · 16-bit · single-shot — L=1023: 48.80 msSAME-L · 16-bit · single-shot — L=1024: 49.20 msSAME-L · 16-bit · single-shot — L=1291: 61.76 msSAME-L · 16-bit · single-shot — L=1292: 61.95 msSAME-L · 16-bit · single-shot — L=2047: 99.05 msSAME-L · 16-bit · single-shot — L=2048: 98.41 msSAME-L · 16-bit · single-shot — L=4095: 196.59 msSAME-L · 16-bit · single-shot — L=4096: 196.51 msSAME-L · fp8 · chunked — L=1: 4.55 msSAME-L · fp8 · chunked — L=2: 4.60 msSAME-L · fp8 · chunked — L=3: 4.64 msSAME-L · fp8 · chunked — L=4: 4.45 msSAME-L · fp8 · chunked — L=7: 4.59 msSAME-L · fp8 · chunked — L=8: 4.75 msSAME-L · fp8 · chunked — L=15: 4.97 msSAME-L · fp8 · chunked — L=16: 6.29 msSAME-L · fp8 · chunked — L=17: 6.11 msSAME-L · fp8 · chunked — L=31: 7.90 msSAME-L · fp8 · chunked — L=32: 8.08 msSAME-L · fp8 · chunked — L=33: 8.05 msSAME-L · fp8 · chunked — L=63: 11.20 msSAME-L · fp8 · chunked — L=64: 11.23 msSAME-L · fp8 · chunked — L=127: 18.44 msSAME-L · fp8 · chunked — L=128: 18.54 msSAME-L · fp8 · chunked — L=255: 32.75 msSAME-L · fp8 · chunked — L=256: 32.32 msSAME-L · fp8 · chunked — L=257: 44.76 msSAME-L · fp8 · chunked — L=511: 56.29 msSAME-L · fp8 · chunked — L=512: 56.28 msSAME-L · fp8 · chunked — L=1023: 78.03 msSAME-L · fp8 · chunked — L=1024: 78.64 msSAME-L · fp8 · chunked — L=1291: 89.93 msSAME-L · fp8 · chunked — L=1292: 89.99 msSAME-L · fp8 · chunked — L=2047: 124.46 msSAME-L · fp8 · chunked — L=2048: 123.91 msSAME-L · fp8 · chunked — L=4095: 212.38 msSAME-L · fp8 · chunked — L=4096: 215.53 msSAME-L · fp8 · chunked — L=4097: 215.22 msSAME-L · fp8 · chunked — L=6144: 307.16 msSAME-L · fp8 · chunked — L=8192: 397.31 msSAME-L · fp8 · single-shot — L=1: 1.54 msSAME-L · fp8 · single-shot — L=2: 1.54 msSAME-L · fp8 · single-shot — L=3: 1.53 msSAME-L · fp8 · single-shot — L=4: 1.50 msSAME-L · fp8 · single-shot — L=7: 1.52 msSAME-L · fp8 · single-shot — L=8: 1.59 msSAME-L · fp8 · single-shot — L=15: 1.67 msSAME-L · fp8 · single-shot — L=16: 2.10 msSAME-L · fp8 · single-shot — L=17: 2.11 msSAME-L · fp8 · single-shot — L=31: 2.63 msSAME-L · fp8 · single-shot — L=32: 2.68 msSAME-L · fp8 · single-shot — L=33: 2.71 msSAME-L · fp8 · single-shot — L=63: 3.75 msSAME-L · fp8 · single-shot — L=64: 3.77 msSAME-L · fp8 · single-shot — L=127: 6.18 msSAME-L · fp8 · single-shot — L=128: 6.22 msSAME-L · fp8 · single-shot — L=255: 10.90 msSAME-L · fp8 · single-shot — L=256: 10.79 msSAME-L · fp8 · single-shot — L=257: 11.37 msSAME-L · fp8 · single-shot — L=511: 21.14 msSAME-L · fp8 · single-shot — L=512: 21.33 msSAME-L · fp8 · single-shot — L=1023: 42.59 msSAME-L · fp8 · single-shot — L=1024: 43.07 msSAME-L · fp8 · single-shot — L=1291: 53.40 msSAME-L · fp8 · single-shot — L=1292: 53.26 msSAME-L · fp8 · single-shot — L=2047: 85.68 msSAME-L · fp8 · single-shot — L=2048: 84.34 msSAME-L · fp8 · single-shot — L=4095: 172.03 msSAME-L · fp8 · single-shot — L=4096: 172.06 msSAME-S · 16-bit · chunked — L=1: 1.64 msSAME-S · 16-bit · chunked — L=2: 1.66 msSAME-S · 16-bit · chunked — L=3: 1.65 msSAME-S · 16-bit · chunked — L=4: 1.66 msSAME-S · 16-bit · chunked — L=7: 1.70 msSAME-S · 16-bit · chunked — L=8: 1.70 msSAME-S · 16-bit · chunked — L=15: 1.82 msSAME-S · 16-bit · chunked — L=16: 1.82 msSAME-S · 16-bit · chunked — L=17: 1.83 msSAME-S · 16-bit · chunked — L=31: 2.05 msSAME-S · 16-bit · chunked — L=32: 2.04 msSAME-S · 16-bit · chunked — L=33: 2.05 msSAME-S · 16-bit · chunked — L=63: 2.52 msSAME-S · 16-bit · chunked — L=64: 2.49 msSAME-S · 16-bit · chunked — L=127: 3.36 msSAME-S · 16-bit · chunked — L=128: 3.36 msSAME-S · 16-bit · chunked — L=255: 5.31 msSAME-S · 16-bit · chunked — L=256: 5.29 msSAME-S · 16-bit · chunked — L=257: 7.38 msSAME-S · 16-bit · chunked — L=511: 9.21 msSAME-S · 16-bit · chunked — L=512: 9.16 msSAME-S · 16-bit · chunked — L=1023: 12.86 msSAME-S · 16-bit · chunked — L=1024: 12.86 msSAME-S · 16-bit · chunked — L=1291: 14.77 msSAME-S · 16-bit · chunked — L=1292: 14.75 msSAME-S · 16-bit · chunked — L=2047: 20.20 msSAME-S · 16-bit · chunked — L=2048: 20.21 msSAME-S · 16-bit · chunked — L=4095: 35.09 msSAME-S · 16-bit · chunked — L=4096: 35.06 msSAME-S · 16-bit · chunked — L=4097: 35.02 msSAME-S · 16-bit · chunked — L=6144: 49.64 msSAME-S · 16-bit · chunked — L=8192: 65.96 msSAME-S · 16-bit · single-shot — L=1: 0.67 msSAME-S · 16-bit · single-shot — L=2: 0.67 msSAME-S · 16-bit · single-shot — L=3: 0.68 msSAME-S · 16-bit · single-shot — L=4: 0.68 msSAME-S · 16-bit · single-shot — L=7: 0.69 msSAME-S · 16-bit · single-shot — L=8: 0.68 msSAME-S · 16-bit · single-shot — L=15: 0.72 msSAME-S · 16-bit · single-shot — L=16: 0.72 msSAME-S · 16-bit · single-shot — L=17: 0.72 msSAME-S · 16-bit · single-shot — L=31: 0.82 msSAME-S · 16-bit · single-shot — L=32: 0.83 msSAME-S · 16-bit · single-shot — L=33: 0.81 msSAME-S · 16-bit · single-shot — L=63: 0.96 msSAME-S · 16-bit · single-shot — L=64: 0.95 msSAME-S · 16-bit · single-shot — L=127: 1.23 msSAME-S · 16-bit · single-shot — L=128: 1.22 msSAME-S · 16-bit · single-shot — L=255: 1.81 msSAME-S · 16-bit · single-shot — L=256: 1.79 msSAME-S · 16-bit · single-shot — L=257: 1.89 msSAME-S · 16-bit · single-shot — L=511: 3.36 msSAME-S · 16-bit · single-shot — L=512: 3.37 msSAME-S · 16-bit · single-shot — L=1023: 6.33 msSAME-S · 16-bit · single-shot — L=1024: 6.31 msSAME-S · 16-bit · single-shot — L=1291: 7.65 msSAME-S · 16-bit · single-shot — L=1292: 7.67 msSAME-S · 16-bit · single-shot — L=2047: 12.03 msSAME-S · 16-bit · single-shot — L=2048: 12.02 msSAME-S · 16-bit · single-shot — L=4095: 23.51 msSAME-S · 16-bit · single-shot — L=4096: 23.38 msSAME-S · fp8 · chunked — L=1: 1.63 msSAME-S · fp8 · chunked — L=2: 1.62 msSAME-S · fp8 · chunked — L=3: 1.63 msSAME-S · fp8 · chunked — L=4: 1.61 msSAME-S · fp8 · chunked — L=7: 1.65 msSAME-S · fp8 · chunked — L=8: 1.65 msSAME-S · fp8 · chunked — L=15: 1.74 msSAME-S · fp8 · chunked — L=16: 1.76 msSAME-S · fp8 · chunked — L=17: 1.79 msSAME-S · fp8 · chunked — L=31: 2.00 msSAME-S · fp8 · chunked — L=32: 1.99 msSAME-S · fp8 · chunked — L=33: 2.00 msSAME-S · fp8 · chunked — L=63: 2.40 msSAME-S · fp8 · chunked — L=64: 2.41 msSAME-S · fp8 · chunked — L=127: 3.21 msSAME-S · fp8 · chunked — L=128: 3.21 msSAME-S · fp8 · chunked — L=255: 4.91 msSAME-S · fp8 · chunked — L=256: 4.91 msSAME-S · fp8 · chunked — L=257: 6.84 msSAME-S · fp8 · chunked — L=511: 8.52 msSAME-S · fp8 · chunked — L=512: 8.49 msSAME-S · fp8 · chunked — L=1023: 11.99 msSAME-S · fp8 · chunked — L=1024: 11.97 msSAME-S · fp8 · chunked — L=1291: 13.70 msSAME-S · fp8 · chunked — L=1292: 13.65 msSAME-S · fp8 · chunked — L=2047: 18.79 msSAME-S · fp8 · chunked — L=2048: 18.77 msSAME-S · fp8 · chunked — L=4095: 32.55 msSAME-S · fp8 · chunked — L=4096: 32.42 msSAME-S · fp8 · chunked — L=4097: 32.62 msSAME-S · fp8 · chunked — L=6144: 46.26 msSAME-S · fp8 · chunked — L=8192: 59.55 msSAME-S · fp8 · single-shot — L=1: 0.56 msSAME-S · fp8 · single-shot — L=2: 0.57 msSAME-S · fp8 · single-shot — L=3: 0.56 msSAME-S · fp8 · single-shot — L=4: 0.58 msSAME-S · fp8 · single-shot — L=7: 0.58 msSAME-S · fp8 · single-shot — L=8: 0.58 msSAME-S · fp8 · single-shot — L=15: 0.64 msSAME-S · fp8 · single-shot — L=16: 0.61 msSAME-S · fp8 · single-shot — L=17: 0.63 msSAME-S · fp8 · single-shot — L=31: 0.70 msSAME-S · fp8 · single-shot — L=32: 0.70 msSAME-S · fp8 · single-shot — L=33: 0.70 msSAME-S · fp8 · single-shot — L=63: 0.85 msSAME-S · fp8 · single-shot — L=64: 0.84 msSAME-S · fp8 · single-shot — L=127: 1.10 msSAME-S · fp8 · single-shot — L=128: 1.22 msSAME-S · fp8 · single-shot — L=255: 1.69 msSAME-S · fp8 · single-shot — L=256: 1.66 msSAME-S · fp8 · single-shot — L=257: 1.75 msSAME-S · fp8 · single-shot — L=511: 3.06 msSAME-S · fp8 · single-shot — L=512: 3.06 msSAME-S · fp8 · single-shot — L=1023: 5.61 msSAME-S · fp8 · single-shot — L=1024: 5.62 msSAME-S · fp8 · single-shot — L=1291: 6.95 msSAME-S · fp8 · single-shot — L=1292: 6.92 msSAME-S · fp8 · single-shot — L=2047: 10.71 msSAME-S · fp8 · single-shot — L=2048: 10.68 msSAME-S · fp8 · single-shot — L=4095: 20.95 msSAME-S · fp8 · single-shot — L=4096: 20.95 ms
SAME-L · 16-bit · chunkedSAME-L · 16-bit · single-shotSAME-L · fp8 · chunkedSAME-L · fp8 · single-shotSAME-S · 16-bit · chunkedSAME-S · 16-bit · single-shotSAME-S · fp8 · chunkedSAME-S · fp8 · single-shot

Encoder — accuracy vs the original music, content held fixed

The SAME 190 s of real music at every point — reassembled from L-sized blocks, so only the processing length changes. This is the apples-to-apples question the TFLite rung table asks, and the answer is the same: flat. From L=16 up the whole curve moves 0.002 dB on SAME-L and 0.020 dB on SAME-S. The fall below L≈16 is real but is not a seam: 0.09 s blocks encoded independently lose context at every boundary.

2.743.143.543.944.344.745.141416642561024latent length L  (L×4096 samples ≈ L×0.093 s)reconstruction SNR (dB)SAME-L · 16-bit · chunked — L=1: 4.21 dBSAME-L · 16-bit · chunked — L=2: 4.74 dBSAME-L · 16-bit · chunked — L=4: 4.85 dBSAME-L · 16-bit · chunked — L=8: 4.89 dBSAME-L · 16-bit · chunked — L=16: 4.89 dBSAME-L · 16-bit · chunked — L=32: 4.89 dBSAME-L · 16-bit · chunked — L=64: 4.89 dBSAME-L · 16-bit · chunked — L=128: 4.89 dBSAME-L · 16-bit · chunked — L=256: 4.89 dBSAME-L · 16-bit · chunked — L=512: 4.89 dBSAME-L · 16-bit · chunked — L=1024: 4.89 dBSAME-L · 16-bit · chunked — L=2048: 4.89 dBSAME-L · 16-bit · single-shot — L=1: 4.21 dBSAME-L · 16-bit · single-shot — L=2: 4.74 dBSAME-L · 16-bit · single-shot — L=4: 4.85 dBSAME-L · 16-bit · single-shot — L=8: 4.89 dBSAME-L · 16-bit · single-shot — L=16: 4.89 dBSAME-L · 16-bit · single-shot — L=32: 4.89 dBSAME-L · 16-bit · single-shot — L=64: 4.89 dBSAME-L · 16-bit · single-shot — L=128: 4.89 dBSAME-L · 16-bit · single-shot — L=256: 4.89 dBSAME-L · 16-bit · single-shot — L=512: 4.89 dBSAME-L · 16-bit · single-shot — L=1024: 4.89 dBSAME-L · 16-bit · single-shot — L=2048: 4.89 dBSAME-L · fp8 · chunked — L=1: 4.20 dBSAME-L · fp8 · chunked — L=2: 4.75 dBSAME-L · fp8 · chunked — L=4: 4.86 dBSAME-L · fp8 · chunked — L=8: 4.91 dBSAME-L · fp8 · chunked — L=16: 4.90 dBSAME-L · fp8 · chunked — L=32: 4.90 dBSAME-L · fp8 · chunked — L=64: 4.90 dBSAME-L · fp8 · chunked — L=128: 4.90 dBSAME-L · fp8 · chunked — L=256: 4.90 dBSAME-L · fp8 · chunked — L=512: 4.90 dBSAME-L · fp8 · chunked — L=1024: 4.90 dBSAME-L · fp8 · chunked — L=2048: 4.90 dBSAME-L · fp8 · single-shot — L=1: 4.20 dBSAME-L · fp8 · single-shot — L=2: 4.75 dBSAME-L · fp8 · single-shot — L=4: 4.86 dBSAME-L · fp8 · single-shot — L=8: 4.91 dBSAME-L · fp8 · single-shot — L=16: 4.90 dBSAME-L · fp8 · single-shot — L=32: 4.90 dBSAME-L · fp8 · single-shot — L=64: 4.90 dBSAME-L · fp8 · single-shot — L=128: 4.90 dBSAME-L · fp8 · single-shot — L=256: 4.90 dBSAME-L · fp8 · single-shot — L=512: 4.90 dBSAME-L · fp8 · single-shot — L=1024: 4.90 dBSAME-L · fp8 · single-shot — L=2048: 4.90 dBSAME-S · 16-bit · chunked — L=1: 3.01 dBSAME-S · 16-bit · chunked — L=2: 3.70 dBSAME-S · 16-bit · chunked — L=4: 3.78 dBSAME-S · 16-bit · chunked — L=8: 3.82 dBSAME-S · 16-bit · chunked — L=16: 3.84 dBSAME-S · 16-bit · chunked — L=32: 3.85 dBSAME-S · 16-bit · chunked — L=64: 3.85 dBSAME-S · 16-bit · chunked — L=128: 3.85 dBSAME-S · 16-bit · chunked — L=256: 3.86 dBSAME-S · 16-bit · chunked — L=512: 3.86 dBSAME-S · 16-bit · chunked — L=1024: 3.86 dBSAME-S · 16-bit · chunked — L=2048: 3.86 dBSAME-S · 16-bit · single-shot — L=1: 3.01 dBSAME-S · 16-bit · single-shot — L=2: 3.70 dBSAME-S · 16-bit · single-shot — L=4: 3.78 dBSAME-S · 16-bit · single-shot — L=8: 3.82 dBSAME-S · 16-bit · single-shot — L=16: 3.84 dBSAME-S · 16-bit · single-shot — L=32: 3.85 dBSAME-S · 16-bit · single-shot — L=64: 3.85 dBSAME-S · 16-bit · single-shot — L=128: 3.85 dBSAME-S · 16-bit · single-shot — L=256: 3.86 dBSAME-S · 16-bit · single-shot — L=512: 3.86 dBSAME-S · 16-bit · single-shot — L=1024: 3.86 dBSAME-S · 16-bit · single-shot — L=2048: 3.86 dBSAME-S · fp8 · chunked — L=1: 2.94 dBSAME-S · fp8 · chunked — L=2: 3.63 dBSAME-S · fp8 · chunked — L=4: 3.70 dBSAME-S · fp8 · chunked — L=8: 3.74 dBSAME-S · fp8 · chunked — L=16: 3.76 dBSAME-S · fp8 · chunked — L=32: 3.77 dBSAME-S · fp8 · chunked — L=64: 3.77 dBSAME-S · fp8 · chunked — L=128: 3.78 dBSAME-S · fp8 · chunked — L=256: 3.78 dBSAME-S · fp8 · chunked — L=512: 3.78 dBSAME-S · fp8 · chunked — L=1024: 3.78 dBSAME-S · fp8 · chunked — L=2048: 3.78 dBSAME-S · fp8 · single-shot — L=1: 2.94 dBSAME-S · fp8 · single-shot — L=2: 3.63 dBSAME-S · fp8 · single-shot — L=4: 3.70 dBSAME-S · fp8 · single-shot — L=8: 3.74 dBSAME-S · fp8 · single-shot — L=16: 3.76 dBSAME-S · fp8 · single-shot — L=32: 3.77 dBSAME-S · fp8 · single-shot — L=64: 3.77 dBSAME-S · fp8 · single-shot — L=128: 3.78 dBSAME-S · fp8 · single-shot — L=256: 3.78 dBSAME-S · fp8 · single-shot — L=512: 3.78 dBSAME-S · fp8 · single-shot — L=1024: 3.78 dBSAME-S · fp8 · single-shot — L=2048: 3.78 dB
SAME-L · 16-bit · chunkedSAME-L · 16-bit · single-shotSAME-L · fp8 · chunkedSAME-L · fp8 · single-shotSAME-S · 16-bit · chunkedSAME-S · 16-bit · single-shotSAME-S · fp8 · chunkedSAME-S · fp8 · single-shot

Decoder — VRAM scratch reserved

5001,0002,0005,000141664256102440968192latent length L  (L×4096 samples ≈ L×0.093 s)scratch (MB, log)SAME-L · 16-bit · chunked — L=1: 485.38 MBSAME-L · 16-bit · chunked — L=2: 485.38 MBSAME-L · 16-bit · chunked — L=3: 485.38 MBSAME-L · 16-bit · chunked — L=4: 485.38 MBSAME-L · 16-bit · chunked — L=7: 485.38 MBSAME-L · 16-bit · chunked — L=8: 485.38 MBSAME-L · 16-bit · chunked — L=15: 485.38 MBSAME-L · 16-bit · chunked — L=16: 485.38 MBSAME-L · 16-bit · chunked — L=17: 485.38 MBSAME-L · 16-bit · chunked — L=31: 485.38 MBSAME-L · 16-bit · chunked — L=32: 485.38 MBSAME-L · 16-bit · chunked — L=33: 485.38 MBSAME-L · 16-bit · chunked — L=63: 485.38 MBSAME-L · 16-bit · chunked — L=64: 485.38 MBSAME-L · 16-bit · chunked — L=127: 485.38 MBSAME-L · 16-bit · chunked — L=128: 485.38 MBSAME-L · 16-bit · chunked — L=255: 485.38 MBSAME-L · 16-bit · chunked — L=256: 485.38 MBSAME-L · 16-bit · chunked — L=257: 485.38 MBSAME-L · 16-bit · chunked — L=511: 485.38 MBSAME-L · 16-bit · chunked — L=512: 485.38 MBSAME-L · 16-bit · chunked — L=1023: 485.38 MBSAME-L · 16-bit · chunked — L=1024: 485.38 MBSAME-L · 16-bit · chunked — L=1291: 485.38 MBSAME-L · 16-bit · chunked — L=1292: 485.38 MBSAME-L · 16-bit · chunked — L=2047: 485.38 MBSAME-L · 16-bit · chunked — L=2048: 485.38 MBSAME-L · 16-bit · chunked — L=4095: 485.38 MBSAME-L · 16-bit · chunked — L=4096: 485.38 MBSAME-L · 16-bit · chunked — L=4097: 485.38 MBSAME-L · 16-bit · chunked — L=6144: 485.38 MBSAME-L · 16-bit · chunked — L=8192: 485.38 MBSAME-L · 16-bit · single-shot — L=1: 7,766.00 MBSAME-L · 16-bit · single-shot — L=2: 7,766.00 MBSAME-L · 16-bit · single-shot — L=3: 7,766.00 MBSAME-L · 16-bit · single-shot — L=4: 7,766.00 MBSAME-L · 16-bit · single-shot — L=7: 7,766.00 MBSAME-L · 16-bit · single-shot — L=8: 7,766.00 MBSAME-L · 16-bit · single-shot — L=15: 7,766.00 MBSAME-L · 16-bit · single-shot — L=16: 7,766.00 MBSAME-L · 16-bit · single-shot — L=17: 7,766.00 MBSAME-L · 16-bit · single-shot — L=31: 7,766.00 MBSAME-L · 16-bit · single-shot — L=32: 7,766.00 MBSAME-L · 16-bit · single-shot — L=33: 7,766.00 MBSAME-L · 16-bit · single-shot — L=63: 7,766.00 MBSAME-L · 16-bit · single-shot — L=64: 7,766.00 MBSAME-L · 16-bit · single-shot — L=127: 7,766.00 MBSAME-L · 16-bit · single-shot — L=128: 7,766.00 MBSAME-L · 16-bit · single-shot — L=255: 7,766.00 MBSAME-L · 16-bit · single-shot — L=256: 7,766.00 MBSAME-L · 16-bit · single-shot — L=257: 7,766.00 MBSAME-L · 16-bit · single-shot — L=511: 7,766.00 MBSAME-L · 16-bit · single-shot — L=512: 7,766.00 MBSAME-L · 16-bit · single-shot — L=1023: 7,766.00 MBSAME-L · 16-bit · single-shot — L=1024: 7,766.00 MBSAME-L · 16-bit · single-shot — L=1291: 7,766.00 MBSAME-L · 16-bit · single-shot — L=1292: 7,766.00 MBSAME-L · 16-bit · single-shot — L=2047: 7,766.00 MBSAME-L · 16-bit · single-shot — L=2048: 7,766.00 MBSAME-L · 16-bit · single-shot — L=4095: 7,766.00 MBSAME-L · 16-bit · single-shot — L=4096: 7,766.00 MBSAME-L · 16-bit · single-shot — L=4097: 7,766.00 MBSAME-L · 16-bit · single-shot — L=6144: 7,766.00 MBSAME-L · 16-bit · single-shot — L=8192: 7,766.00 MBSAME-L · fp8 · chunked — L=1: 485.38 MBSAME-L · fp8 · chunked — L=2: 485.38 MBSAME-L · fp8 · chunked — L=3: 485.38 MBSAME-L · fp8 · chunked — L=4: 485.38 MBSAME-L · fp8 · chunked — L=7: 485.38 MBSAME-L · fp8 · chunked — L=8: 485.38 MBSAME-L · fp8 · chunked — L=15: 485.38 MBSAME-L · fp8 · chunked — L=16: 485.38 MBSAME-L · fp8 · chunked — L=17: 485.38 MBSAME-L · fp8 · chunked — L=31: 485.38 MBSAME-L · fp8 · chunked — L=32: 485.38 MBSAME-L · fp8 · chunked — L=33: 485.38 MBSAME-L · fp8 · chunked — L=63: 485.38 MBSAME-L · fp8 · chunked — L=64: 485.38 MBSAME-L · fp8 · chunked — L=127: 485.38 MBSAME-L · fp8 · chunked — L=128: 485.38 MBSAME-L · fp8 · chunked — L=255: 485.38 MBSAME-L · fp8 · chunked — L=256: 485.38 MBSAME-L · fp8 · chunked — L=257: 485.38 MBSAME-L · fp8 · chunked — L=511: 485.38 MBSAME-L · fp8 · chunked — L=512: 485.38 MBSAME-L · fp8 · chunked — L=1023: 485.38 MBSAME-L · fp8 · chunked — L=1024: 485.38 MBSAME-L · fp8 · chunked — L=1291: 485.38 MBSAME-L · fp8 · chunked — L=1292: 485.38 MBSAME-L · fp8 · chunked — L=2047: 485.38 MBSAME-L · fp8 · chunked — L=2048: 485.38 MBSAME-L · fp8 · chunked — L=4095: 485.38 MBSAME-L · fp8 · chunked — L=4096: 485.38 MBSAME-L · fp8 · chunked — L=4097: 485.38 MBSAME-L · fp8 · chunked — L=6144: 485.38 MBSAME-L · fp8 · chunked — L=8192: 485.38 MBSAME-L · fp8 · single-shot — L=1: 7,766.00 MBSAME-L · fp8 · single-shot — L=2: 7,766.00 MBSAME-L · fp8 · single-shot — L=3: 7,766.00 MBSAME-L · fp8 · single-shot — L=4: 7,766.00 MBSAME-L · fp8 · single-shot — L=7: 7,766.00 MBSAME-L · fp8 · single-shot — L=8: 7,766.00 MBSAME-L · fp8 · single-shot — L=15: 7,766.00 MBSAME-L · fp8 · single-shot — L=16: 7,766.00 MBSAME-L · fp8 · single-shot — L=17: 7,766.00 MBSAME-L · fp8 · single-shot — L=31: 7,766.00 MBSAME-L · fp8 · single-shot — L=32: 7,766.00 MBSAME-L · fp8 · single-shot — L=33: 7,766.00 MBSAME-L · fp8 · single-shot — L=63: 7,766.00 MBSAME-L · fp8 · single-shot — L=64: 7,766.00 MBSAME-L · fp8 · single-shot — L=127: 7,766.00 MBSAME-L · fp8 · single-shot — L=128: 7,766.00 MBSAME-L · fp8 · single-shot — L=255: 7,766.00 MBSAME-L · fp8 · single-shot — L=256: 7,766.00 MBSAME-L · fp8 · single-shot — L=257: 7,766.00 MBSAME-L · fp8 · single-shot — L=511: 7,766.00 MBSAME-L · fp8 · single-shot — L=512: 7,766.00 MBSAME-L · fp8 · single-shot — L=1023: 7,766.00 MBSAME-L · fp8 · single-shot — L=1024: 7,766.00 MBSAME-L · fp8 · single-shot — L=1291: 7,766.00 MBSAME-L · fp8 · single-shot — L=1292: 7,766.00 MBSAME-L · fp8 · single-shot — L=2047: 7,766.00 MBSAME-L · fp8 · single-shot — L=2048: 7,766.00 MBSAME-L · fp8 · single-shot — L=4095: 7,766.00 MBSAME-L · fp8 · single-shot — L=4096: 7,766.00 MBSAME-L · fp8 · single-shot — L=4097: 7,766.00 MBSAME-L · fp8 · single-shot — L=6144: 7,766.00 MBSAME-L · fp8 · single-shot — L=8192: 7,766.00 MBSAME-S · 16-bit · chunked — L=1: 346.13 MBSAME-S · 16-bit · chunked — L=2: 346.13 MBSAME-S · 16-bit · chunked — L=3: 346.13 MBSAME-S · 16-bit · chunked — L=4: 346.13 MBSAME-S · 16-bit · chunked — L=7: 346.13 MBSAME-S · 16-bit · chunked — L=8: 346.13 MBSAME-S · 16-bit · chunked — L=15: 346.13 MBSAME-S · 16-bit · chunked — L=16: 346.13 MBSAME-S · 16-bit · chunked — L=17: 346.13 MBSAME-S · 16-bit · chunked — L=31: 346.13 MBSAME-S · 16-bit · chunked — L=32: 346.13 MBSAME-S · 16-bit · chunked — L=33: 346.13 MBSAME-S · 16-bit · chunked — L=63: 346.13 MBSAME-S · 16-bit · chunked — L=64: 346.13 MBSAME-S · 16-bit · chunked — L=127: 346.13 MBSAME-S · 16-bit · chunked — L=128: 346.13 MBSAME-S · 16-bit · chunked — L=255: 346.13 MBSAME-S · 16-bit · chunked — L=256: 346.13 MBSAME-S · 16-bit · chunked — L=257: 346.13 MBSAME-S · 16-bit · chunked — L=511: 346.13 MBSAME-S · 16-bit · chunked — L=512: 346.13 MBSAME-S · 16-bit · chunked — L=1023: 346.13 MBSAME-S · 16-bit · chunked — L=1024: 346.13 MBSAME-S · 16-bit · chunked — L=1291: 346.13 MBSAME-S · 16-bit · chunked — L=1292: 346.13 MBSAME-S · 16-bit · chunked — L=2047: 346.13 MBSAME-S · 16-bit · chunked — L=2048: 346.13 MBSAME-S · 16-bit · chunked — L=4095: 346.13 MBSAME-S · 16-bit · chunked — L=4096: 346.13 MBSAME-S · 16-bit · chunked — L=4097: 346.13 MBSAME-S · 16-bit · chunked — L=6144: 346.13 MBSAME-S · 16-bit · chunked — L=8192: 346.13 MBSAME-S · 16-bit · single-shot — L=1: 5,511.94 MBSAME-S · 16-bit · single-shot — L=2: 5,511.94 MBSAME-S · 16-bit · single-shot — L=3: 5,511.94 MBSAME-S · 16-bit · single-shot — L=4: 5,511.94 MBSAME-S · 16-bit · single-shot — L=7: 5,511.94 MBSAME-S · 16-bit · single-shot — L=8: 5,511.94 MBSAME-S · 16-bit · single-shot — L=15: 5,511.94 MBSAME-S · 16-bit · single-shot — L=16: 5,511.94 MBSAME-S · 16-bit · single-shot — L=17: 5,511.94 MBSAME-S · 16-bit · single-shot — L=31: 5,511.94 MBSAME-S · 16-bit · single-shot — L=32: 5,511.94 MBSAME-S · 16-bit · single-shot — L=33: 5,511.94 MBSAME-S · 16-bit · single-shot — L=63: 5,511.94 MBSAME-S · 16-bit · single-shot — L=64: 5,511.94 MBSAME-S · 16-bit · single-shot — L=127: 5,511.94 MBSAME-S · 16-bit · single-shot — L=128: 5,511.94 MBSAME-S · 16-bit · single-shot — L=255: 5,511.94 MBSAME-S · 16-bit · single-shot — L=256: 5,511.94 MBSAME-S · 16-bit · single-shot — L=257: 5,511.94 MBSAME-S · 16-bit · single-shot — L=511: 5,511.94 MBSAME-S · 16-bit · single-shot — L=512: 5,511.94 MBSAME-S · 16-bit · single-shot — L=1023: 5,511.94 MBSAME-S · 16-bit · single-shot — L=1024: 5,511.94 MBSAME-S · 16-bit · single-shot — L=1291: 5,511.94 MBSAME-S · 16-bit · single-shot — L=1292: 5,511.94 MBSAME-S · 16-bit · single-shot — L=2047: 5,511.94 MBSAME-S · 16-bit · single-shot — L=2048: 5,511.94 MBSAME-S · 16-bit · single-shot — L=4095: 5,511.94 MBSAME-S · 16-bit · single-shot — L=4096: 5,511.94 MBSAME-S · 16-bit · single-shot — L=4097: 5,511.94 MBSAME-S · 16-bit · single-shot — L=6144: 5,511.94 MBSAME-S · 16-bit · single-shot — L=8192: 5,511.94 MBSAME-S · fp8 · chunked — L=1: 326.78 MBSAME-S · fp8 · chunked — L=2: 326.78 MBSAME-S · fp8 · chunked — L=3: 326.78 MBSAME-S · fp8 · chunked — L=4: 326.78 MBSAME-S · fp8 · chunked — L=7: 326.78 MBSAME-S · fp8 · chunked — L=8: 326.78 MBSAME-S · fp8 · chunked — L=15: 326.78 MBSAME-S · fp8 · chunked — L=16: 326.78 MBSAME-S · fp8 · chunked — L=17: 326.78 MBSAME-S · fp8 · chunked — L=31: 326.78 MBSAME-S · fp8 · chunked — L=32: 326.78 MBSAME-S · fp8 · chunked — L=33: 326.78 MBSAME-S · fp8 · chunked — L=63: 326.78 MBSAME-S · fp8 · chunked — L=64: 326.78 MBSAME-S · fp8 · chunked — L=127: 326.78 MBSAME-S · fp8 · chunked — L=128: 326.78 MBSAME-S · fp8 · chunked — L=255: 326.78 MBSAME-S · fp8 · chunked — L=256: 326.78 MBSAME-S · fp8 · chunked — L=257: 326.78 MBSAME-S · fp8 · chunked — L=511: 326.78 MBSAME-S · fp8 · chunked — L=512: 326.78 MBSAME-S · fp8 · chunked — L=1023: 326.78 MBSAME-S · fp8 · chunked — L=1024: 326.78 MBSAME-S · fp8 · chunked — L=1291: 326.78 MBSAME-S · fp8 · chunked — L=1292: 326.78 MBSAME-S · fp8 · chunked — L=2047: 326.78 MBSAME-S · fp8 · chunked — L=2048: 326.78 MBSAME-S · fp8 · chunked — L=4095: 326.78 MBSAME-S · fp8 · chunked — L=4096: 326.78 MBSAME-S · fp8 · chunked — L=4097: 326.78 MBSAME-S · fp8 · chunked — L=6144: 326.78 MBSAME-S · fp8 · chunked — L=8192: 326.78 MBSAME-S · fp8 · single-shot — L=1: 5,203.84 MBSAME-S · fp8 · single-shot — L=2: 5,203.84 MBSAME-S · fp8 · single-shot — L=3: 5,203.84 MBSAME-S · fp8 · single-shot — L=4: 5,203.84 MBSAME-S · fp8 · single-shot — L=7: 5,203.84 MBSAME-S · fp8 · single-shot — L=8: 5,203.84 MBSAME-S · fp8 · single-shot — L=15: 5,203.84 MBSAME-S · fp8 · single-shot — L=16: 5,203.84 MBSAME-S · fp8 · single-shot — L=17: 5,203.84 MBSAME-S · fp8 · single-shot — L=31: 5,203.84 MBSAME-S · fp8 · single-shot — L=32: 5,203.84 MBSAME-S · fp8 · single-shot — L=33: 5,203.84 MBSAME-S · fp8 · single-shot — L=63: 5,203.84 MBSAME-S · fp8 · single-shot — L=64: 5,203.84 MBSAME-S · fp8 · single-shot — L=127: 5,203.84 MBSAME-S · fp8 · single-shot — L=128: 5,203.84 MBSAME-S · fp8 · single-shot — L=255: 5,203.84 MBSAME-S · fp8 · single-shot — L=256: 5,203.84 MBSAME-S · fp8 · single-shot — L=257: 5,203.84 MBSAME-S · fp8 · single-shot — L=511: 5,203.84 MBSAME-S · fp8 · single-shot — L=512: 5,203.84 MBSAME-S · fp8 · single-shot — L=1023: 5,203.84 MBSAME-S · fp8 · single-shot — L=1024: 5,203.84 MBSAME-S · fp8 · single-shot — L=1291: 5,203.84 MBSAME-S · fp8 · single-shot — L=1292: 5,203.84 MBSAME-S · fp8 · single-shot — L=2047: 5,203.84 MBSAME-S · fp8 · single-shot — L=2048: 5,203.84 MBSAME-S · fp8 · single-shot — L=4095: 5,203.84 MBSAME-S · fp8 · single-shot — L=4096: 5,203.84 MBSAME-S · fp8 · single-shot — L=4097: 5,203.84 MBSAME-S · fp8 · single-shot — L=6144: 5,203.84 MBSAME-S · fp8 · single-shot — L=8192: 5,203.84 MB
SAME-L · 16-bit · chunkedSAME-L · 16-bit · single-shotSAME-L · fp8 · chunkedSAME-L · fp8 · single-shotSAME-S · 16-bit · chunkedSAME-S · 16-bit · single-shotSAME-S · fp8 · chunkedSAME-S · fp8 · single-shot

Decoder — latency

125102050100200500141664256102440968192latent length L  (L×4096 samples ≈ L×0.093 s)milliseconds (log)SAME-L · 16-bit · chunked — L=1: 1.56 msSAME-L · 16-bit · chunked — L=2: 1.54 msSAME-L · 16-bit · chunked — L=3: 1.60 msSAME-L · 16-bit · chunked — L=4: 1.48 msSAME-L · 16-bit · chunked — L=7: 1.52 msSAME-L · 16-bit · chunked — L=8: 1.63 msSAME-L · 16-bit · chunked — L=15: 1.72 msSAME-L · 16-bit · chunked — L=16: 2.17 msSAME-L · 16-bit · chunked — L=17: 2.19 msSAME-L · 16-bit · chunked — L=31: 2.94 msSAME-L · 16-bit · chunked — L=32: 2.98 msSAME-L · 16-bit · chunked — L=33: 2.99 msSAME-L · 16-bit · chunked — L=63: 4.17 msSAME-L · 16-bit · chunked — L=64: 4.15 msSAME-L · 16-bit · chunked — L=127: 6.94 msSAME-L · 16-bit · chunked — L=128: 6.95 msSAME-L · 16-bit · chunked — L=255: 12.47 msSAME-L · 16-bit · chunked — L=256: 12.26 msSAME-L · 16-bit · chunked — L=257: 30.64 msSAME-L · 16-bit · chunked — L=511: 49.14 msSAME-L · 16-bit · chunked — L=512: 50.02 msSAME-L · 16-bit · chunked — L=1023: 78.92 msSAME-L · 16-bit · chunked — L=1024: 78.97 msSAME-L · 16-bit · chunked — L=1291: 96.40 msSAME-L · 16-bit · chunked — L=1292: 96.50 msSAME-L · 16-bit · chunked — L=2047: 142.81 msSAME-L · 16-bit · chunked — L=2048: 143.84 msSAME-L · 16-bit · chunked — L=4095: 248.59 msSAME-L · 16-bit · chunked — L=4096: 249.96 msSAME-L · 16-bit · chunked — L=4097: 261.41 msSAME-L · 16-bit · chunked — L=6144: 369.39 msSAME-L · 16-bit · chunked — L=8192: 484.35 msSAME-L · 16-bit · single-shot — L=1: 1.68 msSAME-L · 16-bit · single-shot — L=2: 1.67 msSAME-L · 16-bit · single-shot — L=3: 1.66 msSAME-L · 16-bit · single-shot — L=4: 1.67 msSAME-L · 16-bit · single-shot — L=7: 1.73 msSAME-L · 16-bit · single-shot — L=8: 1.86 msSAME-L · 16-bit · single-shot — L=15: 1.94 msSAME-L · 16-bit · single-shot — L=16: 2.40 msSAME-L · 16-bit · single-shot — L=17: 2.39 msSAME-L · 16-bit · single-shot — L=31: 2.87 msSAME-L · 16-bit · single-shot — L=32: 2.90 msSAME-L · 16-bit · single-shot — L=33: 2.91 msSAME-L · 16-bit · single-shot — L=63: 4.10 msSAME-L · 16-bit · single-shot — L=64: 4.09 msSAME-L · 16-bit · single-shot — L=127: 6.62 msSAME-L · 16-bit · single-shot — L=128: 6.61 msSAME-L · 16-bit · single-shot — L=255: 12.55 msSAME-L · 16-bit · single-shot — L=256: 12.46 msSAME-L · 16-bit · single-shot — L=257: 12.73 msSAME-L · 16-bit · single-shot — L=511: 23.71 msSAME-L · 16-bit · single-shot — L=512: 23.68 msSAME-L · 16-bit · single-shot — L=1023: 49.25 msSAME-L · 16-bit · single-shot — L=1024: 47.76 msSAME-L · 16-bit · single-shot — L=1291: 61.52 msSAME-L · 16-bit · single-shot — L=1292: 61.47 msSAME-L · 16-bit · single-shot — L=2047: 96.99 msSAME-L · 16-bit · single-shot — L=2048: 97.91 msSAME-L · 16-bit · single-shot — L=4095: 194.38 msSAME-L · 16-bit · single-shot — L=4096: 195.56 msSAME-L · fp8 · chunked — L=1: 1.54 msSAME-L · fp8 · chunked — L=2: 1.55 msSAME-L · fp8 · chunked — L=3: 1.53 msSAME-L · fp8 · chunked — L=4: 1.50 msSAME-L · fp8 · chunked — L=7: 1.54 msSAME-L · fp8 · chunked — L=8: 1.61 msSAME-L · fp8 · chunked — L=15: 1.69 msSAME-L · fp8 · chunked — L=16: 2.15 msSAME-L · fp8 · chunked — L=17: 2.07 msSAME-L · fp8 · chunked — L=31: 2.67 msSAME-L · fp8 · chunked — L=32: 2.68 msSAME-L · fp8 · chunked — L=33: 2.74 msSAME-L · fp8 · chunked — L=63: 3.80 msSAME-L · fp8 · chunked — L=64: 3.77 msSAME-L · fp8 · chunked — L=127: 6.23 msSAME-L · fp8 · chunked — L=128: 6.24 msSAME-L · fp8 · chunked — L=255: 11.03 msSAME-L · fp8 · chunked — L=256: 11.14 msSAME-L · fp8 · chunked — L=257: 27.37 msSAME-L · fp8 · chunked — L=511: 43.73 msSAME-L · fp8 · chunked — L=512: 44.25 msSAME-L · fp8 · chunked — L=1023: 69.24 msSAME-L · fp8 · chunked — L=1024: 70.18 msSAME-L · fp8 · chunked — L=1291: 83.78 msSAME-L · fp8 · chunked — L=1292: 84.06 msSAME-L · fp8 · chunked — L=2047: 125.69 msSAME-L · fp8 · chunked — L=2048: 126.53 msSAME-L · fp8 · chunked — L=4095: 215.69 msSAME-L · fp8 · chunked — L=4096: 216.45 msSAME-L · fp8 · chunked — L=4097: 228.33 msSAME-L · fp8 · chunked — L=6144: 325.97 msSAME-L · fp8 · chunked — L=8192: 424.96 msSAME-L · fp8 · single-shot — L=1: 1.53 msSAME-L · fp8 · single-shot — L=2: 1.54 msSAME-L · fp8 · single-shot — L=3: 1.53 msSAME-L · fp8 · single-shot — L=4: 1.53 msSAME-L · fp8 · single-shot — L=7: 1.57 msSAME-L · fp8 · single-shot — L=8: 1.68 msSAME-L · fp8 · single-shot — L=15: 1.77 msSAME-L · fp8 · single-shot — L=16: 2.10 msSAME-L · fp8 · single-shot — L=17: 2.11 msSAME-L · fp8 · single-shot — L=31: 2.60 msSAME-L · fp8 · single-shot — L=32: 2.64 msSAME-L · fp8 · single-shot — L=33: 2.69 msSAME-L · fp8 · single-shot — L=63: 3.68 msSAME-L · fp8 · single-shot — L=64: 3.69 msSAME-L · fp8 · single-shot — L=127: 5.97 msSAME-L · fp8 · single-shot — L=128: 5.95 msSAME-L · fp8 · single-shot — L=255: 11.06 msSAME-L · fp8 · single-shot — L=256: 11.08 msSAME-L · fp8 · single-shot — L=257: 11.45 msSAME-L · fp8 · single-shot — L=511: 21.07 msSAME-L · fp8 · single-shot — L=512: 21.15 msSAME-L · fp8 · single-shot — L=1023: 42.99 msSAME-L · fp8 · single-shot — L=1024: 41.93 msSAME-L · fp8 · single-shot — L=1291: 53.95 msSAME-L · fp8 · single-shot — L=1292: 54.30 msSAME-L · fp8 · single-shot — L=2047: 86.13 msSAME-L · fp8 · single-shot — L=2048: 85.80 msSAME-L · fp8 · single-shot — L=4095: 171.93 msSAME-L · fp8 · single-shot — L=4096: 172.61 msSAME-S · 16-bit · chunked — L=1: 0.73 msSAME-S · 16-bit · chunked — L=2: 0.73 msSAME-S · 16-bit · chunked — L=3: 0.73 msSAME-S · 16-bit · chunked — L=4: 0.73 msSAME-S · 16-bit · chunked — L=7: 0.76 msSAME-S · 16-bit · chunked — L=8: 0.75 msSAME-S · 16-bit · chunked — L=15: 0.78 msSAME-S · 16-bit · chunked — L=16: 0.77 msSAME-S · 16-bit · chunked — L=17: 0.79 msSAME-S · 16-bit · chunked — L=31: 0.86 msSAME-S · 16-bit · chunked — L=32: 0.88 msSAME-S · 16-bit · chunked — L=33: 0.87 msSAME-S · 16-bit · chunked — L=63: 1.01 msSAME-S · 16-bit · chunked — L=64: 1.01 msSAME-S · 16-bit · chunked — L=127: 1.28 msSAME-S · 16-bit · chunked — L=128: 1.29 msSAME-S · 16-bit · chunked — L=255: 1.99 msSAME-S · 16-bit · chunked — L=256: 1.99 msSAME-S · 16-bit · chunked — L=257: 6.06 msSAME-S · 16-bit · chunked — L=511: 9.08 msSAME-S · 16-bit · chunked — L=512: 9.02 msSAME-S · 16-bit · chunked — L=1023: 13.78 msSAME-S · 16-bit · chunked — L=1024: 13.76 msSAME-S · 16-bit · chunked — L=1291: 16.36 msSAME-S · 16-bit · chunked — L=1292: 16.33 msSAME-S · 16-bit · chunked — L=2047: 23.26 msSAME-S · 16-bit · chunked — L=2048: 23.22 msSAME-S · 16-bit · chunked — L=4095: 39.20 msSAME-S · 16-bit · chunked — L=4096: 39.26 msSAME-S · 16-bit · chunked — L=4097: 42.31 msSAME-S · 16-bit · chunked — L=6144: 60.01 msSAME-S · 16-bit · chunked — L=8192: 80.77 msSAME-S · 16-bit · single-shot — L=1: 0.90 msSAME-S · 16-bit · single-shot — L=2: 0.89 msSAME-S · 16-bit · single-shot — L=3: 0.89 msSAME-S · 16-bit · single-shot — L=4: 0.89 msSAME-S · 16-bit · single-shot — L=7: 0.92 msSAME-S · 16-bit · single-shot — L=8: 0.91 msSAME-S · 16-bit · single-shot — L=15: 0.95 msSAME-S · 16-bit · single-shot — L=16: 0.95 msSAME-S · 16-bit · single-shot — L=17: 0.97 msSAME-S · 16-bit · single-shot — L=31: 1.03 msSAME-S · 16-bit · single-shot — L=32: 1.03 msSAME-S · 16-bit · single-shot — L=33: 1.03 msSAME-S · 16-bit · single-shot — L=63: 1.17 msSAME-S · 16-bit · single-shot — L=64: 1.18 msSAME-S · 16-bit · single-shot — L=127: 1.47 msSAME-S · 16-bit · single-shot — L=128: 1.47 msSAME-S · 16-bit · single-shot — L=255: 2.21 msSAME-S · 16-bit · single-shot — L=256: 2.16 msSAME-S · 16-bit · single-shot — L=257: 2.20 msSAME-S · 16-bit · single-shot — L=511: 3.42 msSAME-S · 16-bit · single-shot — L=512: 3.41 msSAME-S · 16-bit · single-shot — L=1023: 6.31 msSAME-S · 16-bit · single-shot — L=1024: 6.32 msSAME-S · 16-bit · single-shot — L=1291: 7.76 msSAME-S · 16-bit · single-shot — L=1292: 7.84 msSAME-S · 16-bit · single-shot — L=2047: 11.96 msSAME-S · 16-bit · single-shot — L=2048: 12.14 msSAME-S · 16-bit · single-shot — L=4095: 23.70 msSAME-S · 16-bit · single-shot — L=4096: 23.71 msSAME-S · fp8 · chunked — L=1: 0.71 msSAME-S · fp8 · chunked — L=2: 0.71 msSAME-S · fp8 · chunked — L=3: 0.71 msSAME-S · fp8 · chunked — L=4: 0.72 msSAME-S · fp8 · chunked — L=7: 0.73 msSAME-S · fp8 · chunked — L=8: 0.74 msSAME-S · fp8 · chunked — L=15: 0.77 msSAME-S · fp8 · chunked — L=16: 0.76 msSAME-S · fp8 · chunked — L=17: 0.75 msSAME-S · fp8 · chunked — L=31: 0.84 msSAME-S · fp8 · chunked — L=32: 0.83 msSAME-S · fp8 · chunked — L=33: 0.86 msSAME-S · fp8 · chunked — L=63: 0.97 msSAME-S · fp8 · chunked — L=64: 0.97 msSAME-S · fp8 · chunked — L=127: 1.23 msSAME-S · fp8 · chunked — L=128: 1.25 msSAME-S · fp8 · chunked — L=255: 1.85 msSAME-S · fp8 · chunked — L=256: 1.85 msSAME-S · fp8 · chunked — L=257: 5.85 msSAME-S · fp8 · chunked — L=511: 8.52 msSAME-S · fp8 · chunked — L=512: 8.46 msSAME-S · fp8 · chunked — L=1023: 13.02 msSAME-S · fp8 · chunked — L=1024: 12.93 msSAME-S · fp8 · chunked — L=1291: 15.32 msSAME-S · fp8 · chunked — L=1292: 15.28 msSAME-S · fp8 · chunked — L=2047: 21.71 msSAME-S · fp8 · chunked — L=2048: 21.61 msSAME-S · fp8 · chunked — L=4095: 36.79 msSAME-S · fp8 · chunked — L=4096: 36.68 msSAME-S · fp8 · chunked — L=4097: 39.53 msSAME-S · fp8 · chunked — L=6144: 56.32 msSAME-S · fp8 · chunked — L=8192: 73.98 msSAME-S · fp8 · single-shot — L=1: 0.86 msSAME-S · fp8 · single-shot — L=2: 0.85 msSAME-S · fp8 · single-shot — L=3: 0.86 msSAME-S · fp8 · single-shot — L=4: 0.86 msSAME-S · fp8 · single-shot — L=7: 0.87 msSAME-S · fp8 · single-shot — L=8: 0.87 msSAME-S · fp8 · single-shot — L=15: 0.91 msSAME-S · fp8 · single-shot — L=16: 0.90 msSAME-S · fp8 · single-shot — L=17: 0.90 msSAME-S · fp8 · single-shot — L=31: 0.99 msSAME-S · fp8 · single-shot — L=32: 1.00 msSAME-S · fp8 · single-shot — L=33: 0.99 msSAME-S · fp8 · single-shot — L=63: 1.10 msSAME-S · fp8 · single-shot — L=64: 1.12 msSAME-S · fp8 · single-shot — L=127: 1.36 msSAME-S · fp8 · single-shot — L=128: 1.50 msSAME-S · fp8 · single-shot — L=255: 1.99 msSAME-S · fp8 · single-shot — L=256: 1.99 msSAME-S · fp8 · single-shot — L=257: 1.99 msSAME-S · fp8 · single-shot — L=511: 3.07 msSAME-S · fp8 · single-shot — L=512: 3.04 msSAME-S · fp8 · single-shot — L=1023: 5.66 msSAME-S · fp8 · single-shot — L=1024: 5.72 msSAME-S · fp8 · single-shot — L=1291: 6.89 msSAME-S · fp8 · single-shot — L=1292: 6.89 msSAME-S · fp8 · single-shot — L=2047: 10.55 msSAME-S · fp8 · single-shot — L=2048: 10.48 msSAME-S · fp8 · single-shot — L=4095: 20.77 msSAME-S · fp8 · single-shot — L=4096: 20.41 ms
SAME-L · 16-bit · chunkedSAME-L · 16-bit · single-shotSAME-L · fp8 · chunkedSAME-L · fp8 · single-shotSAME-S · 16-bit · chunkedSAME-S · 16-bit · single-shotSAME-S · fp8 · chunkedSAME-S · fp8 · single-shot

Decoder — accuracy vs the original music, content held fixed

Same construction, decoder varying. Chunked and single-shot land on the same value to three decimals at every length, which is the direct evidence that the windowed overlap is exact.

2.783.173.563.954.344.735.121416642561024latent length L  (L×4096 samples ≈ L×0.093 s)reconstruction SNR (dB)SAME-L · 16-bit · chunked — L=1: 4.21 dBSAME-L · 16-bit · chunked — L=2: 4.74 dBSAME-L · 16-bit · chunked — L=4: 4.85 dBSAME-L · 16-bit · chunked — L=8: 4.89 dBSAME-L · 16-bit · chunked — L=16: 4.89 dBSAME-L · 16-bit · chunked — L=32: 4.89 dBSAME-L · 16-bit · chunked — L=64: 4.89 dBSAME-L · 16-bit · chunked — L=128: 4.89 dBSAME-L · 16-bit · chunked — L=256: 4.89 dBSAME-L · 16-bit · chunked — L=512: 4.89 dBSAME-L · 16-bit · chunked — L=1024: 4.89 dBSAME-L · 16-bit · chunked — L=2048: 4.89 dBSAME-L · 16-bit · single-shot — L=1: 4.21 dBSAME-L · 16-bit · single-shot — L=2: 4.74 dBSAME-L · 16-bit · single-shot — L=4: 4.85 dBSAME-L · 16-bit · single-shot — L=8: 4.89 dBSAME-L · 16-bit · single-shot — L=16: 4.89 dBSAME-L · 16-bit · single-shot — L=32: 4.89 dBSAME-L · 16-bit · single-shot — L=64: 4.89 dBSAME-L · 16-bit · single-shot — L=128: 4.89 dBSAME-L · 16-bit · single-shot — L=256: 4.89 dBSAME-L · 16-bit · single-shot — L=512: 4.89 dBSAME-L · 16-bit · single-shot — L=1024: 4.89 dBSAME-L · 16-bit · single-shot — L=2048: 4.89 dBSAME-L · fp8 · chunked — L=1: 4.20 dBSAME-L · fp8 · chunked — L=2: 4.72 dBSAME-L · fp8 · chunked — L=4: 4.83 dBSAME-L · fp8 · chunked — L=8: 4.88 dBSAME-L · fp8 · chunked — L=16: 4.87 dBSAME-L · fp8 · chunked — L=32: 4.87 dBSAME-L · fp8 · chunked — L=64: 4.87 dBSAME-L · fp8 · chunked — L=128: 4.87 dBSAME-L · fp8 · chunked — L=256: 4.87 dBSAME-L · fp8 · chunked — L=512: 4.87 dBSAME-L · fp8 · chunked — L=1024: 4.87 dBSAME-L · fp8 · chunked — L=2048: 4.87 dBSAME-L · fp8 · single-shot — L=1: 4.20 dBSAME-L · fp8 · single-shot — L=2: 4.72 dBSAME-L · fp8 · single-shot — L=4: 4.83 dBSAME-L · fp8 · single-shot — L=8: 4.88 dBSAME-L · fp8 · single-shot — L=16: 4.87 dBSAME-L · fp8 · single-shot — L=32: 4.87 dBSAME-L · fp8 · single-shot — L=64: 4.87 dBSAME-L · fp8 · single-shot — L=128: 4.87 dBSAME-L · fp8 · single-shot — L=256: 4.87 dBSAME-L · fp8 · single-shot — L=512: 4.87 dBSAME-L · fp8 · single-shot — L=1024: 4.87 dBSAME-L · fp8 · single-shot — L=2048: 4.87 dBSAME-S · 16-bit · chunked — L=1: 3.01 dBSAME-S · 16-bit · chunked — L=2: 3.70 dBSAME-S · 16-bit · chunked — L=4: 3.78 dBSAME-S · 16-bit · chunked — L=8: 3.82 dBSAME-S · 16-bit · chunked — L=16: 3.84 dBSAME-S · 16-bit · chunked — L=32: 3.85 dBSAME-S · 16-bit · chunked — L=64: 3.85 dBSAME-S · 16-bit · chunked — L=128: 3.85 dBSAME-S · 16-bit · chunked — L=256: 3.86 dBSAME-S · 16-bit · chunked — L=512: 3.86 dBSAME-S · 16-bit · chunked — L=1024: 3.86 dBSAME-S · 16-bit · chunked — L=2048: 3.86 dBSAME-S · 16-bit · single-shot — L=1: 3.01 dBSAME-S · 16-bit · single-shot — L=2: 3.70 dBSAME-S · 16-bit · single-shot — L=4: 3.78 dBSAME-S · 16-bit · single-shot — L=8: 3.82 dBSAME-S · 16-bit · single-shot — L=16: 3.84 dBSAME-S · 16-bit · single-shot — L=32: 3.85 dBSAME-S · 16-bit · single-shot — L=64: 3.85 dBSAME-S · 16-bit · single-shot — L=128: 3.85 dBSAME-S · 16-bit · single-shot — L=256: 3.86 dBSAME-S · 16-bit · single-shot — L=512: 3.86 dBSAME-S · 16-bit · single-shot — L=1024: 3.86 dBSAME-S · 16-bit · single-shot — L=2048: 3.86 dBSAME-S · fp8 · chunked — L=1: 2.97 dBSAME-S · fp8 · chunked — L=2: 3.66 dBSAME-S · fp8 · chunked — L=4: 3.73 dBSAME-S · fp8 · chunked — L=8: 3.77 dBSAME-S · fp8 · chunked — L=16: 3.78 dBSAME-S · fp8 · chunked — L=32: 3.79 dBSAME-S · fp8 · chunked — L=64: 3.80 dBSAME-S · fp8 · chunked — L=128: 3.80 dBSAME-S · fp8 · chunked — L=256: 3.80 dBSAME-S · fp8 · chunked — L=512: 3.80 dBSAME-S · fp8 · chunked — L=1024: 3.80 dBSAME-S · fp8 · chunked — L=2048: 3.80 dBSAME-S · fp8 · single-shot — L=1: 2.97 dBSAME-S · fp8 · single-shot — L=2: 3.66 dBSAME-S · fp8 · single-shot — L=4: 3.73 dBSAME-S · fp8 · single-shot — L=8: 3.77 dBSAME-S · fp8 · single-shot — L=16: 3.78 dBSAME-S · fp8 · single-shot — L=32: 3.79 dBSAME-S · fp8 · single-shot — L=64: 3.80 dBSAME-S · fp8 · single-shot — L=128: 3.80 dBSAME-S · fp8 · single-shot — L=256: 3.80 dBSAME-S · fp8 · single-shot — L=512: 3.80 dBSAME-S · fp8 · single-shot — L=1024: 3.80 dBSAME-S · fp8 · single-shot — L=2048: 3.80 dB
SAME-L · 16-bit · chunkedSAME-L · 16-bit · single-shotSAME-L · fp8 · chunkedSAME-L · fp8 · single-shotSAME-S · 16-bit · chunkedSAME-S · 16-bit · single-shotSAME-S · fp8 · chunkedSAME-S · fp8 · single-shot