+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: NVIDIA / CUDA (https://www.datasculpting.ai/inference/forumdisplay.php?fid=31)
+--- Thread: batching changes after update (/showthread.php?tid=316)
Pages:
1
2
Re: batching changes after update - thetapath - 09-26-2026
Appreciate the detail. The pattern around INT4 has been pretty similar for me.
Re: batching changes after update - latentgarden - 09-27-2026
subscribed, curious where this lands.