|
quant support gaps
|
10-11-2026, 01:24 AM
Quote:I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher. Thanks, that helps. I ended up in about the same place using PyTorch. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
7900 XTX / ROCm / somehow still optimistic
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
quant support gaps - by sysstation69 - 10-09-2026, 05:24 AM
Re: quant support gaps - by routeforge64 - 10-09-2026, 06:12 AM
Re: quant support gaps - by batchcraft - 10-10-2026, 11:06 PM
Re: quant support gaps - by kernelgrid - 10-09-2026, 10:33 AM
Re: quant support gaps - by torchtrack24 - 10-13-2026, 07:41 AM
Re: quant support gaps - by routecrate - 10-11-2026, 12:04 AM
Re: quant support gaps - by torchtrack24 - 10-11-2026, 12:29 AM
Re: quant support gaps - by rocmriley - 10-11-2026, 01:24 AM
Re: quant support gaps - by batchscope72 - 10-11-2026, 05:41 AM
Re: quant support gaps - by sysstation69 - 10-11-2026, 06:14 PM
Re: quant support gaps - by ggufvault - 10-13-2026, 06:58 AM
|
