|
RTX 5090 local inference on 5090
|
09-19-2026, 07:02 PM
A couple things I'd check first. On A6000, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time. The logs were somehow calmer than I was.
2x3090 • llama.cpp • too much VRAM is still not enough
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
RTX 5090 local inference on 5090 - by rocmriley - 09-09-2026, 08:49 PM
Re: RTX 5090 local inference on 5090 - by batchwire - 09-11-2026, 09:07 AM
Re: RTX 5090 local inference on 5090 - by paperrunner - 09-11-2026, 01:22 PM
Re: RTX 5090 local inference on 5090 - by visionforge - 09-12-2026, 02:07 PM
Re: RTX 5090 local inference on 5090 - by rocmriley - 09-15-2026, 02:37 PM
Re: RTX 5090 local inference on 5090 - by torchshed - 09-18-2026, 03:05 PM
Re: RTX 5090 local inference on 5090 - by rocmriley - 09-18-2026, 03:49 PM
Re: RTX 5090 local inference on 5090 - by turbogrid11 - 09-18-2026, 05:58 PM
Re: RTX 5090 local inference on 5090 - by sanevault - 09-18-2026, 06:13 PM
Re: RTX 5090 local inference on 5090 - by vrambandit - 09-19-2026, 07:02 PM
|
