latency vs throughput for small deployments on 7900 XTX

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

latency vs throughput for small deployments on 7900 XTX

kernelmike Offline

Offline

Member

Posts: 184
Threads: 23
Joined: Sep 2026
Reputation: 0

#2

09-08-2026, 06:46 PM

What exact setup are you running? What model, what runtime, and roughly what context size?

Mostly CUDA, sometimes wrong, usually measured

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

latency vs throughput for small deployments on 7900 XTX - by bytestack - 09-08-2026, 06:03 PM

Re: latency vs throughput for small deployments on 7900 XTX - by kernelmike - 09-08-2026, 06:46 PM

Re: latency vs throughput for small deployments on 7900 XTX - by rasterpoint - 09-08-2026, 09:29 PM

Re: latency vs throughput for small deployments on 7900 XTX - by edgeriver - 09-08-2026, 08:19 PM

Re: latency vs throughput for small deployments on 7900 XTX - by batchscope72 - 09-08-2026, 09:04 PM

Re: latency vs throughput for small deployments on 7900 XTX - by kernelrunner - 09-13-2026, 04:25 AM

Re: latency vs throughput for small deployments on 7900 XTX - by tensorfield88 - 09-10-2026, 10:09 AM

Re: latency vs throughput for small deployments on 7900 XTX - by sparrowshed - 09-10-2026, 02:22 PM

Re: latency vs throughput for small deployments on 7900 XTX - by tensorfield88 - 09-12-2026, 02:46 AM

Re: latency vs throughput for small deployments on 7900 XTX - by kernelmike - 09-13-2026, 02:59 AM

Re: latency vs throughput for small deployments on 7900 XTX - by localpatch - 09-13-2026, 03:53 AM

Re: latency vs throughput for small deployments on 7900 XTX - by cudaworks - 09-13-2026, 01:07 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)