tool calling reliability with PyTorch

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

tool calling reliability with PyTorch

mangopath4 Offline

Junior Member

Posts: 33
Threads: 4
Joined: Aug 2026
Reputation: 0

10-18-2026, 08:55 PM

Ran a quick check on my box. On A6000 with TensorRT-LLM, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.

Find

« Next Oldest | Next Newest »

Messages In This Thread

tool calling reliability with PyTorch - by fusedtinker - 10-16-2026, 04:00 AM

Re: tool calling reliability with PyTorch - by phasestream53 - 10-17-2026, 04:29 AM

Re: tool calling reliability with PyTorch - by rocmhouse90 - 10-18-2026, 05:02 PM

Re: tool calling reliability with PyTorch - by mangopath4 - 10-18-2026, 08:55 PM

Re: tool calling reliability with PyTorch - by turbogrid11 - 10-18-2026, 07:56 PM

Re: tool calling reliability with PyTorch - by torchtrack24 - 10-18-2026, 10:14 PM

Re: tool calling reliability with PyTorch - by fastlab - 10-18-2026, 10:15 PM

Re: tool calling reliability with PyTorch - by forgemixer - 10-19-2026, 12:06 AM

Re: tool calling reliability with PyTorch - by tensorport - 10-19-2026, 12:35 AM

Re: tool calling reliability with PyTorch - by griffinloom66 - 10-18-2026, 11:03 PM

Re: tool calling reliability with PyTorch - by quantsupply - 10-19-2026, 04:27 AM

Re: tool calling reliability with PyTorch - by batchfield55 - 10-19-2026, 05:17 AM

Re: tool calling reliability with PyTorch - by llmpeak - 10-19-2026, 05:24 AM

Re: tool calling reliability with PyTorch - by macropilot - 10-19-2026, 05:31 AM

Re: tool calling reliability with PyTorch - by routecrate - 10-19-2026, 12:01 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)

Login
Username:
Password:	Lost Password?
	Remember me

Sign in with X.com