10-18-2026, 06:47 PM
Tried to reproduce it just now. On mini PC with TensorRT-LLM, I saw basically the same behavior. I expected the model choice to matter more than it did.
small models can still be good
|
Apple unified memory limits
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
Apple unified memory limits - by lablab - 10-14-2026, 12:01 AM
Re: Apple unified memory limits - by mellowstream - 10-14-2026, 04:14 AM
Re: Apple unified memory limits - by cobaltworks25 - 10-18-2026, 06:08 PM
Re: Apple unified memory limits - by circuitwire58 - 10-14-2026, 05:41 AM
Re: Apple unified memory limits - by quietarch - 10-17-2026, 06:43 PM
Re: Apple unified memory limits - by mlxgarden - 10-17-2026, 05:55 AM
Re: Apple unified memory limits - by cudacrate - 10-17-2026, 07:28 PM
Re: Apple unified memory limits - by mlxgarden - 10-18-2026, 07:43 AM
Re: Apple unified memory limits - by kernelrunner - 10-18-2026, 06:47 PM
|
Users browsing this thread: 1 Guest(s)