Users browsing this forum: 1 Guest(s)
| Forums in 'Inference Engines' | ||||
| Forum | Threads | Posts | Last Post | |
| llama.cpp / GGUF | 48 | 465 |
context size vs speed in ...
10-19-2026, 05:58 AM by macroforge |
|
| vLLM / SGLang | 48 | 372 |
prefill/decode separation...
10-19-2026, 05:38 AM by oxidemixer |
|
| TensorRT-LLM | 32 | 282 |
when TensorRT-LLM clearly...
10-19-2026, 02:46 AM by batchcraft |
|
| Ollama / LM Studio / Desktop Runtimes | 32 | 251 |
desktop runtimes for non-...
10-19-2026, 03:35 AM by localcraft17 |
|
| Other Engines | 54 | 465 |
throughput per watt reali...
10-19-2026, 05:28 AM by kernelhouse70 |
|