Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
long context that stayed useful: what are you seeing?
#1
Spent some time on this today and wanted to compare notes.

I've gone back and forth between PyTorch and LM Studio for Llama. The interesting difference for me has been speculative decoding.

Interested in tradeoffs more than fan loyalty.
Reply


Messages In This Thread
long context that stayed useful: what are you seeing? - by tensorriver - 10-17-2026, 04:42 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)