CPU-only fallback performance for Gemma

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

CPU-only fallback performance for Gemma

localpatch78 Offline

Offline

Junior Member

Posts: 37
Threads: 3
Joined: Sep 2026
Reputation: 0

#2

09-05-2026, 12:14 AM

That matches what I was seeing. The pattern around INT4 has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.

I'm happy to test one more variant if you want a second data point.

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

CPU-only fallback performance for Gemma - by batchsize - 09-04-2026, 10:30 PM

Re: CPU-only fallback performance for Gemma - by localpatch78 - 09-05-2026, 12:14 AM

Re: CPU-only fallback performance for Gemma - by routearch - 09-05-2026, 01:06 AM

Re: CPU-only fallback performance for Gemma - by fastlab - 09-05-2026, 12:26 AM

Re: CPU-only fallback performance for Gemma - by torchsmith25 - 09-05-2026, 01:21 PM

Re: CPU-only fallback performance for Gemma - by macrotinker - 09-07-2026, 06:18 AM

Re: CPU-only fallback performance for Gemma - by thetapath - 09-05-2026, 02:42 PM

Re: CPU-only fallback performance for Gemma - by dockriver - 09-05-2026, 03:38 PM

Re: CPU-only fallback performance for Gemma - by vectorfield - 09-05-2026, 04:19 PM

Re: CPU-only fallback performance for Gemma - by northgrid33 - 09-05-2026, 05:01 PM

Re: CPU-only fallback performance for Gemma - by mangohouse - 09-06-2026, 05:45 PM

Re: CPU-only fallback performance for Gemma - by vramscope - 09-07-2026, 10:18 AM

Re: CPU-only fallback performance for Gemma - by quietsupply11 - 09-08-2026, 10:57 AM

Re: CPU-only fallback performance for Gemma - by circuitkite - 09-08-2026, 07:42 PM

Re: CPU-only fallback performance for Gemma - by vramridge - 09-09-2026, 07:59 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)