Your smartphone might be better at running local LLMs than your PCβmine certainly is
Running a capable language model entirely offline used to mean owning a powerful desktop. That assumption no longer holds. On my hardware, a phone app from Google runs the same model noticeably faster than Ollama does on my PC, and the reasons are more interesting than you might expect.
