Your smartphone might be better at running local LLMs than your PC—mine certainly is

Posted

Running a capable language model entirely offline used to mean owning a powerful desktop. That assumption no longer holds. On my hardware, a phone app from Google runs the same model noticeably faster than Ollama does on my PC, and the reasons are more interesting than you might expect.



Continue reading at How-to Geek »

AI & Machine Learning, Android Phones & Tablets, ai, Google