this post was submitted on 04 Mar 2026
233 points (92.1% liked)

Technology

82285 readers
4522 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] partial_accumen@lemmy.world 2 points 13 hours ago (1 child)

Tried the same thing in Asahi but without macOS’ memory management and access to GPU acceleration, it just wasn’t feasible.

Thank you for sharing this result. I knew Asahi's memory management wasn't as robust (so I got a 24GB RAM M2 unit to overcome this).

For your macOS Ollama implementation are you able to leverage the NPU in the hardware (which I know is also unavailable so far in Asahi)?

[–] djdarren@piefed.social 1 point 9 hours ago

I actually have no idea how it all works. It just does.

Asahi is incredible for general use computing on M1/2 machines, and perhaps even in use as a general purpose home server. But it's still very much a fun exercise in what might be possible rather than a solid option, in my opinion.