The best Hacker News stories from All from the past week

Go back

Latest posts:

What happens if an entire class of workers loses faith in their careers

AMD acquires Taalas to boost inference performance by etching models in silicon

<a href="https://ir.amd.com/news-events/press-releases/detail/1296/amd-acquires-taalas-to-advance-compute-solutions-for-rapidly-growing-ai-inference-market" rel="nofollow">https://ir.amd.com/news-events/press-releases/detail/1296/am...</a><p><a href="https://chatjimmy.ai/" rel="nofollow">https://chatjimmy.ai/</a>

US strikes $1.2B deal to pay German firm to halt offshore wind projects

Discovery Loop

Changes at Google DeepMind: Demis Hassabis from CEO to Chair, Jeff Dean departs

<a href="https://www.axios.com/2026/08/05/google-deepmind-demis-hassabis-ai" rel="nofollow">https://www.axios.com/2026/08/05/google-deepmind-demis-hassa...</a><p><a href="https://www.reuters.com/business/google-shakes-up-ai-leadership-deepmind-chief-shifts-role-2026-08-05/" rel="nofollow">https://www.reuters.com/business/google-shakes-up-ai-leaders...</a><p><a href="https://www.discoveryloop.com/" rel="nofollow">https://www.discoveryloop.com/</a>, <a href="https://news.ycombinator.com/item?id=49184960">https://news.ycombinator.com/item?id=49184960</a><p><a href="https://twitter.com/JeffDean/status/2085034604172603724" rel="nofollow">https://twitter.com/JeffDean/status/2085034604172603724</a>, <a href="https://xcancel.com/JeffDean/status/2085034604172603724" rel="nofollow">https://xcancel.com/JeffDean/status/2085034604172603724</a>

In Memory of My Wife, Elise Cawley, with Thanks for 36 Wonderful Years

LLMs reward expertise

Ten advances in mathematics and theoretical computer science

Qwen3.8-Max: A New Bar for Coding and Cowork

Don't be a meat proxy

Google fixed more Chrome bugs in June than over the past two years, thanks to AI

Show HN: Elevators

Read this before you buy that TV streaming stick

UEFA and its national associations will not participate in FIFA competitions

Superlogical

<a href="https://mitchellh.com/writing/superlogical" rel="nofollow">https://mitchellh.com/writing/superlogical</a>

Superlogical

<a href="https://mitchellh.com/writing/superlogical" rel="nofollow">https://mitchellh.com/writing/superlogical</a>

Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac

Hi HN,<p>I built a specialized inference engine for running 4-bit Gemma 4 26B-A4B-IT on any M-series Mac using about 2 GB of RAM. It is called TurboFieldfare and is written in Swift and Metal.<p>I have always adored on-device AI. It feels like magic that you can run a powerful NN on your Mac or iPhone. So I wanted to push the limits a bit and run a model whose weights don’t fit in memory.<p>The model’s 4-bit quantized weights occupy roughly 14 GB, which makes running it with conventional inference tools almost impossible on an 8 GB or even 16 GB Mac once the OS, applications, and KV cache are included.<p>The trick is to keep the shared part of the model and the KV cache in RAM, then stream only the routed experts needed for each token from SSD. An SSD is way slower than RAM, so the runtime uses a small expert cache and bounded parallel `pread`. While those reads are in flight, the GPU runs the shared part of the layer.<p>I ran more than 100 experiments. Most didn’t work. A few got me here. The experiments are described in the GitHub repo.<p>It currently generates 5–6 tok/s on an 8 GB M2 MacBook Air and 31–35 tok/s on an M5 MacBook Pro.<p>I also added an experimental OpenAI-compatible local server. It supports streaming and tool calls, and reuses one prompt prefix from the KV cache.<p>Try it! The Mac app is easy to install. On the first run, it will download 15 GB of weights from Hugging Face. The model is surprisingly capable.<p>I would love any kind of feedback!

Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac

Hi HN,<p>I built a specialized inference engine for running 4-bit Gemma 4 26B-A4B-IT on any M-series Mac using about 2 GB of RAM. It is called TurboFieldfare and is written in Swift and Metal.<p>I have always adored on-device AI. It feels like magic that you can run a powerful NN on your Mac or iPhone. So I wanted to push the limits a bit and run a model whose weights don’t fit in memory.<p>The model’s 4-bit quantized weights occupy roughly 14 GB, which makes running it with conventional inference tools almost impossible on an 8 GB or even 16 GB Mac once the OS, applications, and KV cache are included.<p>The trick is to keep the shared part of the model and the KV cache in RAM, then stream only the routed experts needed for each token from SSD. An SSD is way slower than RAM, so the runtime uses a small expert cache and bounded parallel `pread`. While those reads are in flight, the GPU runs the shared part of the layer.<p>I ran more than 100 experiments. Most didn’t work. A few got me here. The experiments are described in the GitHub repo.<p>It currently generates 5–6 tok/s on an 8 GB M2 MacBook Air and 31–35 tok/s on an M5 MacBook Pro.<p>I also added an experimental OpenAI-compatible local server. It supports streaming and tool calls, and reuses one prompt prefix from the KV cache.<p>Try it! The Mac app is easy to install. On the first run, it will download 15 GB of weights from Hugging Face. The model is surprisingly capable.<p>I would love any kind of feedback!

Our position on open-weights models

Our position on open-weights models

1 2 3 ... 171 172 173 >