The best Hacker News stories from All from the past day
Latest posts:
Ask HN: How can ChatGPT serve 700M users when I can't run one GPT-4 locally?
Sam said yesterday that chatgpt handles ~700M weekly users. Meanwhile, I can't even run a single GPT-4-class model locally without insane VRAM or painfully slow speeds.<p>Sure, they have huge GPU clusters, but there must be more going on - model optimizations, sharding, custom hardware, clever load balancing, etc.<p>What engineering tricks make this possible at such massive scale while keeping latency low?<p>Curious to hear insights from people who've built large-scale ML systems.
Food, housing, & health care costs are a source of major stress for many people
I want everything local – Building my offline AI workspace
I want everything local – Building my offline AI workspace
Ultrathin business card runs a fluid simulation
Ultrathin business card runs a fluid simulation
Windows XP Professional
Flipper Zero dark web firmware bypasses rolling code security
flipper zero implementation of a variant [1] of the rolljam [2] attack<p>[1] <a href="https://arxiv.org/abs/2210.11923" rel="nofollow">https://arxiv.org/abs/2210.11923</a><p>[2] <a href="https://news.ycombinator.com/item?id=10018934">https://news.ycombinator.com/item?id=10018934</a>
Project Hyperion: Interstellar ship design competition
GPT-5 for Developers
GPT-5 for Developers
GPT-5: Key characteristics, pricing and system card
System card: <a href="https://cdn.openai.com/pdf/8124a3ce-ab78-4f06-96eb-49ea29ffb52f/gpt5-system-card-aug7.pdf" rel="nofollow">https://cdn.openai.com/pdf/8124a3ce-ab78-4f06-96eb-49ea29ffb...</a>
GPT-5: Key characteristics, pricing and system card
System card: <a href="https://cdn.openai.com/pdf/8124a3ce-ab78-4f06-96eb-49ea29ffb52f/gpt5-system-card-aug7.pdf" rel="nofollow">https://cdn.openai.com/pdf/8124a3ce-ab78-4f06-96eb-49ea29ffb...</a>
Vibechart
Vibechart
Emailing a one-time code is worse than passwords
GPT-5
<a href="https://www.youtube.com/watch?v=0Uu_VJeVVfo" rel="nofollow">https://www.youtube.com/watch?v=0Uu_VJeVVfo</a>
GPT-5
<a href="https://www.youtube.com/watch?v=0Uu_VJeVVfo" rel="nofollow">https://www.youtube.com/watch?v=0Uu_VJeVVfo</a>
Japan: Apple Must Lift Browser Engine Ban by December
Scientific fraud has become an 'industry,' analysis finds