The best Hacker News stories from All from the past day
Latest posts:
The anatomy of a 2AM mental breakdown
MIT leaders describe the experience of not renewing Elsevier contract
MIT leaders describe the experience of not renewing Elsevier contract
Data Exfiltration from Slack AI via indirect prompt injection
Data Exfiltration from Slack AI via indirect prompt injection
Toasts are bad UX
Toasts are bad UX
Artificial intelligence is losing hype
Launch HN: Sorcerer (YC S24) – Weather balloons that collect more data
Hey HN! We’re Max, Alex, and Austin, the team behind Sorcerer (<a href="https://sorcerer.earth">https://sorcerer.earth</a>). Sorcerer builds weather balloons that last for over six months, collecting 1000x more data per dollar and reaching previously inaccessible regions.<p>In 1981, weather disasters caused $3.5 billion in damages in the United States. In 2023, that number was $94.9 billion (<a href="https://www.ncei.noaa.gov/access/billions/time-series" rel="nofollow">https://www.ncei.noaa.gov/access/billions/time-series</a>). The National Weather Service spends billions annually on its network of weather balloons, satellites, and aircraft sensors – generating hundreds of terabytes of data every day. This data, called observation data, is fed into massive supercomputers running advanced physics to produce global weather forecasts. Despite this cost, there are still places in the US where we don't know what the temperature will be two days from now: <a href="https://www.washingtonpost.com/climate-environment/interactive/2024/how-accurate-is-the-weather-forecast/" rel="nofollow">https://www.washingtonpost.com/climate-environment/interacti...</a>. And for the rest of the world that lacks weather infrastructure? There’s always the Weather Rock: <a href="https://en.wikipedia.org/wiki/Weather_rock" rel="nofollow">https://en.wikipedia.org/wiki/Weather_rock</a>.<p>The most important data for these forecasts come from vertical data ‘slices’ of the atmosphere, called soundings. Every day 2,500 single-use latex radiosondes are launched across the globe to collect these soundings. They stay aloft for about two hours before popping and falling back to Earth. Launch sites for these systems are sparse in Latin America and Africa, and they’re completely non-existent over oceans. This leaves about 80% of the globe with inadequate weather data for accurate predictions.<p>The coverage gap became painfully evident to Max and Alex during their time at Urban Sky. While building balloons for high-altitude aerial imaging, they kept running into a problem: no matter what weather forecast they used, they couldn’t get accurate wind predictions for the upper atmosphere. They tried all of the free and commercial forecast products, but none of them were accurate enough. Digging into it more, we learned that a big part of the problem was the lack of high-quality in-situ data at those altitudes.<p>To solve this problem, our systems ascend and descend between sea level and 65,000ft several times a day to collect vertical data soundings. Each vehicle (balloon + payload) weighs less than a pound and can be launched from anywhere in the world, per the FAA and ICAO reg. Here’s one we launched from Potrero Hill in SF, <a href="https://youtu.be/75fN5WpRWH0" rel="nofollow">https://youtu.be/75fN5WpRWH0</a> and here’s another near the Golden Gate Bridge, <a href="https://youtu.be/7yLmzLPUFVQ" rel="nofollow">https://youtu.be/7yLmzLPUFVQ</a>. Although we can’t “drive” these balloons laterally, we can use opposing wind layers to target or avoid specific regions. Here’s what a few simulated flight paths look like, to give you an idea: <a href="https://youtu.be/F_Di8cjaEUY" rel="nofollow">https://youtu.be/F_Di8cjaEUY</a><p>Our payload uses a satellite transceiver for communications and a small, thin film solar panel array to generate power. In addition to the weather data, we also get real-time telemetry from the vehicles, which we use to optimize their flight paths. This includes maintaining the optimal spacing between balloons and steering them to a recovery zone at the end of their lifespan so we can recycle them.<p>These systems spend most of their time in the stratosphere which is an extremely unforgiving environment. We’ll often see temperatures as low as -80°C while flying near the equator. Throughout the day, we experience extreme temperature cycling as they ascend and descend through the atmosphere. We’ll often encounter 100mph+ wind shears near the boundary with the troposphere (the tropopause) that can rip apart the balloon envelope. These conditions make the stratosphere a very difficult place to deploy to prod.<p>The real magic of what we’re building will come into play when we have hundreds of these systems in the air over data-sparse regions. But even now, we can do useful and interesting things with them. Some of our early customers are companies who fly very big, very expensive things into the stratosphere. They use our balloons to give them a clear idea of what conditions are ahead of their operations, and we’re working on a forecast product specifically designed for the stratosphere.<p>The combination of long duration and low cost is novel. We can theoretically maintain thousands of balloons in the atmosphere at any given time for a tenth of the cost of one useful weather satellite. We’re also using the data we collect to train AI models that produce forecasts with better accuracy than existing numerical (supercomputer) forecasts. Because we’re collecting totally unique data over areas that lack observation, our models will maintain a consistent edge versus models that are only trained on open data.<p>We’re really excited to be launching Sorcerer here with you! We’d love to hear what you think. And if you find one of our balloons in the Bay Area: Sorry! It’s still a work in progress (and please get it back to us).<p>I’ll leave you all with a bonus video of Paul Buchheit launching one of our balloons, which we thought was pretty cool: <a href="https://www.youtube.com/watch?v=-sngF9VvDzg" rel="nofollow">https://www.youtube.com/watch?v=-sngF9VvDzg</a>
Launch HN: Sorcerer (YC S24) – Weather balloons that collect more data
Hey HN! We’re Max, Alex, and Austin, the team behind Sorcerer (<a href="https://sorcerer.earth">https://sorcerer.earth</a>). Sorcerer builds weather balloons that last for over six months, collecting 1000x more data per dollar and reaching previously inaccessible regions.<p>In 1981, weather disasters caused $3.5 billion in damages in the United States. In 2023, that number was $94.9 billion (<a href="https://www.ncei.noaa.gov/access/billions/time-series" rel="nofollow">https://www.ncei.noaa.gov/access/billions/time-series</a>). The National Weather Service spends billions annually on its network of weather balloons, satellites, and aircraft sensors – generating hundreds of terabytes of data every day. This data, called observation data, is fed into massive supercomputers running advanced physics to produce global weather forecasts. Despite this cost, there are still places in the US where we don't know what the temperature will be two days from now: <a href="https://www.washingtonpost.com/climate-environment/interactive/2024/how-accurate-is-the-weather-forecast/" rel="nofollow">https://www.washingtonpost.com/climate-environment/interacti...</a>. And for the rest of the world that lacks weather infrastructure? There’s always the Weather Rock: <a href="https://en.wikipedia.org/wiki/Weather_rock" rel="nofollow">https://en.wikipedia.org/wiki/Weather_rock</a>.<p>The most important data for these forecasts come from vertical data ‘slices’ of the atmosphere, called soundings. Every day 2,500 single-use latex radiosondes are launched across the globe to collect these soundings. They stay aloft for about two hours before popping and falling back to Earth. Launch sites for these systems are sparse in Latin America and Africa, and they’re completely non-existent over oceans. This leaves about 80% of the globe with inadequate weather data for accurate predictions.<p>The coverage gap became painfully evident to Max and Alex during their time at Urban Sky. While building balloons for high-altitude aerial imaging, they kept running into a problem: no matter what weather forecast they used, they couldn’t get accurate wind predictions for the upper atmosphere. They tried all of the free and commercial forecast products, but none of them were accurate enough. Digging into it more, we learned that a big part of the problem was the lack of high-quality in-situ data at those altitudes.<p>To solve this problem, our systems ascend and descend between sea level and 65,000ft several times a day to collect vertical data soundings. Each vehicle (balloon + payload) weighs less than a pound and can be launched from anywhere in the world, per the FAA and ICAO reg. Here’s one we launched from Potrero Hill in SF, <a href="https://youtu.be/75fN5WpRWH0" rel="nofollow">https://youtu.be/75fN5WpRWH0</a> and here’s another near the Golden Gate Bridge, <a href="https://youtu.be/7yLmzLPUFVQ" rel="nofollow">https://youtu.be/7yLmzLPUFVQ</a>. Although we can’t “drive” these balloons laterally, we can use opposing wind layers to target or avoid specific regions. Here’s what a few simulated flight paths look like, to give you an idea: <a href="https://youtu.be/F_Di8cjaEUY" rel="nofollow">https://youtu.be/F_Di8cjaEUY</a><p>Our payload uses a satellite transceiver for communications and a small, thin film solar panel array to generate power. In addition to the weather data, we also get real-time telemetry from the vehicles, which we use to optimize their flight paths. This includes maintaining the optimal spacing between balloons and steering them to a recovery zone at the end of their lifespan so we can recycle them.<p>These systems spend most of their time in the stratosphere which is an extremely unforgiving environment. We’ll often see temperatures as low as -80°C while flying near the equator. Throughout the day, we experience extreme temperature cycling as they ascend and descend through the atmosphere. We’ll often encounter 100mph+ wind shears near the boundary with the troposphere (the tropopause) that can rip apart the balloon envelope. These conditions make the stratosphere a very difficult place to deploy to prod.<p>The real magic of what we’re building will come into play when we have hundreds of these systems in the air over data-sparse regions. But even now, we can do useful and interesting things with them. Some of our early customers are companies who fly very big, very expensive things into the stratosphere. They use our balloons to give them a clear idea of what conditions are ahead of their operations, and we’re working on a forecast product specifically designed for the stratosphere.<p>The combination of long duration and low cost is novel. We can theoretically maintain thousands of balloons in the atmosphere at any given time for a tenth of the cost of one useful weather satellite. We’re also using the data we collect to train AI models that produce forecasts with better accuracy than existing numerical (supercomputer) forecasts. Because we’re collecting totally unique data over areas that lack observation, our models will maintain a consistent edge versus models that are only trained on open data.<p>We’re really excited to be launching Sorcerer here with you! We’d love to hear what you think. And if you find one of our balloons in the Bay Area: Sorry! It’s still a work in progress (and please get it back to us).<p>I’ll leave you all with a bonus video of Paul Buchheit launching one of our balloons, which we thought was pretty cool: <a href="https://www.youtube.com/watch?v=-sngF9VvDzg" rel="nofollow">https://www.youtube.com/watch?v=-sngF9VvDzg</a>
Parsing protobuf at 2+GB/s: how I learned to love tail calls in C (2021)
Stripe's Monorepo Developer Environment
The gigantic and unregulated power plants in the cloud
Markov chains are funnier than LLMs
13ft – A site similar to 12ft.io but self-hosted
13ft – A site similar to 12ft.io but self-hosted
Roblox is the biggest game in the world, but is unprofitable
Show HN: PgQueuer – Transform PostgreSQL into a Job Queue
PgQueuer is a minimalist, high-performance job queue library for Python, leveraging the robustness of PostgreSQL. Designed for simplicity and efficiency, PgQueuer uses PostgreSQL's LISTEN/NOTIFY to manage job queues effortlessly.
Postmortem of my 9 year journey at Google
Dasel: Select, put and delete data from JSON, TOML, YAML, XML and CSV