The best Hacker News stories from All from the past day
Latest posts:
I bricked my Christmas lights
How Lego builds a new Lego set
How Lego builds a new Lego set
WebP is so great except it's not (2021)
Database Fundamentals
Suspects can refuse to provide phone passcodes to police, court rules
Suspects can refuse to provide phone passcodes to police, court rules
Interviewing my mother, a mainframe COBOL programmer (2016)
Interviewing my mother, a mainframe COBOL programmer (2016)
Security Issue: Cloud Site Manager presented me your consoles, not mine
Show HN: I scraped 25M Shopify products to build a search engine
Hi HN! I built Agora as a side-project leading up to the holiday season. I wanted to find an easier way to find Christmas gifts, without needing to go store-by-store.<p>My wife asked me for a a pair of red shoes for Christmas. I quickly typed it into Google and found a combination of ads from large retailers and links to a 1948 movie called 'Red Shoes'. I decided to build Agora to solve my own problem (and stay happily married). The product is a search engine that automatically crawls thousands of Shopify stores and makes them easily accessible with a search interface. There's a few additional features to enhance the buying experience including saving products, filters, reviews, and popular products.<p>I've started with exclusively Shopify stores and plan to expand the crawler to other e-commerce platforms like BigCommerce, WooCommerce, Wix, etc. The technical challenge I've found is keeping the search speed and performance strong as the data set becomes larger. There's about 25 million products on Agora right now. I'll ramp this up carefully to make sure we don't compromise the search speed and user experience.<p>I'd love any feedback!
The AI Trust Crisis
Maybe getting rid of your QA team was bad
Mitchell reflects as he departs HashiCorp
Mitchell reflects as he departs HashiCorp
Australia to ban engineered stone
Trains were designed to break down after third-party repairs, hackers find
Voyager 1 stops communicating with Earth
Voyager 1 stops communicating with Earth
What We Watched: A Netflix engagement report