The best Hacker News stories from Show from the past day
Latest posts:
Show HN: Open-source macOS AI copilot using vision and voice
Heeey! I built a macOS copilot that has been useful to me, so I open sourced it in case others would find it useful too.<p>It's pretty simple:<p>- Use a keyboard shortcut to take a screenshot of your active macOS window and start recording the microphone.<p>- Speak your question, then press the keyboard shortcut again to send your question + screenshot off to OpenAI Vision<p>- The Vision response is presented in-context/overlayed over the active window, and spoken to you as audio.<p>- The app keeps running in the background, only taking a screenshot/listening when activated by keyboard shortcut.<p>It's built with NodeJS/Electron, and uses OpenAI Whisper, Vision and TTS APIs under the hood (BYO API key).<p>There's a simple demo and a longer walk-through in the GH readme <a href="https://github.com/elfvingralf/macOSpilot-ai-assistant">https://github.com/elfvingralf/macOSpilot-ai-assistant</a>, and I also posted a different demo on Twitter: <a href="https://twitter.com/ralfelfving/status/1732044723630805212" rel="nofollow noreferrer">https://twitter.com/ralfelfving/status/1732044723630805212</a>
Show HN: FireDBG – A Time Travel Visual Debugger for Rust
Hey HN, the is Chris, creator of FireDBG. We’ve been working on this debugger just about a year now. Time travel debugging isn’t a new concept, the new idea here is to use call tree visualisation to help us navigate the debug trace.<p>It supports various Linux distros on x64 and macOS on x64 and M1. It’s only available for Rust right now, but we do want to bring this debugging experience to other programming languages. Please give it a try! Would love to know your thoughts.<p>What’s your anecdote in debugging programs? My stupidity is usually in the form of: after a few hours of debugging, I realised I misused a system API (e.g. messing up length with offset) but I kept thinking I had a logic error somewhere.<p>By the way, I am looking for a technical co-founder. If you are also passionate about developer toolings and willing to commit to this problem, let's team up and build a company. You can find me on YC Co-Founder Matching (link in blog post).
Show HN: FireDBG – A Time Travel Visual Debugger for Rust
Hey HN, the is Chris, creator of FireDBG. We’ve been working on this debugger just about a year now. Time travel debugging isn’t a new concept, the new idea here is to use call tree visualisation to help us navigate the debug trace.<p>It supports various Linux distros on x64 and macOS on x64 and M1. It’s only available for Rust right now, but we do want to bring this debugging experience to other programming languages. Please give it a try! Would love to know your thoughts.<p>What’s your anecdote in debugging programs? My stupidity is usually in the form of: after a few hours of debugging, I realised I misused a system API (e.g. messing up length with offset) but I kept thinking I had a logic error somewhere.<p>By the way, I am looking for a technical co-founder. If you are also passionate about developer toolings and willing to commit to this problem, let's team up and build a company. You can find me on YC Co-Founder Matching (link in blog post).
Show HN: Pryingdeep – The new OSINT instrument for the Deep Web
PryingDeep is a dark web OSINT tool. It specializes in extracting information depending on modules chosen.
Here's an overview of the features:<p>- Email, PhoneNumber, Wordpress search<p>- PGP keys, Certificates and 3 different cryptocurrencies (XMR,BTC,ETH) search<p>- PostgreSQL database, docker container for Tor and docker-compose for the whole project<p>- A built in exporter, currently only JSON, but possibly more.<p>- Exporter has support for: offset, limit, query building via the command line, raw-sql and different modules you can specify, e.g you only want emails, you will only get emails and the html webpage<p>- Collects title, status_code, body and headers from a webpage.<p>- Extremely customizable, supports multiple url's at once, based of the goColly framework which gives the crawler many options, e.g Debugger, allowed-domains or url-filters.<p>- Built install module, so there's no need for manually grabbing our config from github.<p>- Choice to remember previous parameters with our save-config flag.<p>- Built in queue and once reached max size, crawler will automatically exit.<p>That's a short overview, but there will be many more features to come as I enjoy working on this project!
Show HN: Pryingdeep – The new OSINT instrument for the Deep Web
PryingDeep is a dark web OSINT tool. It specializes in extracting information depending on modules chosen.
Here's an overview of the features:<p>- Email, PhoneNumber, Wordpress search<p>- PGP keys, Certificates and 3 different cryptocurrencies (XMR,BTC,ETH) search<p>- PostgreSQL database, docker container for Tor and docker-compose for the whole project<p>- A built in exporter, currently only JSON, but possibly more.<p>- Exporter has support for: offset, limit, query building via the command line, raw-sql and different modules you can specify, e.g you only want emails, you will only get emails and the html webpage<p>- Collects title, status_code, body and headers from a webpage.<p>- Extremely customizable, supports multiple url's at once, based of the goColly framework which gives the crawler many options, e.g Debugger, allowed-domains or url-filters.<p>- Built install module, so there's no need for manually grabbing our config from github.<p>- Choice to remember previous parameters with our save-config flag.<p>- Built in queue and once reached max size, crawler will automatically exit.<p>That's a short overview, but there will be many more features to come as I enjoy working on this project!
Show HN: You Need Less Caffeine Than You Think
Show HN: You Need Less Caffeine Than You Think
Show HN: Temporary Note – Convenient way to use a browser tab as a notepad
Show HN: Crunching 1,200 Authors' Favorite Reads of 2023
Hi all, creator here :)<p>I launched Shepherd.com on a Show HN in April 2021 (<a href="https://news.ycombinator.com/item?id=26871660">https://news.ycombinator.com/item?id=26871660</a>), and it has come a long way.<p>My goal with Shepherd is to create an experience that feels like wandering your local bookstore, along with little notes from authors & experts sharing why each book is one of their all-time favorites.<p>For 2023, I surveyed 1,200+ authors to get their three favorite reads of the year. Then I crunched that data and broke it by genre, age range, and when it was published. Publisher data is a nightmare, so some of the genres are not perfect; I am working on improving that and some of the NLP/ML that drives this.<p>Check out their top sci-fi reads: <a href="https://shepherd.com/bboy/2023/science-fiction" rel="nofollow noreferrer">https://shepherd.com/bboy/2023/science-fiction</a><p>Or, their top nonfiction reads: <a href="https://shepherd.com/bboy/2023/nonfiction" rel="nofollow noreferrer">https://shepherd.com/bboy/2023/nonfiction</a><p>You can also zoom in on each author’s favorite 3 reads.<p>Louise Carey - <a href="https://shepherd.com/bboy/2023/f/louise-carey" rel="nofollow noreferrer">https://shepherd.com/bboy/2023/f/louise-carey</a><p>Kevin Klehr - <a href="https://shepherd.com/bboy/2023/f/kevin-klehr" rel="nofollow noreferrer">https://shepherd.com/bboy/2023/f/kevin-klehr</a><p>Alice C. Hill - <a href="https://shepherd.com/bboy/2023/f/alice-c-hill" rel="nofollow noreferrer">https://shepherd.com/bboy/2023/f/alice-c-hill</a><p>Sara Ackerman - <a href="https://shepherd.com/bboy/2023/f/sara-ackerman" rel="nofollow noreferrer">https://shepherd.com/bboy/2023/f/sara-ackerman</a><p>My email is ben@shepherd.com if you want to share ideas or suggestions for 2024.<p>Thanks, Ben<p>P.S. I have a newsletter for readers here where I share what I am building, new features, my fav book lists: <a href="https://forauthors.shepherd.com/newsletter-for-readers" rel="nofollow noreferrer">https://forauthors.shepherd.com/newsletter-for-readers</a>
Show HN: Crunching 1,200 Authors' Favorite Reads of 2023
Hi all, creator here :)<p>I launched Shepherd.com on a Show HN in April 2021 (<a href="https://news.ycombinator.com/item?id=26871660">https://news.ycombinator.com/item?id=26871660</a>), and it has come a long way.<p>My goal with Shepherd is to create an experience that feels like wandering your local bookstore, along with little notes from authors & experts sharing why each book is one of their all-time favorites.<p>For 2023, I surveyed 1,200+ authors to get their three favorite reads of the year. Then I crunched that data and broke it by genre, age range, and when it was published. Publisher data is a nightmare, so some of the genres are not perfect; I am working on improving that and some of the NLP/ML that drives this.<p>Check out their top sci-fi reads: <a href="https://shepherd.com/bboy/2023/science-fiction" rel="nofollow noreferrer">https://shepherd.com/bboy/2023/science-fiction</a><p>Or, their top nonfiction reads: <a href="https://shepherd.com/bboy/2023/nonfiction" rel="nofollow noreferrer">https://shepherd.com/bboy/2023/nonfiction</a><p>You can also zoom in on each author’s favorite 3 reads.<p>Louise Carey - <a href="https://shepherd.com/bboy/2023/f/louise-carey" rel="nofollow noreferrer">https://shepherd.com/bboy/2023/f/louise-carey</a><p>Kevin Klehr - <a href="https://shepherd.com/bboy/2023/f/kevin-klehr" rel="nofollow noreferrer">https://shepherd.com/bboy/2023/f/kevin-klehr</a><p>Alice C. Hill - <a href="https://shepherd.com/bboy/2023/f/alice-c-hill" rel="nofollow noreferrer">https://shepherd.com/bboy/2023/f/alice-c-hill</a><p>Sara Ackerman - <a href="https://shepherd.com/bboy/2023/f/sara-ackerman" rel="nofollow noreferrer">https://shepherd.com/bboy/2023/f/sara-ackerman</a><p>My email is ben@shepherd.com if you want to share ideas or suggestions for 2024.<p>Thanks, Ben<p>P.S. I have a newsletter for readers here where I share what I am building, new features, my fav book lists: <a href="https://forauthors.shepherd.com/newsletter-for-readers" rel="nofollow noreferrer">https://forauthors.shepherd.com/newsletter-for-readers</a>
Show HN: Crunching 1,200 Authors' Favorite Reads of 2023
Hi all, creator here :)<p>I launched Shepherd.com on a Show HN in April 2021 (<a href="https://news.ycombinator.com/item?id=26871660">https://news.ycombinator.com/item?id=26871660</a>), and it has come a long way.<p>My goal with Shepherd is to create an experience that feels like wandering your local bookstore, along with little notes from authors & experts sharing why each book is one of their all-time favorites.<p>For 2023, I surveyed 1,200+ authors to get their three favorite reads of the year. Then I crunched that data and broke it by genre, age range, and when it was published. Publisher data is a nightmare, so some of the genres are not perfect; I am working on improving that and some of the NLP/ML that drives this.<p>Check out their top sci-fi reads: <a href="https://shepherd.com/bboy/2023/science-fiction" rel="nofollow noreferrer">https://shepherd.com/bboy/2023/science-fiction</a><p>Or, their top nonfiction reads: <a href="https://shepherd.com/bboy/2023/nonfiction" rel="nofollow noreferrer">https://shepherd.com/bboy/2023/nonfiction</a><p>You can also zoom in on each author’s favorite 3 reads.<p>Louise Carey - <a href="https://shepherd.com/bboy/2023/f/louise-carey" rel="nofollow noreferrer">https://shepherd.com/bboy/2023/f/louise-carey</a><p>Kevin Klehr - <a href="https://shepherd.com/bboy/2023/f/kevin-klehr" rel="nofollow noreferrer">https://shepherd.com/bboy/2023/f/kevin-klehr</a><p>Alice C. Hill - <a href="https://shepherd.com/bboy/2023/f/alice-c-hill" rel="nofollow noreferrer">https://shepherd.com/bboy/2023/f/alice-c-hill</a><p>Sara Ackerman - <a href="https://shepherd.com/bboy/2023/f/sara-ackerman" rel="nofollow noreferrer">https://shepherd.com/bboy/2023/f/sara-ackerman</a><p>My email is ben@shepherd.com if you want to share ideas or suggestions for 2024.<p>Thanks, Ben<p>P.S. I have a newsletter for readers here where I share what I am building, new features, my fav book lists: <a href="https://forauthors.shepherd.com/newsletter-for-readers" rel="nofollow noreferrer">https://forauthors.shepherd.com/newsletter-for-readers</a>
Show HN: I built an OSS alternative to Azure OpenAI services
Hey HN, I am proud to show you guys that I have built an open source alternative to Azure OpenAI services.<p>Azure OpenAI services was born out of companies needing enhanced security and access control for using different GPT models. I want to build an OSS version of Azure OpenAI services that people could self host in their own infrastructure.<p>"How can I track LLM spend per API key?"<p>"Can I create a development OpenAI API key with limited access for Bob?"<p>"Can I see my LLM spend breakdown by models and endpoints?"<p>"Can I create 100 OpenAI API keys that my students could use in a classroom setting?"<p>These are questions that BricksLLM helps you answer.<p>BricksLLM is an API gateway that let you create API keys with rate limit, cost control and ttl that could be used to access all OpenAI and Anthropic endpoints with out of box analytics.<p>When I first started building with OpenAI APIs, I was constantly worried about API keys being comprised since vanilla OpenAI API keys would grant you unlimited access to all of their models. There are stories of people losing thousands of dollars and the existence of a black market for stolen OpenAI API keys.<p>This is why I started building a proxy for ourselves that allows for the creation of API keys with rate limits and cost controls. I built BricksLLM in Go since that was the language I used to build performative ads exchanges that scaled to thousands of requests per second at my previous job. A lot of developer tools in LLM ops are built with Python which I believe might be suboptimal in terms of performance and compute resource efficiency.<p>One of the challenges building this platform is to get accurate token counts for different OpenAI and Anthropic models. LLM providers are not exactly transparent with the way how they count prompt and completion tokens. In addition to user input, OpenAI and Anthropic pad prompt inputs with additional instructions or phrases that contribute to the final token counts. For example, Anthropic's actual completion token consumption is consistently 4 more than the token count of the completion output.<p>The latency of the gateway hovers around 50ms. Half of the latency comes from the tokenizer. If I start utilizing Go routines, might be able to lower the latency of the gateway to 30ms.<p>BricksLLM is not an observability platform, but we do provide integration with Datadog so you can get more insights regarding what is going on inside the proxy. Compared to other tools in the LLMOps space, I believe that BricksLLM has the most comprehensive features when it comes to access control.<p>Let me know what you guys think.
Show HN: I built an OSS alternative to Azure OpenAI services
Hey HN, I am proud to show you guys that I have built an open source alternative to Azure OpenAI services.<p>Azure OpenAI services was born out of companies needing enhanced security and access control for using different GPT models. I want to build an OSS version of Azure OpenAI services that people could self host in their own infrastructure.<p>"How can I track LLM spend per API key?"<p>"Can I create a development OpenAI API key with limited access for Bob?"<p>"Can I see my LLM spend breakdown by models and endpoints?"<p>"Can I create 100 OpenAI API keys that my students could use in a classroom setting?"<p>These are questions that BricksLLM helps you answer.<p>BricksLLM is an API gateway that let you create API keys with rate limit, cost control and ttl that could be used to access all OpenAI and Anthropic endpoints with out of box analytics.<p>When I first started building with OpenAI APIs, I was constantly worried about API keys being comprised since vanilla OpenAI API keys would grant you unlimited access to all of their models. There are stories of people losing thousands of dollars and the existence of a black market for stolen OpenAI API keys.<p>This is why I started building a proxy for ourselves that allows for the creation of API keys with rate limits and cost controls. I built BricksLLM in Go since that was the language I used to build performative ads exchanges that scaled to thousands of requests per second at my previous job. A lot of developer tools in LLM ops are built with Python which I believe might be suboptimal in terms of performance and compute resource efficiency.<p>One of the challenges building this platform is to get accurate token counts for different OpenAI and Anthropic models. LLM providers are not exactly transparent with the way how they count prompt and completion tokens. In addition to user input, OpenAI and Anthropic pad prompt inputs with additional instructions or phrases that contribute to the final token counts. For example, Anthropic's actual completion token consumption is consistently 4 more than the token count of the completion output.<p>The latency of the gateway hovers around 50ms. Half of the latency comes from the tokenizer. If I start utilizing Go routines, might be able to lower the latency of the gateway to 30ms.<p>BricksLLM is not an observability platform, but we do provide integration with Datadog so you can get more insights regarding what is going on inside the proxy. Compared to other tools in the LLMOps space, I believe that BricksLLM has the most comprehensive features when it comes to access control.<p>Let me know what you guys think.
Show HN: I built an OSS alternative to Azure OpenAI services
Hey HN, I am proud to show you guys that I have built an open source alternative to Azure OpenAI services.<p>Azure OpenAI services was born out of companies needing enhanced security and access control for using different GPT models. I want to build an OSS version of Azure OpenAI services that people could self host in their own infrastructure.<p>"How can I track LLM spend per API key?"<p>"Can I create a development OpenAI API key with limited access for Bob?"<p>"Can I see my LLM spend breakdown by models and endpoints?"<p>"Can I create 100 OpenAI API keys that my students could use in a classroom setting?"<p>These are questions that BricksLLM helps you answer.<p>BricksLLM is an API gateway that let you create API keys with rate limit, cost control and ttl that could be used to access all OpenAI and Anthropic endpoints with out of box analytics.<p>When I first started building with OpenAI APIs, I was constantly worried about API keys being comprised since vanilla OpenAI API keys would grant you unlimited access to all of their models. There are stories of people losing thousands of dollars and the existence of a black market for stolen OpenAI API keys.<p>This is why I started building a proxy for ourselves that allows for the creation of API keys with rate limits and cost controls. I built BricksLLM in Go since that was the language I used to build performative ads exchanges that scaled to thousands of requests per second at my previous job. A lot of developer tools in LLM ops are built with Python which I believe might be suboptimal in terms of performance and compute resource efficiency.<p>One of the challenges building this platform is to get accurate token counts for different OpenAI and Anthropic models. LLM providers are not exactly transparent with the way how they count prompt and completion tokens. In addition to user input, OpenAI and Anthropic pad prompt inputs with additional instructions or phrases that contribute to the final token counts. For example, Anthropic's actual completion token consumption is consistently 4 more than the token count of the completion output.<p>The latency of the gateway hovers around 50ms. Half of the latency comes from the tokenizer. If I start utilizing Go routines, might be able to lower the latency of the gateway to 30ms.<p>BricksLLM is not an observability platform, but we do provide integration with Datadog so you can get more insights regarding what is going on inside the proxy. Compared to other tools in the LLMOps space, I believe that BricksLLM has the most comprehensive features when it comes to access control.<p>Let me know what you guys think.
Show HN: I Remade the Fake Google Gemini Demo, Except Using GPT-4 and It's Real
Show HN: I created an extension for direct streaming of videos, bypassing ads
Show HN: Rot - Offline secrets management
Finally open sourced an internal tool we've been using for managing secrets. It's similar to SOPS, but more opinionated, easier to configure/use correctly, and produces nicer git diffs. It also supports one-way encryption, so you don't have to know the private key to add secrets.
Show HN: Rot - Offline secrets management
Finally open sourced an internal tool we've been using for managing secrets. It's similar to SOPS, but more opinionated, easier to configure/use correctly, and produces nicer git diffs. It also supports one-way encryption, so you don't have to know the private key to add secrets.
Show HN: Rot - Offline secrets management
Finally open sourced an internal tool we've been using for managing secrets. It's similar to SOPS, but more opinionated, easier to configure/use correctly, and produces nicer git diffs. It also supports one-way encryption, so you don't have to know the private key to add secrets.
Show HN: Watering my Christmas tree with ESPHome