The best Hacker News stories from All from the past day
Latest posts:
Show HN: 80% faster, 50% less memory, 0% loss of accuracy Llama finetuning
Hi HN! I'm just sharing a project I've been working on during the LLM Efficiency Challenge - you can now finetune Llama with QLoRA 5x faster than Huggingface's original implementation on your own local GPU. Some highlights:<p>1. Manual autograd engine - hand derived backprop steps.<p>2. QLoRA / LoRA 80% faster, 50% less memory.<p>3. All kernels written in OpenAI's Triton language.<p>4. 0% loss in accuracy - no approximation methods - all exact.<p>5. No change of hardware necessary. Supports NVIDIA GPUs since 2018+. CUDA 7.5+.<p>6. Flash Attention support via Xformers.<p>7. Supports 4bit and 16bit LoRA finetuning.<p>8. Train Slim Orca fully locally in 260 hours from 1301 hours (5x faster).<p>9. Open source version trains 5x faster or you can check out Unsloth Pro and Max codepaths for 30x faster training!<p><a href="https://www.reddit.com/r/LocalLLaMA/comments/188197j/80_faster_50_less_memory_0_accuracy_loss_llama/" rel="nofollow noreferrer">https://www.reddit.com/r/LocalLLaMA/comments/188197j/80_fast...</a> has more info about Unsloth!<p>Hopefully you can try it out! Wrote a blog post at <a href="https://unsloth.ai/introducing" rel="nofollow noreferrer">https://unsloth.ai/introducing</a> if you want to learn more about our manual hand derived backprop or Triton kernels and stuff! Thanks once again!
Ask HN: Who wants to be hired? (December 2023)
Share your information if you are looking for work. Please use this format:<p><pre><code> Location:
Remote:
Willing to relocate:
Technologies:
Résumé/CV:
Email:
</code></pre>
Readers: please only email these addresses to discuss work opportunities.
No new boss at NSA until it answers questions on buying location, browsing data
Tinnitus linked to undetected auditory nerve damage
You don't need JavaScript for that
Tiny volumetric display
Tiny volumetric display
Star neuroscientist may have manipulated data to support a major stroke trial
Marker: Convert PDF to Markdown quickly with high accuracy
Ask HN: Who is hiring? (December 2023)
Please state the location and include REMOTE, INTERNS and/or VISA
when that sort of candidate is welcome. When remote work is <i>not</i> an option,
include ONSITE.<p>Please only post if you personally are part of the hiring company—no
recruiting firms or job boards. One post per company. If it isn't a household name,
explain what your company does.<p>Commenters: please don't reply to job posts to complain about
something. It's off topic here.<p>Readers: please only email if you are personally interested in the job.<p>Searchers: try <a href="https://www.remotenbs.com" rel="nofollow noreferrer">https://www.remotenbs.com</a>, <a href="https://hnjobs.u-turn.dev" rel="nofollow noreferrer">https://hnjobs.u-turn.dev</a>, <a href="https://hnresumetojobs.com" rel="nofollow noreferrer">https://hnresumetojobs.com</a>,
<a href="https://hnhired.fly.dev" rel="nofollow noreferrer">https://hnhired.fly.dev</a>, <a href="https://kennytilton.github.io/whoishiring/" rel="nofollow noreferrer">https://kennytilton.github.io/whoishiring/</a>, <a href="https://hnjobs.emilburzo.com" rel="nofollow noreferrer">https://hnjobs.emilburzo.com</a>.<p>Don't miss these other fine threads:<p><i>Who wants to be hired?</i> <a href="https://news.ycombinator.com/item?id=38490809">https://news.ycombinator.com/item?id=38490809</a><p><i>Freelancer? Seeking freelancer?</i> <a href="https://news.ycombinator.com/item?id=38490810">https://news.ycombinator.com/item?id=38490810</a>
Ask HN: Who is hiring? (December 2023)
Please state the location and include REMOTE, INTERNS and/or VISA
when that sort of candidate is welcome. When remote work is <i>not</i> an option,
include ONSITE.<p>Please only post if you personally are part of the hiring company—no
recruiting firms or job boards. One post per company. If it isn't a household name,
explain what your company does.<p>Commenters: please don't reply to job posts to complain about
something. It's off topic here.<p>Readers: please only email if you are personally interested in the job.<p>Searchers: try <a href="https://www.remotenbs.com" rel="nofollow noreferrer">https://www.remotenbs.com</a>, <a href="https://hnjobs.u-turn.dev" rel="nofollow noreferrer">https://hnjobs.u-turn.dev</a>, <a href="https://hnresumetojobs.com" rel="nofollow noreferrer">https://hnresumetojobs.com</a>,
<a href="https://hnhired.fly.dev" rel="nofollow noreferrer">https://hnhired.fly.dev</a>, <a href="https://kennytilton.github.io/whoishiring/" rel="nofollow noreferrer">https://kennytilton.github.io/whoishiring/</a>, <a href="https://hnjobs.emilburzo.com" rel="nofollow noreferrer">https://hnjobs.emilburzo.com</a>.<p>Don't miss these other fine threads:<p><i>Who wants to be hired?</i> <a href="https://news.ycombinator.com/item?id=38490809">https://news.ycombinator.com/item?id=38490809</a><p><i>Freelancer? Seeking freelancer?</i> <a href="https://news.ycombinator.com/item?id=38490810">https://news.ycombinator.com/item?id=38490810</a>
Accidental database programming
Accidental database programming
Return to office is 'dead,' Stanford economist says
A reality bending mistake in Apple's computational photography
The Seamless Communication models
The Seamless Communication models
Code is run more than read
Turbo Pascal Turns 40
Brickception