Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

And if you're running it on a dGPU, power limit it, because you lose very little in terms of token generation performance, since it's memory-bound.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: