Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

[flagged]


Are you using 7/8b models for coding? I keep getting the impression from what i read that 8b is only good for autocomplete. Also, it seems like an 8b model will run on a $100 2nd hand gpu (e.g. an 8gb gtx 1050/1060/1070 kind of thing) - why would you need to quantize?



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: