Seems like AMD 395+ is only about 16 tokens/s which is 25-33% the speed of SOTA ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		hadlock 26 days ago \| parent \| context \| favorite \| on: I cancelled Claude: Token issues, declining qualit... Seems like AMD 395+ is only about 16 tokens/s which is 25-33% the speed of SOTA models. Break even on a $3000 machine is ~15 months

cyanydeez 26 days ago [–]

thats pessimistic. do the calc assuming Cloud provider X changes your nondetermistic output every Y Months by Z probability and increases prices by 10% every 6 months.

slow and steady is worth exponentials. keep slopppping it my boid.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact