Any idea what makes models hard to run on it? Just general compatibility between... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		typpilol 5 months ago \| parent \| context \| favorite \| on: Evaluating the Infinity Cache in AMD Strix Halo Any idea what makes models hard to run on it? Just general compatibility between Nvidia and AMD for stuff that was built for Nvidia originally? Or do you mean something else?

cakealert 5 months ago [–]

It's not the models, it's the tooling. Models are just weights and an architecture spec. The tooling is how to load and execute the model on hardware.

Some UX-oriented tooling has sort of solved this problem and will run on AMD: LM Studio

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact