Not to mention how insanely difficult heterogeneous memory management can get if you start needing coherence and/or relaxed atomics.
I have taken multiple swings at getting good at mixed computing and decided in most cases it's better to just pick CPU or GPU, trying to use both at the same time increases the difficulty by orders of magnitude.
I have taken multiple swings at getting good at mixed computing and decided in most cases it's better to just pick CPU or GPU, trying to use both at the same time increases the difficulty by orders of magnitude.
Hats off to people that are good at that shit.