Unclear what this is referring to, but if it means CUDA vs other things it is worth noting that:

a) CUDA won in a free market because NVidia showed they cared about it

b) Llama has support for OpenCL (via CLBlast) and Apple Metal

The OpenCL support already has a custom kernel for token generation.