filister@lemmy.world to Linux@lemmy.ml · 14 days agoZLUDA v4 Released For Initial CUDA Support On Non-NVIDIA GPUs - Phoronixwww.phoronix.comexternal-linkmessage-square4fedilinkarrow-up10arrow-down10
arrow-up10arrow-down1external-linkZLUDA v4 Released For Initial CUDA Support On Non-NVIDIA GPUs - Phoronixwww.phoronix.comfilister@lemmy.world to Linux@lemmy.ml · 14 days agomessage-square4fedilink
minus-squarefilister@lemmy.worldOPlinkfedilinkarrow-up0·14 days agoI am really looking forward to having a viable alternative to NVIDIA. I would love buying Intel or AMD and being able to enable CUDA support on the GPU out of the box.
minus-squaregeneva_convenience@lemmy.mllinkfedilinkarrow-up0·14 days agoNVIDIA skimps out on VRAM needed for deep learning. If AMD could compete it would be huge as they often include more for cheaper.
minus-squaregaylord_fartmaster@lemmy.worldlinkfedilinkarrow-up0·14 days agoMe too. I recently switched from an RTX 2080 to a 7900 XTX, which is way more powerful for games, but local LLM performance tanked without CUDA.
I am really looking forward to having a viable alternative to NVIDIA. I would love buying Intel or AMD and being able to enable CUDA support on the GPU out of the box.
NVIDIA skimps out on VRAM needed for deep learning. If AMD could compete it would be huge as they often include more for cheaper.
Me too. I recently switched from an RTX 2080 to a 7900 XTX, which is way more powerful for games, but local LLM performance tanked without CUDA.