ProductW7900 / Radeon PRO W7900
AMD W7900
A workstation-class professional graphics card released by AMD with 48GB of video memory, suited to local large-model deployment and AI inference tasks.
Timeline (last 90 days)
Oct 15
On an AMD W7900 GPU using llama.cpp with the ROCm backend, the Q8 quantized version of LFM2.5-24B-A2B sustains an inference speed of about 95 tokens/second.
Unverified50%