I have the same GPU but I always run 7B/8B variants as exl2. Do you use GGUF to use your system RAM?

I don’t know how big the original model is but I have an RX 6700 XT and I can easily run the Llama 3 8B distill of Deepseek R1 with 32k context. I just haven’t figured out how to get good results yet, it always does the <thinking><thinking/> thing.