Estebiu

Uhh, a lot of big words here. I mostly just play around with it… Never used LLMs for anything more serious than a couple of test, so I don’t even know now many tokens can my setup generate…

For llama 70B I’m using an rtx a6000; slightly older but it does the job magnificently with hers 48gb of vram.

I dont use neither void and neither x11, but that seems like a common thing that should be mentioned in the docs? i think