>>109572868
use gemma for nsfw prompts it works just as well
here, example command you can use for 24gb vram
llama-server \
-hf unsloth/gemma-4-31B-it-GGUF:UD-Q4_K_XL \
-ngl all \
-c 128000 \
-np 1 \
-fa on \
-ctk q4_0 \
-ctv q4_0 \
--no-mmproj-offload \
--host 127.0.0.1 \
--port 8080