Show HN: Janus – Go binary that runs GGUF models via Vulkan on AMD/Intel/Nvidia

25 points2 comments2 hours ago
PcChip

I didn't see any benchmarks against vllm, sglang, exllama, etc

show comments