NVIDIA-Nemotron-3-Super-120B-A12B-UD-Q4_K_XL-MTPv2-layers

Vllm

AI APIs & LLMs

A high-throughput and memory-efficient inference and serving engine for LLMs

SillyTavern

AI APIs & LLMs

LLM Frontend for Power Users.

Ms Swift

AI APIs & LLMs

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).

Dalai

AI APIs & LLMs

The simplest way to run LLaMA on your local machine

Axolotl

AI APIs & LLMs

Go ahead and axolotl questions

LMCache

AI APIs & LLMs

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer