Skip to contentDEEKOYA AI CoursesFLAT 20% OFFEnroll Now
Deekoya AI

granite-4.0-h-350m-GGUF

AI model by mrutkows on Hugging Face. 965 downloads in the last 30 days as of 2026-10-15.

granite-4.0-h-350m-GGUF logo
ProductivityFreeAI modelLink verified 2026-11-01

What is granite-4.0-h-350m-GGUF?

granite-4.0-h-350m-GGUF is an open AI model published on Hugging Face by mrutkows. Its name indicates it belongs to the Granite model family with about 350M parameters, packaged as quantised GGUF weights for llama.cpp-compatible runtimes (Ollama, LM Studio, llama.cpp). Hugging Face reported 965 downloads in the 30 days to 2026-10-15. Weights are free to download from Hugging Face; licence terms are set by the publisher on the model card.

granite-4.0-h-350m-GGUF key facts
Publishermrutkows
Model family (from name)Granite
Parameters (from name)350M
FormatGGUF
Downloads (30 days)965 (as of 2026-10-15)
PriceFree to download (open weights)

granite-4.0-h-350m-GGUF pricing

Listed as Free. Detailed prices haven't been checked from the official site yet; see granite-4.0-h-350m-GGUF.

How to run granite-4.0-h-350m-GGUF

  1. Open the model page on Hugging Face and pick a quantisation file that fits your RAM/VRAM (smaller Q-numbers use less memory).
  2. Run it locally with llama.cpp, LM Studio or Ollama (e.g. `ollama run hf.co/mrutkows/granite-4.0-h-350m-GGUF`).
  3. Read the model card for the prompt template, context length and licence.

Models related to granite-4.0-h-350m-GGUF

granite-embedding-small-english-r2 logo

granite-embedding-small-english-r2

ML Ops & Infrastructure

feature extraction model by ibm-granite on Hugging Face (sentence-transformers). 5,287,991 downloads in the last 30 days as of 2026-10-15.

Free

AI model by ibm-granite on Hugging Face (granite-tsfm). 1,196,779 downloads in the last 30 days as of 2026-10-15.

Free
granite-4.1-3b logo

granite-4.1-3b

AI APIs & LLMs

text generation model by ibm-granite on Hugging Face (transformers). 619,077 downloads in the last 30 days as of 2026-10-15.

Free

time series forecasting model by ibm-granite on Hugging Face. 393,767 downloads in the last 30 days as of 2026-10-15.

Free

text generation model by ibm-granite on Hugging Face (transformers). 338,924 downloads in the last 30 days as of 2026-10-15.

Free

time series forecasting model by ibm-granite on Hugging Face. 336,386 downloads in the last 30 days as of 2026-10-15.

Free

All Productivity tools →

granite-4.0-h-350m-GGUF FAQ

What is granite-4.0-h-350m-GGUF?

granite-4.0-h-350m-GGUF is an open AI model published on Hugging Face by mrutkows.

Is granite-4.0-h-350m-GGUF free?

granite-4.0-h-350m-GGUF is listed as free.

How do I use granite-4.0-h-350m-GGUF?

1. Open the model page on Hugging Face and pick a quantisation file that fits your RAM/VRAM (smaller Q-numbers use less memory). 2. Run it locally with llama.cpp, LM Studio or Ollama (e.g. `ollama run hf.co/mrutkows/granite-4.0-h-350m-GGUF`). 3. Read the model card for the prompt template, context length and licence.

What models are similar to granite-4.0-h-350m-GGUF?

Related models include granite-embedding-small-english-r2, granite-timeseries-tspulse-r1, granite-4.1-3b, granite-timeseries-ttm-r3, granite-3.3-2b-instruct.

This page is generated from public listing data (source listing, tags, counts and our own link check); check the official page for features, licence and current pricing. Want to master tools like this? See the 100+ AI Tools Course.