Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

41,569

Full-text search

Active filters: bitsandbytes

unsloth/medgemma-1.5-4b-it-bnb-4bit

Image-Text-to-Text • 4B • Updated Jan 14 • 1.06k • 2

OzzyGT/flux2_klein_9B_bnb_4bit_transformer

Image-to-Image • Updated Jan 15 • 50 • 2

cahlen/lingbot-world-base-cam-nf4

Image-to-Video • Updated Feb 3 • 14

EricRollei/HunyuanImage-3.0-Instruct-NF4

Text-to-Image • 83B • Updated 26 days ago • 163 • 3

brianmatzelle/personaplex-7b-v1-bnb-4bit

Updated 12 days ago • 8

manu02/kani-tts-2-pt-bnb-4bit-nf4-dq

Text Generation • 0.4B • Updated 19 days ago • 9 • 1

EricRollei/HunyuanImage-3.0-Instruct-INT8-v2

Text-to-Image • 83B • Updated 14 days ago • 143 • 1

EricRollei/HunyuanImage-3.0-Instruct-NF4-v2

Text-to-Image • 83B • Updated 13 days ago • 113 • 1

EricRollei/HunyuanImage-3.0-Instruct-Distil-INT8-v2

Text-to-Image • 83B • Updated 13 days ago • 111 • 3

PavonicAI/HeartMuLa-3B-4bit

4B • Updated 11 days ago • 58 • 1

sankarvnk/translategemma-12b-it_8bit

Image-Text-to-Text • 12B • Updated 10 days ago • 28 • 1

devilb2103/Wan2.2-Animate-14B-NF4

Updated 10 days ago • 197 • 1

supateam/ministral-3b-t2-nf4

4B • Updated 7 days ago • 48 • 1

Madras1/JadeBr72b-2

Text Generation • 73B • Updated 7 days ago • 30 • 1

manu02/Jan-code-4b-bnb-4bit-nf4-dq

Text Generation • 5B • Updated 4 days ago • 176 • 1

davidjbarnes/bridge-cli

Text Generation • Updated about 17 hours ago • 13 • 1

NeshVerse/Ultra_Flash_Financial_SFT_Nanbeige_4.1-3B

Text Generation • 4B • Updated 8 days ago • 122 • 1

dddx/mehmehmeh

Text Generation • 7B • Updated Apr 4, 2025 • 1

rosyvs/whisat

Automatic Speech Recognition • Updated Apr 29, 2025 • 5 • 3

Sakuna/LLaMaCoder

Text Generation • Updated Jan 3, 2024 • 6 • 1

Mediocreatmybest/instructblip-vicuna-7b_8bit

Image-to-Text • 8B • Updated Nov 19, 2023 • 5 • 3

0prodigy/axolotl

Text Generation • Updated Oct 17, 2023 • 5

Mediocreatmybest/instructblip-vicuna-13b_8bit

Image-Text-to-Text • 14B • Updated Nov 19, 2023 • 4

Mediocreatmybest/instructblip-flan-t5-xl_8bit

Image-to-Text • 4B • Updated Nov 20, 2023 • 5 • 1

Mediocreatmybest/instructblip-flan-t5-xxl_8bit

Image-to-Text • 12B • Updated Nov 20, 2023 • 8

nominate/llama2-13b-chat-hf-jmc-001-merged-q8_0

Text Generation • Updated Aug 11, 2023 • 1

jionlyu/3B-test

Text Generation • Updated Aug 16, 2023 • 4

rajuptvs/bigscience_bloom-560m_sharded_8bit

Text Generation • 0.6B • Updated Sep 27, 2023 • 4

rajuptvs/stabilityai_stablecode-instruct-alpha-3b-sharded-8bit

Text Generation • Updated Aug 16, 2023 • 3

Kashfia/base_model

Updated Aug 25, 2023