RedHatAI/gemma-2-27b-it-quantized.w8a16
Text Generation • 28B • Updated • 92
AI & ML interests
OpenSource and AI
Recent Activity
View all activity
Papers
SNLP: Layer-Parallel Inference via Structured Newton Corrections
S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation
RedHatAI/SmolLM-360M-Instruct-quantized.w8a8
Text Generation • 0.4B • Updated • 106
RedHatAI/SmolLM-135M-Instruct-quantized.w8a8
Text Generation • 0.2B • Updated • 128 • 1
RedHatAI/SmolLM-135M-Instruct-quantized.w8a16
Text Generation • 0.2B • Updated • 465
RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a8
Text Generation • 2B • Updated • 108 • 1
RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a16
Text Generation • 2B • Updated • 193
RedHatAI/Qwen2-7B-Instruct-quantized.w8a8
Text Generation • 8B • Updated • 166
RedHatAI/Qwen2-72B-Instruct-quantized.w8a8
Text Generation • 73B • Updated • 140 • 2
RedHatAI/Qwen2-1.5B-Instruct-quantized.w8a8
Text Generation • 2B • Updated • 251
RedHatAI/Qwen2-0.5B-Instruct-quantized.w8a8
Text Generation • 0.6B • Updated • 205
RedHatAI/Phi-3-small-128k-instruct-quantized.w8a16
Text Generation • 8B • Updated • 68
RedHatAI/Phi-3-mini-128k-instruct-quantized.w8a8
Text Generation • 4B • Updated • 191
RedHatAI/Phi-3-mini-128k-instruct-quantized.w8a16
Text Generation • 4B • Updated • 110
RedHatAI/Phi-3-mini-128k-instruct-quantized.w4a16
Text Generation • 4B • Updated • 176 • 1
RedHatAI/Phi-3-mini-128k-instruct-FP8
Text Generation • 4B • Updated • 72
RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a8
Text Generation • 14B • Updated • 101 • 2
RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a16
Text Generation • 14B • Updated • 98 • 2
RedHatAI/Phi-3-medium-128k-instruct-quantized.w4a16
Text Generation • 14B • Updated • 1.22k • 3
RedHatAI/Phi-3-medium-128k-instruct-FP8
Text Generation • 14B • Updated • 61 • 5
RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w8a16
Text Generation • 12B • Updated • 109
RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w4a16
Text Generation • 12B • Updated • 1.53k • 4
RedHatAI/Mistral-Large-Instruct-2407-FP8
Text Generation • 123B • Updated • 190
RedHatAI/Mistral-7B-Instruct-v0.3-quantized.w8a8
Text Generation • 7B • Updated • 126 • 2
RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8
Text Generation • 8B • Updated • 5.76k • 5
RedHatAI/Meta-Llama-3.1-8B-quantized.w8a16
Text Generation • 8B • Updated • 140 • 1
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
Text Generation • 8B • Updated • 12.4k • 20
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16
Text Generation • 8B • Updated • 691 • 12
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8
Text Generation • 8B • Updated • 134k • 45
RedHatAI/Meta-Llama-3.1-70B-quantized.w8a8
Text Generation • 71B • Updated • 105
RedHatAI/Meta-Llama-3.1-70B-quantized.w8a16
Text Generation • 71B • Updated • 96