How to use from
Lemonade
Pull the model
# Download Lemonade from https://lemonade-server.ai/
lemonade pull Colby/starcoder-7b-agent-0.4-gguf:
Run and chat with the model
lemonade run user.starcoder-7b-agent-0.4-gguf-
List all available models
lemonade list
Quick Links

starcoder-7b-agent-0.4-gguf

GGUF conversion of Colby/starcoder-7b-agent-0.4.

Downloads last month
172
GGUF
Model size
7B params
Architecture
starcoder
Hardware compatibility
Log In to add your hardware

4-bit

5-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Colby/starcoder-7b-agent-0.4-gguf