Is gguf possible?
#4
by 04RR - opened
Love this model, wanted to know if gguf quants are possible for this as this Cosmos-Reason + Action expert architecture of this model isn't supported by llamacpp. Would love to have the quants!
Love this model, wanted to know if gguf quants are possible for this as this Cosmos-Reason + Action expert architecture of this model isn't supported by llamacpp. Would love to have the quants!