AWQ:
"q_group_size": 128, "w_bit": 4, "version": "GEMM"
Source:
https://huggingface.co/xDAN-AI/xDAN-L1-Chat-RL-v1
- Downloads last month
- -
"q_group_size": 128, "w_bit": 4, "version": "GEMM"
https://huggingface.co/xDAN-AI/xDAN-L1-Chat-RL-v1