Demo . 4bit.
#15
by sccssc - opened
wdym?
I can see that they used a 4-bit version of it. This is easily findable. Fp4 reduces the precision a LOT. Which is why, in image 1, the cabinet has a window, and the paper towel is clipped into a wall. However, in the second image, it seems all is fine. So if I had to guess, they used and demo'd a 4-bit model.
how on 2 gpu kagle????