Output generation is failing
#8
by
ravithejads - opened
Hello,
Thank you for the model. However, I keep encountering the following error when trying to run it. It fails when I execute outputs = model.generate(**input_ids). I am experiencing this issue with both the 9B and 27B models. Is anyone else facing this problem? Can someone assist me with this?
Same issue here with both 9b and 9b-it.
Transformers library version 4.43.0.dev0
Ok, I can confirm that this is fixed in transformers-4.42.1 :)
Yeah. Thank you.
ravithejads changed discussion status to
closed
Ahhh, I struggled with this all day yesterday and it's fixed, time to go download the weights again.