Solved the problem with this solution: https://huggingface.co/proxy/discuss.huggingface.co/t/fine-tune-for-multiclass-or-multilabel-multiclass/4035/8