---
base_model: unsloth/mistral-nemo-instruct-2407-bnb-4bit
datasets:
- vicgalle/creative-rubrics-preferences
library_name: transformers
pipeline_tag: text-generation
license: apache-2.0
---

This is a LoRA adapter for `unsloth/mistral-nemo-instruct-2407-bnb-4bit` and was trained using the code and dataset described in the paper [Configurable Preference Tuning with Rubric-Guided Synthetic Data](https://huggingface.co/papers/2506.11702).

The code is available at https://github.com/vicgalle/configurable-preference-tuning.