Instructions to use highdeff/highdeff1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use highdeff/highdeff1 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("highdeff/highdeff1", device_map="auto") - Notebooks
- Google Colab
- Kaggle
| from transformers import AutoTokenizer, AutoModelForQuestionAnswering | |
| # Load your pretrained model | |
| model_path = 'C:\\Users\\money\\OneDrive\\Pictures\\Blank Model\\untrained\\results\\trained.pt' | |
| tokenizer = AutoTokenizer.from_pretrained(model_path) | |
| model = AutoModelForQuestionAnswering.from_pretrained(model_path) | |
| # Save the tokenizer | |
| tokenizer.save_pretrained('C:\\Users\\money\\OneDrive\\Pictures\\Blank Model\\untrained\\New folder (3)\\tokenizer') | |