| | --- |
| | base_model: |
| | - nbeerbower/Llama3.1-Gutenberg-Doppel-70B |
| | - Nexesenex/Llama_3.x_70b_SmarTricks_V1.01 |
| | - Nexesenex/Llama_3.1_70b_HighPriestess_R1_V1 |
| | - Steelskull/L3.3-Electra-R1-70b |
| | - Nexesenex/Llama_3.3_70b_DarkHorse |
| | - Nexesenex/Llama_3.1_70b_FLDx2-Tess3_abliterated_fusion_norm |
| | library_name: transformers |
| | tags: |
| | - mergekit |
| | - merge |
| |
|
| | --- |
| | # about |
| |
|
| | V3.0 changes (relatively minor update) : |
| | - DarkHorse replace DoppelGangerR1 to add a bit of Negative Llama at the expense of a bit of Fallen Llama R1. |
| | - A bit of Fallen Llama is recovered by using Smartricks instead of Smartracks as a base. |
| | - Priestess is upgraded with Lumitron Lorablated. |
| | - Tess is merged with Hitachi FLDx2 in the perplexity dropper model. |
| |
|
| | Electra R1 and GutenbergDoppel are kept as they were. |
| |
|
| | If you have V2 already, this model is quite similar, and the difference might not be worth a download. |
| |
|
| | --- |
| | # merge |
| |
|
| | This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). |
| |
|
| | ## Merge Details |
| | ### Merge Method |
| |
|
| | This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [Nexesenex/Llama_3.x_70b_SmarTricks_V1.01](https://huggingface.co/Nexesenex/Llama_3.x_70b_SmarTricks_V1.01) as a base. |
| |
|
| | ### Models Merged |
| |
|
| | The following models were included in the merge: |
| | * [nbeerbower/Llama3.1-Gutenberg-Doppel-70B](https://huggingface.co/nbeerbower/Llama3.1-Gutenberg-Doppel-70B) |
| | * [Nexesenex/Llama_3.1_70b_HighPriestess_R1_V1](https://huggingface.co/Nexesenex/Llama_3.1_70b_HighPriestess_R1_V1) |
| | * [Steelskull/L3.3-Electra-R1-70b](https://huggingface.co/Steelskull/L3.3-Electra-R1-70b) |
| | * [Nexesenex/Llama_3.3_70b_DarkHorse](https://huggingface.co/Nexesenex/Llama_3.3_70b_DarkHorse) |
| | * [Nexesenex/Llama_3.1_70b_FLDx2-Tess3_abliterated_fusion_norm](https://huggingface.co/Nexesenex/Llama_3.1_70b_FLDx2-Tess3_abliterated_fusion_norm) |
| |
|
| | ### Configuration |
| |
|
| | The following YAML configuration was used to produce this model: |
| |
|
| | ```yaml |
| | merge_method: model_stock |
| | models: |
| | - model: Nexesenex/Llama_3.1_70b_FLDx2-Tess3_abliterated_fusion_norm |
| | parameters: |
| | weight: 1.0 |
| | - model: nbeerbower/Llama3.1-Gutenberg-Doppel-70B |
| | parameters: |
| | weight: 1.0 |
| | - model: Nexesenex/Llama_3.1_70b_HighPriestess_R1_V1 |
| | parameters: |
| | weight: 1.0 |
| | - model: Steelskull/L3.3-Electra-R1-70b |
| | parameters: |
| | weight: 1.0 |
| | - model: Nexesenex/Llama_3.3_70b_DarkHorse |
| | parameters: |
| | weight: 1.0 |
| | base_model: Nexesenex/Llama_3.x_70b_SmarTricks_V1.01 |
| | dtype: bfloat16 |
| | out_dtype: bfloat16 |
| | parameters: |
| | int8_mask: true |
| | normalize: true |
| | rescale: false |
| | chat_template: auto |
| | tokenizer: |
| | source: union |
| | ``` |
| |
|
