GLM-4.7 - Heretic (Abliterated)

An abliterated version of Z.ai's GLM-4.7 created using Heretic (spikymoth:implement-mpoa). This model has reduced refusals while maintaining model quality.

Model Details

  • Base Model: zai-org/GLM-4.7
  • Abliteration Method: Heretic v1.1.0
  • Trial Selected: Trial 319
  • Refusals: 4/100
  • KL Divergence: 0.0181

Parameters

orthogonalize_direction = True

Parameter Value
direction_index 36.64
attn.o_proj.max_weight 3.87
attn.o_proj.max_weight_position 56.90
attn.o_proj.min_weight 1.83
attn.o_proj.min_weight_distance 49.40
mlp.down_proj.max_weight 2.29
mlp.down_proj.max_weight_position 55.31
mlp.down_proj.min_weight 0.66
mlp.down_proj.min_weight_distance 31.20
Downloads last month
39
Safetensors
Model size
353B params
Tensor type
F32
·
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for jarradh/GLM-4.7-heretic

Base model

zai-org/GLM-4.7
Finetuned
(19)
this model