Lambent/Mira-v1.22.1-27B

With credit to virtuous7373 for sharing the implementation of DeLerp used here.

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the DeLERP merge method using ../Mira-v1.22-27B-tsvm as a base.

Models Merged

The following models were included in the merge:

• ../Mira-v1.22b-27B

Configuration

The following YAML configuration was used to produce this model:

merge_method: delerp
base_model: ../Mira-v1.22-27B-tsvm
parameters:
  t: 0.3  # Move 30% towards the Stable model's direction

models:
  - model: ../Mira-v1.22-27B-tsvm
  - model: ../Mira-v1.22b-27B

tokenier_source: ../Mira-v1.22b-27B