Re: [ot][aiml] Merge Higher-Performing Models Without Compute Across Modes?

looks like a wip addition to mergekit: https://github.com/arcee-ai/mergekit/blob/main/mergekit/scripts/evolve.py documented at https://github.com/arcee-ai/mergekit/blob/main/docs/evolve.md a couple more implementation approaches or repos discussed at https://github.com/arcee-ai/mergekit/issues/207 mergekit seems a reasonable resource for this for now, they just implemented a newer method called DELLA https://arxiv.org/abs/2406.11617