At Character.AI, we’re excited to share an experimental project from our research team with the open-source community: pipeling-sft — a lightweight yet powerful training framework built for full-parameter supervised fine-tuning (SFT) of large-scale LLMs with Mixture-of-Experts (MoE) architectures. This framework was originally developed to explore better ways of fine-tuning
