15 Feb
2023
15 Feb
'23
2:29 p.m.
after i posted my small complaint around hf’s handling of peft somebody linked to colossalai in an unrelated discord where i hadn’t mentioned this colossalai is a similar model training acceleration framework with some support for peft that says it is looking to connect with other contributors. it is based on energonai for inference which appears to have a unified architecture for popular gpt, opt, bert pretrained models ( https://github.com/hpcaitech/EnergonAI/blob/master/energonai/model/model_fac... ). the colossalai news is that they are actively developing yet-another-clone of the chatgpt training framework using their acceleration library. https://github.com/hpcaitech/ColossalAI/tree/main/applications/ChatGPT