[ot][personal] updates on aiml discovery

Undescribed Horrific Abuse, One Victim & Survivor of Many gmkarl at gmail.com
Wed Feb 15 06:29:17 PST 2023


after i posted my small complaint around hf’s handling of peft
somebody linked to colossalai in an unrelated discord where i hadn’t
mentioned this

colossalai is a similar model training acceleration framework with
some support for peft that says it is looking to connect with other
contributors. it is based on energonai for inference which appears to
have a unified architecture for popular gpt, opt, bert pretrained
models ( https://github.com/hpcaitech/EnergonAI/blob/master/energonai/model/model_factory.py
).

the colossalai news is that they are actively developing
yet-another-clone of the chatgpt training framework using their
acceleration library.
https://github.com/hpcaitech/ColossalAI/tree/main/applications/ChatGPT


More information about the cypherpunks mailing list