[ot][personal] updates on aiml discovery
Undescribed Horrific Abuse, One Victim & Survivor of Many
gmkarl at gmail.com
Wed Feb 15 06:29:17 PST 2023
after i posted my small complaint around hf’s handling of peft
somebody linked to colossalai in an unrelated discord where i hadn’t
mentioned this
colossalai is a similar model training acceleration framework with
some support for peft that says it is looking to connect with other
contributors. it is based on energonai for inference which appears to
have a unified architecture for popular gpt, opt, bert pretrained
models ( https://github.com/hpcaitech/EnergonAI/blob/master/energonai/model/model_factory.py
).
the colossalai news is that they are actively developing
yet-another-clone of the chatgpt training framework using their
acceleration library.
https://github.com/hpcaitech/ColossalAI/tree/main/applications/ChatGPT
More information about the cypherpunks
mailing list