[ot][spam][crazy] adapters for semibalanced trees?
Undiscussed Groomed for Male Slavery, One Victim of Many
gmkarl at gmail.com
Sat Jul 23 13:37:44 PDT 2022
special tokens in these transformers:
key: eos=end-of-stream, bos=beginning-of-stream
longt5 eos_token='</s>' unk_token='<unk>' pad_token='<pad>' note:
longt5 says it uses pad as bos
xlnet bos_token='<s>' eos_token='</s>' unk_token='<unk>'
sep_token='<sep>' pad_token='<pad>' cls_token='<cls>'
transxl eos_token='<eos>' unk_token='<unk>' additional: '<formula>'
i guess i'll make a variable and use <pad> for longt5
More information about the cypherpunks
mailing list