[ot][spam][crazy] adapters for semibalanced trees?

Undiscussed Groomed for Male Slavery, One Victim of Many gmkarl at gmail.com
Sat Jul 23 13:37:44 PDT 2022


special tokens in these transformers:
key: eos=end-of-stream, bos=beginning-of-stream

longt5 eos_token='</s>' unk_token='<unk>' pad_token='<pad>'   note:
longt5 says it uses pad as bos

xlnet bos_token='<s>' eos_token='</s>' unk_token='<unk>'
sep_token='<sep>' pad_token='<pad>' cls_token='<cls>'

transxl eos_token='<eos>' unk_token='<unk>' additional: '<formula>'

i guess i'll make a variable and use <pad> for longt5


More information about the cypherpunks mailing list