24 Jul
2022
24 Jul
'22
5:37 a.m.
special tokens in these transformers: key: eos=end-of-stream, bos=beginning-of-stream longt5 eos_token='</s>' unk_token='<unk>' pad_token='<pad>' note: longt5 says it uses pad as bos xlnet bos_token='<s>' eos_token='</s>' unk_token='<unk>' sep_token='<sep>' pad_token='<pad>' cls_token='<cls>' transxl eos_token='<eos>' unk_token='<unk>' additional: '<formula>' i guess i'll make a variable and use <pad> for longt5