Re: [ot][spam][crazy] coping spam while trying to make code to prompt a model

ok ummmmmmmmmmmm i have about 2G gpu ram. so i'll want a model that fits in a little under that. if i use 16 bit floats, that means ummm 2b / 2 = <1b params if i use 32 bit floats, that means ummm 2b / 4 = <500m params maybe i'll see if bloomz-560m loads to start with