Re: [ot][spam][crazy][data] transformer model 'attention' improvement

re the masks and biases, basically the chunking code assumes they are dense matrices, but by changing the chunking code you can pass only the data needed. i'm presently doing that. it may end up that the optimization is not reasonable on models that store a dense mask or bias as an on-disk weight.