hum second run the other was faster, by about the same amount, so maybe they're comparable. anyway next step is to add aminrezaei to huggingface's perceiver implementation. maybe in a base class.