19 Jan
2022
19 Jan
'22
2:40 a.m.
## num_self_attends_per_block ## - number of self attention layers configuration object is transformers.models.perceiver.configuration_perceiver.PerceiverConfig and it briefly documents the parameters (and likely a few more). configs deriving from perceiverconfig can simply set attribute to add more configs the perceiver classes are aliased into transformers at the top level import transformers config = transformers.PerceiverConfig() model = transformers.PerceiverModel(config)