[spam] [personal] perceiver model notes

[k]

i'm drafting an attempt to use perceiver

i thought i'd try to convert between numbers and the words for them

the next step is, i need to figure out how to get the ends of the
model to match that kind of data.  means comprehending the configs,
preprocessor, postprocessor/decoder, again.

i'm thinking it would be nice to put processors on the ends of the
model such that it handles either a single number, or a sequence of
characters.

but maybe it would make sense for me to start with a simpler task:
like a single number to another single number, maybe simplify further
by having the numbers be full embedding vectors with 0s for their
extra elements.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: perceiver_play.py
Type: text/x-python
Size: 5027 bytes
Desc: not available
URL: <https://lists.cpunks.org/pipermail/cypherpunks/attachments/20220118/f694cfd7/attachment.py>