[ot][spam][crazy][data] transformer model 'attention' improvement

k gmkarl at gmail.com
Wed Jan 26 02:39:49 PST 2022


I'm making slow progress on running the pytorch implementations of the
paper through the same test. Attached is the start of a wrapper.
The two linked implementations have the same package name for now, so
the plan was to put both wrappers in the same file, and just check the
package to see if it has the implementation function to see which one
is installed when both wrappers are in.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: chunked_lib.py
Type: text/x-python
Size: 392 bytes
Desc: not available
URL: <https://lists.cpunks.org/pipermail/cypherpunks/attachments/20220126/382a0131/attachment.py>


More information about the cypherpunks mailing list