On Fri, May 13, 2022, 3:48 AM Undiscussed Horrific Abuse, One Victim of
   Many <[1]gmkarl@gmail.com> wrote:

   On Thu, May 12, 2022, 8:37 AM Undiscussed Horrific Abuse, One Victim of
   Many <[2]gmkarl@gmail.com> wrote:

   Worker 2 [groaning]: "It's ... it's in the ul2 subfolder. You only need
   the ul2 subfolder."
   Zombie with Pink Skin [grabs somebody else's brain and munches a
   little]: "git clone --no-checkout --filter=blob:none
   [3]https://github.com/google-research/google-research; cd
   google-research; git checkout master -- ul2"
    Zombie with Pink Skin stares wide-eyed.
   Zombie with Pink Skin: "What did I just say?"

   I've moved these sota model weights to
   [4]https://bafybeialobgoggqrgxdewvi3ndj7cmqqq57qzcgcs65fvm32iste5hei4y.
   ipfs.dweb.link/ul2/ul220b . It may take some hours for everything to
   get pinned on web3.storage .
   They still need porting or wrapping in a framework, to use.
   As time passes, of course, more things will happen in the world by
   people more capable and normal than I.

   It looks like huggingface has scripts to convert these to their pytorch
   format,
   at [5]https://github.com/huggingface/transformers/tree/main/src/transfo
   rmers/models/t5 . Somebody has likely done that already, elsewhere. I
   guess I'm used to that interface, although I'm thinking a little that
   it's not the most flexible.

References

   1. mailto:gmkarl@gmail.com
   2. mailto:gmkarl@gmail.com
   3. https://github.com/google-research/google-research
   4. https://bafybeialobgoggqrgxdewvi3ndj7cmqqq57qzcgcs65fvm32iste5hei4y.ipfs.dweb.link/ul2/ul220b
   5. https://github.com/huggingface/transformers/tree/main/src/transformers/models/t5