20 Feb
2023
20 Feb
'23
8 p.m.
This example is now at https://github.com/xloem/gitrepository.git . It presently runs the facebook/opt-iml-max-30b model locally using langchain and uses 60GB of vram. It doesn't know how to write code: Human: write a hello world program in python AI: Hello world! Human: like def hello_world(): AI: Hello world! It would make sense to upgrade it to a fancier langchain example. Maybe to make it an agent or something.