[ot][log][journal?] koboldai use progression
Undescribed Horrific Abuse, One Victim & Survivor of Many
gmkarl at gmail.com
Fri Feb 17 08:27:28 PST 2023
per “request” i implemented a simple api myself. i have not published
it to pypi or reddit or added a setup script. i made some small notes
that could be similar to how a language model might automate such a
task alongside as notes.txt . i might share on reddit i’m somewhat
confused.
https://github.com/xloem/simplekobold
# simplekobold
This is only a tiny implementation.
In the future when implementing an API, maybe make a doc showing a small
scratchpad of information, using short context windows, as you do so. Then
likely a system like langchain could be used to replicate the work
automatically, based on the notes.
## example
```
# import
from simplekobold import SimpleHorde
# construct
horde = SimpleHorde()
# get available models
models = await horde.status_models()
# sort models by availability first and performance second
models.sort(key = lambda model: (model.get('queued'),
-model.get('performance')))
# generate text
texts = await horde.generate('Once upon a time,',
models=[models[0]['name']], n=1)
# output result
print('Once upon a time', texts[0])
```
More information about the cypherpunks
mailing list