[ot][log][journal?] koboldai use progression

Undescribed Horrific Abuse, One Victim & Survivor of Many gmkarl at gmail.com
Fri Feb 17 08:27:28 PST 2023


per “request” i implemented a simple api myself. i have not published
it to pypi or reddit or added a setup script. i made some small notes
that could be similar to how a language model might automate such a
task alongside as notes.txt . i might share on reddit i’m somewhat
confused.

https://github.com/xloem/simplekobold

# simplekobold

This is only a tiny implementation.

In the future when implementing an API, maybe make a doc showing a small
scratchpad of information, using short context windows, as you do so. Then
likely a system like langchain could be used to replicate the work
automatically, based on the notes.

## example

```
# import
from simplekobold import SimpleHorde

# construct
horde = SimpleHorde()

# get available models
models = await horde.status_models()

# sort models by availability first and performance second
models.sort(key = lambda model: (model.get('queued'),
-model.get('performance')))

# generate text
texts = await horde.generate('Once upon a time,',
models=[models[0]['name']], n=1)

# output result
print('Once upon a time', texts[0])
```


More information about the cypherpunks mailing list