1 Dec
2023
1 Dec
'23
3:13 p.m.
[from, if training transformers were an actual data average by tracking symbolic gradients across thresholds] something i’ve done sometimes is try to make a symbolic equation solver. this usually goes away about halfway through, but something that’s interesting about it is that it’s clearly not very complicated to do. it’s also a bit of a big work. anyway it seems it’s useful to have a symbolic algebra framework. maybe i could use a thread like this to draft such things/more. class Expression {}; class OperatorExpression {}; // an expression that is the evaluation of a parameterized operator on operands (could elide into Expression); class Operator {};