The linked article appears a handful of good examples of the result of the obscure way in which these models are presented. If their logits were labeled with regard to meaning — labels which, after skimming the article and its links, they could obviously generate themselves — it would not appear magic but rather a precise situation with a multitude of clear and meaningful parameters that even novice humans could step into and manually refine.