25 Jan
2022
25 Jan
'22
11:08 a.m.
08: key_chunk_size = min(key_chunk_size, num_kv) It's the first dimension of the keys and values that will be split. 09: query = query / jnp.sqrt(k_features) # i typed a lot of comments on lines but they disappeared again. i plan to return to line 09 above because i'm not sure why it is. i skipped the inner functions to start with, and am working on copying over lines 30 and 31. sending to preserve.