0936
How to write the sum files to make checking easy?
So, data comes in. Sum file goes parallel to other data leaves. We could give it the same name if other sums had a name that always sorted after or separately.
We could give it a different extension. Like .sum and .sums or such.
My autocorrect turned sumsum into sums. Not often I accept what it does. Sometimes it has me capitalise words in the middle of sentences and such.
0940 using .check for single files
So, then we can sum all the .check files into a further file I suppose.
0942
Ok um
So
Um
./check *.checks *.check # seems to work fine
When making new .checks files, increment a counter by 1 or such
Maybe we can use date
Date works
Ok when making new check files, in theory we only need the last created one, and the one just made.
0946
My scripts could be simplified if one read from stdin instead of a file.
0948
Oops! It seeks to 0 repeatedly. That wasn't the right idea.
0951
Ok the system is busy testing stuff.
1015
1019
Okay, I'm testing a little now. Hashing a lot of data takes ages on a raspberry pi. The current script is written to do all the hashes and move forward when they are done, but the user really would want some string to verify with before it is done.
With the current file approach, that could mean a separate file for the first hash, or each hash.
It might be more organised to hash based on lines rather than filenames.
Meanwhile, my lotus client finished a task.
1020
ERROR: generating unsealed CID: Piece is larger than sector.
So, filecoin needs data in 32GiB chunks at the largest. I can delete my 64GiB test files.
1021