It’s been a busy week
US will have Greenland ‘one way or the other’, says Trump – Europe live
Trump tells Cuba to ‘make a deal’ or face the consequences
Homeland security sends more agents to Minneapolis as protests erupt in US
There is a developing consensus that this is the tail wagging the dog: US justice department has released less than 1% of Epstein files, filing reveals
Tasks
- Trash
- Look through the bank stuff and see if there is enough to open an account
SBIRs
- Work on loading arrays.
- See how big all the files are. Iterate over all the pkl files but don’t keep anything, just increment the memory size value and the number of vectors. create a list of dicts
- Sort the list by memory, and try loading up all the small ones until 14GB is passed. See if that works. If it does, use those to create a mapping
- Based on the overall size of the pkl footprint, determine an optimal subsampling strategy
- See how much it would cost to use a bigger box
- Maybe try the NN approach? Possibly in steps until the array is the size that can fit in memory?
