Brrr! Fall is here!

SBIRs

• Starting to work on the proposal. I want to use the concept of cyberspace, but as understood though embeddings. The hook is that the term “cyberspace” came out too early. It represented a need on the part of people experiencing the internet to be able to “navigate,” as opposed to “search.” It turned out that search was an easier problem, so we now have a search-based methodology for finding new content. Even recommender algorithms are search – they just use latent terms to promote items that will get your attention.
• But with “embeddings”, came a way to comprehend the vast amounts of online information in a spatial sense. The discovery that embeddings in deep neural network Language Models have a spatial relationship to one another that reflects human understanding is profound. That the equation king – man + woman = queen works in embedding space and matches our intuitive understanding implies that these models, trained on vast amounts of human-generated text, represent human understanding of information, belief, and opinion in discoverable ways.
• Games are at their core a way of exploring a domain constrained by rules in search of a winning condition. Neural networks and embeddings provide a new way to quantify that process, increase understanding, and increase the likelihood that novel winning solutions will not be overlooked.

• Made a lot of progress. Let’s see how tomorrow goes. Book club!