I loaded journal entries from the past 10 years into GPT-3—and started asking it questions – This might be the way to do my next online resume and the book website. Basically, index and summarize, which sounds perfect.
I realize that this approach could replace the finetuning of the GPT-2 models. This makes it extremely general. There could be a book agent, Twitter agent, or even a SBIR agent.
And because it is finding text “chunks” based on embedding similarity to the prompt, it can point back to the sources. That makes research into a subject where the corpora exists much better.
Going to dig into this some more.
Elicit.org is also doing something like this. Here’s the thread:
This is very good: