Phil 4.8.21

Print and mail taxes today

How many data points is a prompt worth?

  • Prompts are interesting because they allow a practitioner to give information to the model, although in a very different fashion from standard ML supervision. In our NAACL 2021 paper with Sasha Rush, we investigate prompt-based fine-tuning, a promising alternative fine-tuning approach, and find that prompts often yield an edge over the standard approach. As we interpret a prompt as additional human-crafted information for the model, we measure that edge in terms of data points and quantify: how many data points is a prompt worth?


  • 9:15 IRAD standup
  • 11:00 Meeting with Orest
  • Make slide for Aaron
  • More work with Rukan


GPT Agents

  • More writing