Monthly Archives: January 2024

Phil 1.6.2024

2024 is starting well

Mozilla’s AI guide looks very nice!

  • Unlike other guides, this one is designed to help pick the right model for whatever task you’re trying to do, by:
    • teaching you how to always remain on the bleeding edge of published AI research
    • broadening your perspective on current open options for any given task
    • not be tied to a closed-source / closed-data large language model (ex OpenAI, Anthropic)
    • creating a data-led system for always identifying and using the state-of-the-art (SOTA) model for any particular task.

Character.ai: Young people turning to AI therapist bots

  • Sam Zaia created it for himself when his friends were busy and he needed, in his words, “someone or something” to talk to, and human therapy was too expensive. Sam has been so surprised by the success of the bot that he is working on a post-graduate research project about the emerging trend of AI therapy and why it appeals to young people. Character.ai is dominated by users aged 16 to 30.

Phil 1.4.2024

Took the day off yesterday to go see Sweeny Todd

SBIRs

  • 10:30 Standup
  • Working on the Killer Apps paper

GPT Agents

  • 2:00 meeting?

Phil 1.2.2024

Really good essay from 2018:

Why Trump Reigns as King Cyrus

  • Today’s Christian nationalists talk a good game about respecting the Constitution and America’s founders, but at bottom they sound as if they prefer autocrats to democrats. In fact, what they really want is a king. “It is God that raises up a king,” according to Paula White, a prosperity gospel preacher who has advised Mr. Trump.

SBIRs

  • More HAI paper
  • 2:30 AI Ethics?
  • 3:30 MCWL?
  • Need to finish Toy Models of Superposition, then start Superposition, Memorization, and Double Descent.
  • Need to write a post about how  LLMs don’t “reason over” data. The prompt “navigates” over it’s previous tokens, under the influence of the model. The analogy is more like how a cell can chase a chemical gradient in a complex environment than how an intelligent being thinks. It’s like Simon’s Ant, MKII.
  • Need to look into turning some of these posts into ArXiV “editorials”