This looks genuinely awesome, though I’m not sure if it’s that much better than incorporating illustrator images:

• TikZiT is a super simple GUI editor for graphs and string diagrams. Its native file format is a subset of PGF/TikZ, which means TikZiT files can be included directly in papers typeset using LaTeX. Pre-built versions are available for systems running Windows, Linux, or macOS. Packages are available for some Linux distributions, or you can build from source.

It also works with ChatGPT:

SBIRs

• Working a bit on the Killer Apps conclusions to put the DEPICT framework results in.
• And I got my first example of a RAG hallucination!

• It should be: Discrediting, Emotion, Polarization, Impersonation, Conspiracy, and Trolling

2024 is starting well

Mozilla’s AI guide looks very nice!

• Unlike other guides, this one is designed to help pick the right model for whatever task you’re trying to do, by:
  • teaching you how to always remain on the bleeding edge of published AI research
  • broadening your perspective on current open options for any given task
  • not be tied to a closed-source / closed-data large language model (ex OpenAI, Anthropic)
  • creating a data-led system for always identifying and using the state-of-the-art (SOTA) model for any particular task.

Character.ai: Young people turning to AI therapist bots

• Sam Zaia created it for himself when his friends were busy and he needed, in his words, “someone or something” to talk to, and human therapy was too expensive. Sam has been so surprised by the success of the bot that he is working on a post-graduate research project about the emerging trend of AI therapy and why it appeals to young people. Character.ai is dominated by users aged 16 to 30.

SBIRs

• Working on the Killer Apps paper. Finished the first pass within the page limit!

Took the day off yesterday to go see Sweeny Todd

SBIRs

• 10:30 Standup
• Working on the Killer Apps paper

GPT Agents

• 2:00 meeting?

Really good essay from 2018:

Why Trump Reigns as King Cyrus

• Today’s Christian nationalists talk a good game about respecting the Constitution and America’s founders, but at bottom they sound as if they prefer autocrats to democrats. In fact, what they really want is a king. “It is God that raises up a king,” according to Paula White, a prosperity gospel preacher who has advised Mr. Trump.

SBIRs

• More HAI paper
• 2:30 AI Ethics?
• 3:30 MCWL?
• Need to finish Toy Models of Superposition, then start Superposition, Memorization, and Double Descent.
• Need to write a post about how  LLMs don’t “reason over” data. The prompt “navigates” over it’s previous tokens, under the influence of the model. The analogy is more like how a cell can chase a chemical gradient in a complex environment than how an intelligent being thinks. It’s like Simon’s Ant, MKII.
• Need to look into turning some of these posts into ArXiV “editorials”

Seems like a good day to get some hours in:

SBIRs

• Working on the Killer Apps paper. Still moving over content from the book

Court records here. Pages 6, 86 – 89

Updated the RAG paper to reflect this

Good ride today in the unseasonably (new seasonably?) warm temps

HugingFace now has HuggingChat, which can be linked to multiple models. I wonder if there is an API? Looks like there is this unofficial one

SBIRs

• 9:00 standup
• Set up the HAI Overleaf using their template. The directions for preparing a submission file seem… unusual. Done! Pasted in a few sections from the book as placeholder

GPT Agents

• Back up the SIGCHI paper – done!
• 2:00 Meeting – couldn’t get in at first, but a good discussion about the paper.

SBIRs

• Spent all day writing the RAG paper. Finished the first draft!

Took in some lights and hosted some guests over the last few days

Why the simplest explanation isn’t always the best

• As Shinn underscores, what feels intuitive and simple can often mislead: dimensionality reduction optimizes for specific statistical features of the data, and doesn’t always agree with the most intuitive explanation.

Winter solstice. Going to see the lights at Longwood Gardens

GPT Agents

• Had a good (quick) chat with Jimmy and Shimei about the SIGCHI paper. We are in agreement that focusing on the RAG errors makes good sense
• Rough out the methods and results sections

SBIRs

• Had a good exchange with Julie about meeting with her AI/Cyber folks at NIST

40 hours until the days start getting longer!

Carbon offsets from the UN. Looks like I use about 18 tons according to their calculator. So get 75 for F&F. Done!

NewsGuard provides transparent tools to counter misinformation for readers, brands, and democracies. Since launching in 2018, its global staff of trained journalists and information specialists has collected, updated, and deployed more than 6.9 million data points on more than 35,000 news and information sources, and cataloged and tracked all of the top false narratives spreading online.

The rise of AI fake news is creating a ‘misinformation superspreader’

SBIRs

• Nothing scheduled?
• Pinged Julie to discuss AI & Cyber

GPT Agents

• Finish the analysis of Partials, then start framing out the paper for SIGCHI Late Breaking

Carbon credits!

SBIRs

• Submit request to charge for work on SIGCHI and 5th Workshop on Human-AI Co-Creation with Generative Models – done
• 9:00 Standup – done
• AI ethics? Cancelled
• OpenAI lays out plan for dealing with dangers of AI
  • OpenAI’s “Preparedness” team, led by MIT AI professor Aleksander Madry, will hire AI researchers, computer scientists, national security experts and policy professionals to monitor the tech, continually test it and warn the company if it believes any of its AI capabilities are becoming dangerous.
  • OpenAI’s post
  • Openings, but I can’t find any job description?

GPT Agents

• Write a query that pulls all examples of all “with context” hallucinations and see what’s going on. It’s not many, and I suspect user problems. Done. It seems to be associated with unusual formatting. Working the unhelpful and partials. I think the angle is going to be that “Context helps a lot,” but it’s not a panacea. Errors leak through when the model can’t navigate the context effectively. At scale, this is millions of responses. Mitigation is going to be a version of Zeno’s paradox.
• Start framing out the paper. Created appropriate Overleaf doc.

Supported Radio Paradise. Now I need to get some carbon credits

3:00 Podcast

Lawn mower, dammit – done! Also door screen – done!

GPT_Agents

• Working on getting summed values as a tab in the spreadsheet – done
• Start framing out the paper
• Maybe put something together for the 5th Workshop on Human-AI Co-Creation with Generative Models? CfP Is Jan 15. I’d like to put in something on AI weapons. 5 – 10 pages

SBIR

• Need to finish Toy Models of Superposition, then start Superposition, Memorization, and Double Descent.
• RFdiffusion is an open source method for structure generation, with or without conditional information (a motif, target etc). It can perform a whole range of protein design challenges as we have outlined in the RFdiffusion paper.
• JSC discussion. Seems we’re on the hook for something other than we told them

Tasks

• 9:00 Dentist – looks like bone graft. Yike
• Dr. Diener

SBIRs

• Continuing Toy Models of Superposition, then starting Superposition, Memorization, and Double Descent.

GPT Agents

• Playing around with spreadsheets