Dont you (forget NLP): Prompt injection with control characters in ChatGPT

• As part of this work, we recently observed some unusual behavior with two popular large language models from OpenAI, in which control characters (like backspace) are interpreted as tokens. This can lead to situations where user-controlled input can circumvent system instructions designed to constrain the question and information context. In extreme cases, the models will also hallucinate or respond with an answer to a completely different question.

SBIRs

• 2 hour meeting in Moorestown with a 2.5 hour drive each way. Not sure it’s worth it, but the meeting went well,
• Closed out my stories, made slides, and created new stories. Still need to do one for the IS Dept presentation on the 22nd