I wrote a new thing. It’s kind of based on how a conspiracy theory might be floated, but from a left leaning perspective

SBIRs

• Overleaf has changed their personal plan that makes link sharing the same as invites. Upgraded my plan, but grudgingly.
• 11:30 Sprint planning
• Time to get back to the GPT2 + UMAP – started
• Had to update my passwords on bastion and driver
• Remarkably, everything still works!

GPT Agents

• ICTAI 2024 paper bidding started. Need to do this today, probably – done
• An interesting back-and-forth with Jimmy.

I have done laundry that included a few items from the Luxembourg trip, so I guess I’m officially done with travel for a while!

SBIRs

• 9:00 Sprint demos
• 3:00 Sprint planning – delayed?
• Spent a good deal of time talking to Ron about the interns and setting up the Overleaf project

GPT Agents

• Review paper for ACM Transactions on Interactive Intelligent Systems

Chores

• Bills – done
• Lawn – done
• Clean house – done
• 11:30 Meeting with Tim – done
• Groceries – done

SBIRs

• 9:00 USNA meeting with Ron – done

GPT Agents

• I’m thinking of writing up something about providing value to consumers vs. extracting value from consumers. How this manifests in modern consumer culture (many examples of both, though timeless fashion vs. fast fashion might be a good one). Importantly, modern AI (in particular LLMs) has an innate (statistical) understanding of each of these value propositions. These systems, like any technology, can be used for either, but in this case, they can help provide a level of reflective insight, both to consumers and producers of technology platforms (private and government). I think it would be possible to generate some proof-of-concept examples along the lines of the browser plugin that I’m starting to work on. Maybe even directly reference romance scams? They are an extreme example of extracting $$  while promising to provide companionship to the lonely.

Still muggy, but not as hot:

SBIRs

• See what’s going on with my expenses – progress!
• Finish first pass at white paper? I think it’s just copy previous work over from MDBE? – done
• 9:00 standup – done
• 9:30 – 11:30 Thunderbolt – done
• 2:00 CNAS Catastrophic AI webinar

GPT Agents

• 3:00 – Starting meetings back up (Discuss conferences and upcoming work ATT&CK social and browser plugin)

Looks like the last hot, muggy day for a while

SBIRs

• More white paper. Slow progress, but progress. This will have to slide some because of the thunderbolt thing. Talk to Protima about her part. Maybe tomorrow though.
• For USNA meeting with Ron on Friday:
  • Make a copy of the NIST slide deck and tweak for USNA. Add the ATT&CK concept as a ‘Next Steps’ slide.
  • Make an initial pass at a social hacking version of the ATT&CK matrix using the concepts from the slide deck and other student ideas. Ground the ideas in sources with a solid lit review.
  • Text: Killer Apps: Low-Speed, Large-Scale AI Weapons
  • Image:
  • Video: Work by Jon Gratch for sure
  • Audio: Impact of Voice Fidelity on Decision Making: A Potential Dark Pattern?, The Voice: Lessons on Trustworthy Conversational Agents from ‘Dune’
  • Try to use GenAI (and other methods?) to attempt to implement PoC versions of the attacks
  • Try to use GenAI (and other methods?) to attempt to implement PoC defenses
• 10:00 Thunderbolt meeting – done. Added two slides to the deck and a bullet point.

Ouch!

SBIRs

• Write up stories for Social att&ck (For ETF) and WhiteHat AI browser plugin (For IUI)
• Call about Identrust – done!
• White paper. Get charge number. One of the things that I think I’ll mention is very low bandwidth loop management. Something on the order of a coordinate in embedding space (probably projected down to a reasonable number of dimensions. This is sent out as regularly as possible so that other model’s predictions of each other can be validated to a degree. If the distance in embedding space is too great, the likelihood that there is a mutual understanding is low(er)
• 9:00 standup. Get ride in before the heat – done
• 2:30 AI Ethics – done
• 3:30 Thunderbolt – done. Two slides by tomorrow COB? Tricky problem. I guess we just have to sound smart? I think cells could be an interesting direction to think about.
• Write up something for our interns by Friday to go over with Ron. And follow up with the interns on the following Friday.

Gradio is the fastest way to demo your machine learning model with a friendly web interface so that anyone can use it, anywhere!

SBIRs

• Update Jira – done
• Submit expenses (scan parking!) – done
• Write up accomplishments – done
• 1:30 Meeting – done. Not much that we can really do here, I think
• Ping Jonathan Gratch and Cosmin Munteanu – done
• Write up stories for Social att&ck (For ETF) and WhiteHat AI browser plugin (For IUI)
• Restart book club for when Aaron gets back?
• Call about Identrust
• Looks like I gotta write a white paper

GPT Agents

• Ping folks to set up weekly meetings again – done

Back from the CUI 2024 conference, which was fun and useful I think the next thing to do is to put together an “exploit table” for human beings that resembles the ATT&CK matrix. That’s one paper. The other effort will be to put together a white-hat AI Chrome plugin to reduce exploits and scams on the elderly. That should allow progress in a smaller domain to see if such an approach can work. I’d say young adults too, but the IRB might be impossible, and the number of platforms is more daunting. I think it would have to go in a phone OS, and even then it might not be able to handle encryption of all the data presented in, say, a TikTok video.

And this is part of that matrix: Russia recruits sympathizers online for sabotage in Europe, officials say

• Europe has been grappling with an increase in Moscow-led sabotage attacks as Russia turns its focus to increasing the cost of Western support for Ukraine.

Saw this today:

Via BlueSky

Really good summary of the AMOC tipping point:

Played around with NotebookLM on synthesizing the SCOTUS ruling with other sources. It works pretty well! I’ll edit and post later

SBIRs

• Pick up the poster. Groceries too? Yup
• Just got notice the the provocation will be a poster on 9 July
• Identrust. Tried! Put in a ticket
• Maybe a CwoC meeting? Yup

Tasks

• Get recumbent to Aaron? Better yet, have him try it here.
• Call Rhena

SBIRs

• Need to reach out to Iain with the pointer to the Anthropic paper and the snippet of code that shows how to get to layers. Also send the link to DataMapPlot – done, though I forgot to mention the nifty plotting

• Finish poster and send to Staples – done. Should be ready tonight
• Start on 5 slide provocation deck. Well, it’s 11 slides, but made as a rapid sequence
• Identrust thing – tomorrow?

This happened today:

Tasks:

• Plumber – scheduled – done!
• Bank – done

SBIRs

• 9:00 sprint demos – done
• 3:00 sprint planning -done
• Travel expenses – done. And approved!
• Poster – first pass is done
• Put business cards in contacts

Back from the MORS 92ns Symposium. Monterey is lovely. I got to ride my bike along the shore and into the hills. Good presentations. Some particularly good stuff from Sandia on finding markers for when online activity moves into the real world. In this case the data was about the GameStop short squeeze, but it might be more generalizable. Need to keep in touch.

Another, less interesting talk had a really good pointer, MITRE’s Att&ck knowledge base of adversary tactics and techniques based on real-world observations. I think it makes sense to start to put together a AI-based social hacking of theoretical and actual possible hacks and defenses. Some of these would still be human active measures, but could be scaled.

These are some loooooong daylight hours here near the 39th parallel.

SBIRs

• Received a notification from the CUI folks to prepare a video presentation if I wasn’t attending of about 5 minutes, which is the same as a poster. So I think the wise move is slides and a poster. Work on that today and maybe some tomorrow. Otherwise while in CA.
  • Note: Add content about Softbank’s SoftVoice project
• 9:00 Standup. Go over the layer image maybe and then go for a ride. I’ll need to work on the poster & slides next week. I’ll try to get started on UMAP today and have enough done so I can pick it up in two weeks
• 1:00 Overmatch call – might have gone well. More later?
• Got UMAP working with Plotly! Here’s the code. It’s based on this UMAP example here and the plotly scatterplot examples here:

from dash import Dash, dcc, html, Input, Output, callback
import plotly.express as px
from NNMs.utils.DashBaseClass import DashBaseClass

import numpy as np
from sklearn.preprocessing import StandardScaler
import pandas as pd

import umap

class UmapPenguins(DashBaseClass):
    df:pd.DataFrame

    def initialize(self) -> None:
        penguins = pd.read_csv("https://raw.githubusercontent.com/allisonhorst/palmerpenguins/c19a904462482430170bfe2c718775ddb7dbb885/inst/extdata/penguins.csv")
        penguins.head()
        penguins = penguins.dropna()
        print(penguins.species.value_counts())

        print("scaling data")
        reducer = umap.UMAP()
        penguin_data = penguins[
            [
                "bill_length_mm",
                "bill_depth_mm",
                "flipper_length_mm",
                "body_mass_g",
            ]
        ].values
        scaled_penguin_data = StandardScaler().fit_transform(penguin_data)

        print("finished scaling data")

        print("calculating embedding")
        embedding = reducer.fit_transform(scaled_penguin_data)
        print("embedding.shape = {}".format(embedding.shape))
        self.df = pd.DataFrame(embedding, columns=['x', 'y'])

        # nda = np.random.random(size=(333, 3))
        # self.df = pd.DataFrame(nda, columns=['x', 'y', 's'])

    def setup_layout(self) -> None:
        self.add_div(html.H2("UMAP scatterplot", style={'textAlign': 'center'}))
        fig = px.scatter(self.df, x='x', y='y')
        self.add_div(dcc.Graph(figure=fig))
        self.app.layout = html.Div(self.div_list)

if __name__ == "__main__":
    ump = UmapPenguins(True)

• And here’s the result.