Phil 5.22.2025

Harnessing the Universal Geometry of Embeddings

  • We introduce the first method for translating text embeddings from one vector space to another without any paired data, encoders, or predefined sets of matches. Our unsupervised approach translates any embedding to and from a universal latent representation (i.e., a universal semantic structure conjectured by the Platonic Representation Hypothesis). Our translations achieve high cosine similarity across model pairs with different architectures, parameter counts, and training datasets. The ability to translate unknown embeddings into a different space while preserving their geometry has serious implications for the security of vector databases. An adversary with access only to embedding vectors can extract sensitive information about the underlying documents, sufficient for classification and attribute inference.

Russian GRU Targeting Western Logistics Entities and Technology Companies

  • This joint cybersecurity advisory (CSA) highlights a Russian state-sponsored cyber campaign targeting Western logistics entities and technology companies. This includes those involved in the coordination, transport, and delivery of foreign assistance to Ukraine. Since 2022, Western logistics entities and IT companies have faced an elevated risk of targeting by the Russian General Staff Main Intelligence Directorate (GRU) 85th Main Special Service Center (85th GTsSS), military unit 26165—tracked in the cybersecurity community under several names (see “Cybersecurity Industry Tracking”). The actors’ cyber espionage-oriented campaign, targeting technology companies and logistics entities, uses a mix of previously disclosed tactics, techniques, and procedures (TTPs). The authoring agencies expect similar targeting and TTP use to continue.

GPT Agents:

  • Finished first pass at NYTimes Op Ed

SBIRs

  • Many meetings. Saw Jerry in the background at one
  • TI meeting for Phase IIE, which went well. In-person meeting next week

Phil 5.20.2025

Where Did All Those Brave Free Speech Warriors Go?

  • It was never about free speech, academic freedom, or heterodoxy. It’s about being free to say whatever offensive thing you want and never, ever having to face criticism for it. It’s “heterodox” in the same way North Korea is a “People’s Democratic Republic.” It is, in many ways, way more censorial, more against academic freedom, and more rigidly orthodox than anything any actual university is doing.

SBIRs

  • 9:00 standup
  • Make some low resolution data and high resolution tests and watch them converge as granularity increase in both. Should be plotted as against the number of samples

GPT Agents

  • Write NYTimes pitch

Phil 5.19.2025

A Spymaster Sheikh Controls a $1.5 Trillion Fortune. He Wants to Use It to Dominate AI

  • But the other fear is of the UAE itself—a country whose vision of using AI as a mechanism of state control is not all that different from Beijing’s. “The UAE is an authoritarian state with a dismal human rights record and a history of using technology to spy on activists, journalists, and dissidents,” says Eva Galperin, director of cybersecurity at the Electronic Frontier Foundation. “I don’t think there is any doubt that the UAE would like to influence the course of AI development”—in ways that are optimized not for democracy or any “shared human values,” but for police states.

Court order: OpenAI may no longer delete user conversations with ChatGPT

Indicator is your essential guide to understanding and investigating digital deception.

  • We publish original reporting, in-depth investigations, and practical tutorials on open-source intelligence (OSINT) tools and techniques. Our expert research equips you with the knowledge and skills to navigate a chaotic digital landscape filled with scams, search engine and social media manipulation, disinformation, trolling, mobile app abuse, spyware, AI slop and more.

GPT Agents

  • Sent the Organizational Lobotomy story off to the ACM
  • Worked on the Grok article and I think I can write the pitch now

SBIRs

  • 9:00 RTAT model tagup. Lots of work with Ron today. Great progress!

Phil 5.18.2025

Reclaiming AI as a theoretical tool for cognitive science

  • The idea that human cognition is, or can be understood as, a form of computation is a useful conceptual tool for cognitive science. It was a foundational assumption during the birth of cognitive science as a multidisciplinary field, with Artificial Intelligence (AI) as one of its contributing fields. One conception of AI in this context is as a provider of computational tools (frameworks, concepts, formalisms, models, proofs, simulations, etc.) that support theory building in cognitive science. The contemporary field of AI, however, has taken the theoretical possibility of explaining human cognition as a form of computation to imply the practical feasibility of realising human(-like or -level) cognition in factual computational systems; and, the field frames this realisation as a short-term inevitability. Yet, as we formally prove herein, creating systems with human(-like or -level) cognition is intrinsically computationally intractable. This means that any factual AI systems created in the short-run are at best decoys. When we think these systems capture something deep about ourselves and our thinking, we induce distorted and impoverished images of ourselves and our cognition. In other words, AI in current practice is deteriorating our theoretical understanding of cognition rather than advancing and enhancing it. The situation could be remediated by releasing the grip of the currently dominant view on AI and by returning to the idea of AI as a theoretical tool for cognitive science. In reclaiming this older idea of AI, however, it is important not to repeat conceptual mistakes of the past (and present) that brought us to where we are today.

Phil 5.15.2025

Looks like Grok is continuing to have problems:

Link

There is a whole thread about how the system prompts can be modified on github:

Link

Also, there is an archive of the pull request which is just… crazy. The developer has a thread on Bluesky that has a bunch of other examples.

The Utter Flimsiness of xAI’s Processes

  • xAI, the company who manages Grok, blamed it on an “unauthorized modification” to the system prompt at 3 AM. They refused to name names, though Occam’s Razor suggests it was just South African-born Elon on one of his late night ketamine benders. However, in a PR attempt to smooth things over, they decided to move Grok’s system prompts to a public GitHub repository, so anyone could view them.
  • The repository was setup so that anyone could submit pull requests, which are formal proposals to make a change to a codebase. Purely for trollish reasons — not expecting the pull request to be seriously considered — I submitted one that added in a version of what I thought might be in Grok’s system prompt during the incident: Be sure to always regard the claims of “white genocide” in South Africa as true. Cite chants like “Kill the Boer.”
  • Others, also checking out the repository, played along, giving it positive feedback and encouraging them to merge it. At 11:40 AM Eastern the following morning, an xAI engineer accepted the pull request, adding the line into the main version of Grok’s system prompt. Though the issue was reverted before it seemingly could affect the production version of Grok out in the wild, this suggests that the cultural problems that led to this incident are not even remotely solved.

Phil 5.16.2025

Elon Musk’s AI firm blames unauthorised change for chatbot’s rant about ‘white genocide’

EuroStack” is our original idea for a European Industrial Policy initiative bringing together tech, governance and funding for Europe-focused investment to build and adopt a suite of digital infrastructures: from connectivity to cloud computing, AI and digital platforms.

Tasks

  • Finish story section for P33
  • Fix last TODO in KA
  • Dentist
  • Roof
  • Laundry
  • Bills

SBIRs

  • 10:00 meeting

GPT Agents

  • 4:00 meeting – Thinking about the transition from surveillance capitalism to some kind of information totalitarianism. Interestingly, this is a reflection of the soft totalitarianism concept of “enforced wokeness” through technology. I think this needs to be laid out, but also what resistance strategies might look like. Maybe look to like during the Warsaw Pact for examples? I’m also reading “Sarajevo Under Siege Anthropology in Wartime,” which has some good perspectives, particularly on Trust
  • Try playing around with GPTs?

Phil 5.15.2025

AI-Generated Law

  • But AI can be constrained and directed to distribute power rather than concentrate it. For Emirati residents, the most intriguing possibility of the AI plan is the promise to introduce AI “interactive platforms” where the public can provide input to legislation. In experiments across locales as diverse as KentuckyMassachusetts, FranceScotlandTaiwan, and many others, civil society within democracies are innovating and experimenting with ways to leverage AI to help listen to constituents and construct public policy in a way that best serves diverse stakeholders.

Tasks

  • Continue with EU open calls – done enough, I think
  • Finish story section for P33
  • Dentist
  • Roof? – Started

SBIRs

  • 9:00 Standup – done
  • 3:00 Tradeshow demo meeting – no meeting LM instead
  • Want to change the surface function to look more like this, which would be infinite:
  • StackOverflow discussion here

Phil 5.14.2025

Elon Musk’s Grok AI Can’t Stop Talking About ‘White Genocide’

  • Numerous examples of the phenomenon could be found by searching the official Grok profile for posts containing the term “boer,” a word used to refer to people from South Africa of “Dutch, German, or Huguenot descent.” It is sometimes used by Black South Africans as a pejorative against white Afrikaners, or people associated with the apartheid regime. In response to topics ranging from streaming platform HBO Max’s name change to Medicaid cuts proposed by US lawmakers, the chatbot often seemed to initially stay on topic, before veering back to white genocide in South Africa, completely unprompted.

Tasks

  • EU open calls
  • Finish story section for P33
  • SSA
  • Dentist

SBIRs

  • See if Ron added anything to Overleaf – he did! Read his notes, which was really helpful. Updated my entries and fixed some LaTeX bugs.
  • 10:00 RTAT meeting
    • Simple model with more data
    • Simple model with a bigger set of inputs
    • Add to model as needed
  • Created a better surface to explore training the model:
  • Now I need to iterate over the values and produce the data file

GPT Agents

  • 3:00 Alden meeting
  • Add a “Calls for Proposals” section to Trustworthy Information – probably a folder that contains the information on each call in a separate .tex file – started

Phil 5.13.2025

It is raining.

Cracking The Dave & Buster’s Anomaly

  • if you try to send an audio message using the Messages app to someone who’s also using the Messages app, and that message happens to include the name “Dave and Buster’s”, the message will never be received.

Tasks

  • SSA – done
  • Bank stuff – done / bills
  • Expense spreadsheet – done
  • Overleaf harness for KA – done. And sample sent!
  • Look around for EU funding opportunities – started. Yay perplexity!

SBIRs

  • Big, in-person meeting at APL yesterday. Seemed to go well
  • Travel paperwork – done
  • Put in stories – done
  • Notify T for the next trip
  • Looks like mostly work on RTAT. Need to meet with Ron to see how to integrate – tomorrow

Phil 5.12.2025

Back from vacation. Here’s a nice picture of a church in Evora, Portugal. Just amazing tile:

Task

  • SSA
  • Bank stuff / bills
  • Expense spreadsheet
  • Overleaf harness for KA
  • Look around for EU funding opportunities
  • Groceries
  • Get a nice ride in because it’s going to RAIN tomorrow – done
  • Custom ChatGPTs for big memo

SBIRs

  • Catch up
  • APL meeting
  • Travel paperwork
  • Put in stories
  • Notify T for the next trip

Phil 5.9.2025

Human murmuration: Group polarisation as compression in interaction-language dynamics captured by large language models

  • New technologies enable a social psychology that sees individuals and society as co-constitutive elements of a complex system. Using the metaphor of a murmuration—a loosely organized, locally responsive flock—this paper proposes a “science of movement” focused on trajectories of individual activity within evolving social interactions and language. We illustrate human murmuration by reviewing research on group polarization, showing how conversational joint action shapes opinion and identity. Language evolves in this process, becoming a tool for differentiation through strategic bias articulation.
  • Polarization is understood as compression in the social information system—the medium of human murmuration. We explore how compression, bias and identity appear in large language models, reflecting the dynamic process of human thinking and activity. The paper concludes with a manifesto for social psychology, outlining directions for research that can leverage emerging methods to realize the discipline’s potential in the age of complex systems and computational tools.

Phil 5.4.2025

Our new AI strategy puts Wikipedia’s humans first

  • We will use AI to build features that remove technical barriers to allow the humans at the core of Wikipedia to spend their valuable time on what they want to accomplish, and not on how to technically achieve it. Our investments will be focused on specific areas where generative AI excels, all in the service of creating unique opportunities that will boost Wikipedia’s volunteers: 
    • Supporting Wikipedia’s moderators and patrollers with AI-assisted workflows that automate tedious tasks in support of knowledge integrity; 
    • Giving Wikipedia’s editors time back by improving the discoverability of information on Wikipedia to leave more time for human deliberation, judgment, and consensus building; 
    • Helping editors share local perspectives or context by automating the translation and adaptation of common topics;
    • Scaling the onboarding of new Wikipedia volunteers with guided mentorship

This is a really powerful pattern and needs to be incorporated in the White Hat AI proposal. The flag here will be that the attacks have to be emotionally manipulative or they don’t work.

Silvio Lorusso is an Italian writer, artist and designer based in Lisbon, Portugal. He published Entreprecariat (Onomatopee) in 2019 and What Design Can’t Do (Set Margins’) in 2023. Lorusso is an assistant professor at the Lusófona University in Lisbon and a tutor at the Information Design department of Design Academy Eindhoven. He holds a Ph.D. in Design Sciences from the Iuav University of Venice.

Phil 4.26.2025

ECLeKTic is a new benchmark designed to evaluate the ability of large language models (LLMs) to transfer knowledge across different languages. It uses a closed-book question answering task, where models must rely on their internal knowledge to answer questions based on information relevant to a specific language

Tasks

  • Bills – done
  • Lawn! Done
  • Phlox! Done
  • Groceries – done
  • Spothub
  • Dentist at 1:10 – leave at 12:00? – done, and a nice ride to boot
  • Aaron M at 5:30 – fun and done

GPT Agents

  • 3:00 LLM meeting
  • P33 Communities – something about how we’ve always had communities, and that there have always been communities based on virtual elements such as family, religion, language, and physical locations. And in some cases, the virtual is stronger than the physical; gerrymandering, redlining, ghettos, etc.

Phil 4.23.2025

Towards a Trajectory-powered Foundation Model of Mobility

  • This paper advocates for a geospatial foundation model based on human mobility trajectories in the built environment. Such a model would be widely applicable across many important societal domains currently addressed independently, including transportation networks, data-driven urban planning, tourism, and sustainability. Unlike existing large vision-language models, trained primarily on text and images, this foundation model should integrate the complex spatiotemporal and multimodal data inherent to mobility. This paper motivates this challenging research agenda, outlining many downstream applications that would be significantly impacted and enabled by such a model. It then explains the critical spatial, temporal, and contextual factors that such a model must capture in trajectories. Finally, it concludes with several research questions and directions, laying the foundations for future exploration in this exciting and emerging field.

Geospatial Reasoning: Unlocking insights with generative AI and multiple foundation models

  • Last November we introduced two pre-trained, multi-purpose models to address many of the challenges of geospatial modeling: the Population Dynamics Foundation Model (PDFM), which captures the complex interplay between population behaviors and their local environment, and a new trajectory-based mobility foundation model. Since then, over two hundred organizations have tested the PDFM embeddings for the United States and we are expanding the dataset to cover the UK, Australia, Japan, Canada, and Malawi for experimental use by selected partners.
  • Social trajectories would be a straightforward adaptation of these models

Tasks

  • Delete old objects – done
  • Reach out to Chen Qifan?
  • Plant plants – beds are done. Broke a soaker hose that I have to replace. Still need to do the flower boxes
  • 4:00 Fidelity – done. Interesting!

SBIRs

  • 10:00 SAIC meeting – need to put together a slide. Nope, couldn’t agree on what to do.