Inside the AI Revolution: A Two-Day Odyssey at École Polytechnique

• The article is annoying AI writing, but if you can get past that, the content is pretty good

• Oddly, in some ways I disagree with this. It is the hallucinatory elements of LLMs that are the most interesting.

A language model built for the public good

• ETH Zurich and EPFL will release a large language model (LLM) developed on public infrastructure. Trained on the “Alps” supercomputer at the Swiss National Supercomputing Centre (CSCS), the new LLM marks a milestone in open-source AI and multilingual excellence.

Apertus: A fully open, transparent, multilingual language model

• EPFL, ETH Zurich and the Swiss National Supercomputing Centre (CSCS) released Apertus today, Switzerland’s first large-scale, open, multilingual language model — a milestone in generative AI for transparency and diversity.
• The model on HF

Tasks

• Pinged Dr. Veronica Riniolo, and she responded that I need to apply for the activity. So:
  • Set up COST account – done
  • Finish application. I think I need to bundle all the relevant abstracts and use them for the 150 word descriptions. Done! That took a while
• Groceries – return the fuzzy tomatoes, drop off the plastic, and swing by TJ
• Rolling in V’s edits – done!
• Need to see about LLC tomorrow

SBIRs

• Roll in text as it becomes available
• Start looking at GPT-2 layers again. I want to make animations first