7:00 – 5:00 ASRC MKT
- From zero to research — An introduction to Meta-learning
- Thomas Wolf Machine Learning, Natural Language Processing & Deep learning – Science Lead @ Huggingface (We’re on a journey to build the first truly social artificial intelligence. Along the way, we contribute to the development of technology for the better.)
Over the last months, I have been playing and experimenting quite a lot with meta-learning models for Natural Language Processing and will be presenting some of this work at ICLR, next month in Vancouver 🇨🇦 — come say hi! 👋 In this post, I will start by making a very visual introduction to meta-learning, from zero to current research work. Then, we will code a meta-learning model in PyTorch from scratch and I will share some of the lessons learned on this project.
- Google veteran Jeff Dean takes over as company’s AI chief
- Add some MB framing words to the game theory part of the lit review – done
- Work on the PSA writeup
Our research has indicated that an awareness of nomadic/explorer activity in belief space may help nudge stampeding groups away from a terminal trajectory and back towards “average” beliefs. Tajfel states that groups can exist “in opposition”, so providing counter-narratives may be ineffective. Rather, we think that a practical solution to online polarization is the injection of diversity into user’s feeds, be they social media, search results, videos, etc. The infrastructure exists for this already in platform’s support of advertising. The precedent is the Public Service Announcement (PSA).
US Broadcasters since 1927, have been obligated to “serve the public interest” in exchange for spectrum rights. One way that this has been addressed is through the creation of the PSA, “the purpose of which is to improve the health, safety, welfare, or enhancement of people’s lives and the more effective and beneficial functioning of their community, state or region”
We believe that PSAs can be repurposed to support diversity injection through the following:
- Random, non-political content designed to expand information horizons, analogous to clicking the “random article” link on Wikipedia.
- Progressive levels of detail starting with an informative “hook” presented in social feeds or search results. Users should be able to explore as much or as little as they want.
- Simultaneous presentation to large populations. Google has been approximating this with their “doodle” since 1998, with widespread positive feedback, which indicates that there may be good receptivity to common serendipitous information.
- Format should reflect the medium, Text, images and videos.
- Content should be easily verifiable, recognizable, and difficult to spoof.
We believe that such diversity injection mechanisms as described above can serve as a “first do no harm” first step in addressing the current crisis of misinformation. By nudging users towards an increased awareness of a wider world, which in turn interferes with the processes that lead to belief stampedes by increasing the number of dimensions, the awareness of different paths that others are taking. As we gain understanding of the mechanisms that influence group behaviors, it may be possible to further refine our designs and interfaces so that they no longer promote extremism while still providing value.
- Done with first draft? Nope. Going to rework the implications section some more.