7:00 – 8:00 ASRC GOES
This makes me happy. Older, but not slower. Yet.
- Maryland Anatomy Board Dept of vital records 410 764 2922 – Never got called back
- Ping Antonio about virtual crowdsourcing of opinion
- Dissertation – write up dissertation house one-pager
- Optimizer
- Generating chromosome sequences.
- Created a fitness landscape to evaluate
- Working on breeding and mutation
- ML Seminar
- Status, and a few more Andrew Ng segments. How to debug gradient descent
- Meeting With Aaron M
- Nice chat
- GARY MARCUS is a scientist, best-selling author, and entrepreneur. He is Founder and CEO of Robust.AI.
- His newest book, co-authored with Ernest Davis, Rebooting AI: Building Machines We Can Trust aims to shake up the field of artificial intelligence.
- Don’t put the transformer research in the dissertation
- Evolution of Representations in the Transformer (nice looking blog post of deeper paper)
- We look at the evolution of representations of individual tokens in Transformers trained with different training objectives (MT, LM, MLM – BERT-style) from the Information Bottleneck perspective and show, that:
- LMs gradually forget past when forming future;
- for MLMs, the evolution has the two stages of context encoding and token reconstruction;
- MT representations get refined with context, but less processing is happening.
- We look at the evolution of representations of individual tokens in Transformers trained with different training objectives (MT, LM, MLM – BERT-style) from the Information Bottleneck perspective and show, that:
- Different Spirals of Sameness: A Study of Content Sharing in Mainstream and Alternative Media
- In this paper, we analyze content sharing between news sources in the alternative and mainstream media using a dataset of 713K articles and 194 sources. We find that content sharing happens in tightly formed communities, and these communities represent relatively homogeneous portions of the media landscape. Through a mix-method analysis, we find several primary content sharing behaviors. First, we find that the vast majority of shared articles are only shared with similar news sources (i.e. same community). Second, we find that despite these echo-chambers of sharing, specific sources, such as The Drudge Report, mix content from both mainstream and conspiracy communities. Third, we show that while these differing communities do not always share news articles, they do report on the same events, but often with competing and counter-narratives. Overall, we find that the news is homogeneous within communities and diverse in between, creating different spirals of sameness.
viztales 