Monthly Archives: February 2021

Phil 2.5.21

They Stormed the Capitol. Their Apps Tracked Them

  • While there were no names or phone numbers in the data, we were once again able to connect dozens of devices to their owners, tying anonymous locations back to names, home addresses, social networks and phone numbers of people in attendance. In one instance, three members of a single family were tracked in the data.

Book

  • 2:00 Meeting with Michelle

GOES

  • Run pure pitch/roll/yaw maneuvers
  • Yaw – really nice
https://viztales.com/wp-content/uploads/2021/02/image-4.png
  • Roll – WTaF?
https://viztales.com/wp-content/uploads/2021/02/image-5.png
  • Pitch – ok?
https://viztales.com/wp-content/uploads/2021/02/image-6.png
  • 11:00 Meeting with Vadim

GPT Agents

  • Install Ecco and try the intro (here in the video, also ranked choices, and token probability) locally, then message him to see if he’d like to discuss maps.
  • Have the code running locally (the NVIDIA update worked too!):
  • Messaged Jay Alamar on twitter. Working on setting up a video chat
  • Woohoo!
The IJCAI-21 summary reject phase has now ended and we are pleased to inform you that your submission #1558 "Navigating Human Language Models with Synthetic Agents" will enter the full-paper review phase. 
  • 3:30 Meeting

Phil 2.4.21

Book

  • Tweak the conclusions to add flocking and stampeding – closer to really done?

GOES

  • Finish adding script management – done!
  • There are issues though:
  • Adding a ManeuverCreator class that will produce pure pitch, roll, and yaw scripts
  • Status report – done!

JuryRoom

  • 5:00 Meeting with Priyank

Phil 2.2.21

Can Small and Synthetic Benchmarks Drive Modeling Innovation? A Retrospective Study of Question Answering Modeling Approaches

  • Datasets are not only resources for training accurate, deployable systems, but are also benchmarks for developing new modeling approaches. While large, natural datasets are necessary for training accurate systems, are they necessary for driving modeling innovation? For example, while the popular SQuAD question answering benchmark has driven the development of new modeling approaches, could synthetic or smaller benchmarks have led to similar innovations?
  • This counterfactual question is impossible to answer, but we can study a necessary condition: the ability for a benchmark to recapitulate findings made on SQuAD. We conduct a retrospective study of 20 SQuAD modeling approaches, investigating how well 32 existing and synthesized benchmarks concur with SQuAD — i.e., do they rank the approaches similarly? We carefully construct small, targeted synthetic benchmarks that do not resemble natural language, yet have high concurrence with SQuAD, demonstrating that naturalness and size are not necessary for reflecting historical modeling improvements on SQuAD. Our results raise the intriguing possibility that small and carefully designed synthetic benchmarks may be useful for driving the development of new modeling approaches.

Book

  • Finished the Charles Dawson and Alfred Wegoner bits. Working on play

GOES

  • Finally got the sim working again! Now back to getting the scriptreader in

NESDIS

  • Got my account working!

GPT Agents

  • Meeting and working on probes

Phil 2.1.21

Book

  • Working on conclusions

GPT-2

  • Sent Antonio a note on research directions

GOES

  • Verify yaw flip works, and then add script reading