I think this is pretty good:

Are conspiracy theories what mysticism looks like when it adopts the trappings of rationalism?

Added some exception handling for the sql calls:

except pymysql.err.OperationalError as oe:
    messagebox.showerror("pymysql.err.OperationalError", oe.args)
    return None

Downloaded the new Slack files. Had to handle the presence of gifs, and a few other db issues. Everything continues to look good.

Working on building the table, then the map. Here’s the first shot.

split_1 places: ['goblin', 'orc', 'stairs', 'vines', 'see', 'hit', 'arrow', 'fire', 'gate', 'behind']
	splt-chn_1of4-tymora1 spaces: ['guys', 'temple', 'guess', 'damage', 'hey', 'spell', 'axe', 'know', 'trees', 'move', 'come']
	splt-chn_1of4-tymora2 spaces: ['short', 'log', 'attack', 'feet', 'stealth', 'damage', 'morc', 'temple', 'axe', 'top', 'mindy']
	splt-chn_1of4-tymora3 spaces: ['coins', 'light', 'damage', 'shards', 'glass', 'steps', 'floor', 'need', 'poison', 'bow', 'sacred']
	splt-chn_1of4-tymora4 spaces: ['spell', 'glass', 'feet', 'perception', 'antechamber', 'shield', 'cast', 'hand', 'log', 'move', 'beyond']
	splt-chn_1of4-Group 1 spaces: ['eyes', 'bow', 'side', 'bit', 'looking', 'carefully', 'halfling', 'arrows', 'near', 'beyond', 'hand']
	common elements: set()
------------------------
split_2 places: ['rope', 'gate', 'orb', 'statues', 'across', 'see', 'side', 'around', 'pit', 'feet']
	splt-chn_2of4-tymora1 spaces: ['something', 'perception', 'hand', 'statue', 'floor', 'guys', 'ropes', 'switch', 'wall', 'tie', 'pull']
	splt-chn_2of4-tymora2 spaces: ['tie', 'wall', 'open', 'lever', 'gear', 'trap', 'hand', 'pitons', 'lightning', 'javelin', 'cross']
	splt-chn_2of4-tymora3 spaces: ['lever', 'trap', 'metal', 'need', 'floor', 'perception', 'statue', 'dwarves', 'hand', 'bar', 'large']
	splt-chn_2of4-tymora4 spaces: ['trap', 'guys', 'guidance', 'metal', 'statue', 'fountain', 'perception', 'appears', 'investigate', 'spell', 'coins']
	splt-chn_2of4-Group 1 spaces: ['anything', 'metal', 'halfling', 'gear', 'close', 'something', 'spell', 'statue', 'range', 'trap', 'hand']
	common elements: set()
------------------------
split_3 places: ['troll', 'grogg', 'box', 'chest', 'hand', 'open', 'gate', 'club', 'see', 'want']
	splt-chn_3of4-tymora1 spaces: ['rope', 'oil', 'fire', 'door', 'sleep', 'maybe', 'trolls', 'key', 'nice', 'around', 'feet']
	splt-chn_3of4-tymora2 spaces: ['dream', 'tiny', 'people', 'sleep', 'groggs', 'thing', 'eyes', 'turn', 'lets', 'need', 'group']
	splt-chn_3of4-tymora3 spaces: ['attack', 'damage', 'key', 'fire', 'need', 'lock', 'hit', 'torches', 'attacks', 'dwarves', 'know']
	splt-chn_3of4-tymora4 spaces: ['spell', 'stealth', 'guidance', 'sleep', 'hands', 'burning', 'cast', 'ready', 'attack', 'damage', 'key']
	splt-chn_3of4-Group 1 spaces: ['song', 'sing', 'trolls', 'running', 'feather', 'sleeping', 'looking', 'need', 'creature', 'come', 'face']
	common elements: set()
------------------------
split_4 places: ['coins', 'dragon', 'barrier', 'platform', 'something', 'light', 'woman', 'see', 'eyes', 'treasure']
	splt-chn_4of4-tymora1 spaces: ['blue', 'figures', 'enormous', 'coin', 'piles', 'appears', 'friend', 'around', 'full', 'wyrm', 'shall']
	splt-chn_4of4-tymora2 spaces: ['body', 'enormous', 'across', 'must', 'offer', 'mortal', 'gold', 'piles', 'die', 'near', 'within']
	splt-chn_4of4-tymora3 spaces: ['bridge', 'choose', 'insight', 'blue', 'know', 'gold', 'bridges', 'appears', 'die', 'enormous', 'game']
	splt-chn_4of4-tymora4 spaces: ['stay', 'across', 'must', 'dragons', 'game', 'boy', 'enormous', 'gold', 'piles', 'cant', 'hear']
	splt-chn_4of4-Group 1 spaces: ['grogg', 'looking', 'anything', 'thing', 'troll', 'dragons', 'moment', 'gate', 'gold', 'breath', 'magical']
	common elements: set()

A really interesting thing happened in the run last night. There was an argument about the shared perception of the belief space in the troll room. This misalignment was with the DM (the longer smear), who is kind of like a ship’s captain and is the final authority of the dungeon. When the player resists adhering with the DM’s perception of the belief space, the DM threatens expulsion. Some explorers are born, but involuntary explorers can be made:

ASRC PhD 7:00 – 2:00, NASA 2:00 – 4:00

• Add Text area for “selected”, with a combobox for “Place”, “Space”, and “Ignore”. Ignore words get split(), added to a sorted list view, and saved in the config.xml
• Add text area for program output as well as console. Text lists for users can be shown here. Selected terms from here can be selected and added to the ignore list
• Draw the following as colored points on the embeddings
  • Top Room (bow/tf-idf) terms
  • Top Group (bow/tf-idf)
  • Place terms and Space terms (differentiated by room/group?)

NASA

• Split my time between TL and AIMS through May, see what has the most traction

Meeting with Aaron M.

• Nice discussion. He thinks I’m on a good track, and agrees with using mixed methods as a step towards full automation

Made some tweaks to Antonio’s reply article

7:00 – 5:00, 6:30 – 7:15 ASRC PhD

• Algorithmic Rationality: Game Theory with Costly Computation
  • We develop a general game-theoretic framework for reasoning about strategic agents performing possibly costly computation. In this framework, many traditional game-theoretic results (such as the existence of a Nash equilibrium) no longer hold. Nevertheless, we can use the framework to provide psychologically appealing explanations of observed behavior in well-studied games (such as finitely repeated prisoner’s dilemma and rock-paper-scissors). Furthermore, we provide natural conditions on games sufficient to guarantee that equilibria exist.
• NVIDIA has an IoT NN chipset as well
• Recreate DB with file pull. Success! Here’s the code that works. It takes a downloaded Slack chat session and iterates over that. When it finds a message with a “files” subobject, it does the following. Shout out to the wonderful requests library:

  for mf in entry["files"]:
      mf["user"] = entry["user"]
      mf["ts"] = entry["ts"]
      if mf["pretty_type"] == "Post":
          if use_local :
              to_return += mf["preview"]
          else:
              url = mf["url_private"]
              try:
                  result = requests.get(url, headers={'Authorization': 'Bearer %s' % self.slack_token})
                  dict = json.loads(result.text)
                  root = dict["root"]
                  to_return = ""
                  ch_list = root["children"]
                  for ch in ch_list:
                      if ch["type"] == 'p':
                          to_return += "{} ".format(ch["text"])
                  print("handle_file_entries(): text = {}".format(to_return))
              except requests.exceptions.RequestException as err:
                  print("Got a RequestException: {}".format(err))
                  to_return += mf["preview"]

• Whoops, tymora3 doesn’t have the “Near the port city of Waterdeep in Faerun” phrase. Switching to “young man in a well crafted tunic”
• Add explicit file opening and saving – done
• Add “Embedding Dimensions” field – done
• Example xml file:

  <config>
     <name>test_2019.03.19_11.24</name>
     <buckets>10</buckets>
     <similarity>0.01</similarity>
     <dimensions>3</dimensions>
     <dbs>
        <db>ab_slack</db>
        <db>phpbb</db>
     </dbs>
     <channels>
        <channel>Group 1</channel>
        <channel>tymora1</channel>
        <channel>tymora2</channel>
        <channel>tymora3</channel>
        <channel>peanutgallery</channel>
     </channels>
     <places>
        <place>Orc</place>
        <place>Goblin</place>
        <place>stairs</place>
        <place>orb</place>
        <place>statues</place>
        <place>troll</place>
        <place>Grogg</place>
     </places>
     <spaces>
        <space>fight</space>
        <space>diplomacy</space>
        <space>sing</space>
        <space>sleep</space>
     </spaces>
     <splits>
        <split>young man in a well crafted tunic</split>
        <split>brightly glowing blue orb</split>
        <split>large scaled troll sleeping</split>
        <split>the sea of gold coins and gems filling it</split>
        <split>Two women lounge on chairs across from each other</split>
     </splits>
  </config>

• Reading and writing data are done. Now to start slicing and displaying data interactively

• Data slicing
  • Build embedding for all docs
  • Starting to add bucketing code. First step is to get ignore text from individual users, second task is to have single, room aligned buckets, gust so we can see what that looks like
• JuryRoom meeting at 6:30
  • Added my req’s
    • Groups can stay together
    • Threaded questions in sequential or random order
    • Voting for post, rather than yes/no questions
  • Tony raised a bunch of points about how the conversation could be gamed. My response was that we should build something simple and then try to game it to see what affordances we need
  • Extended discussion on display real estate – how do we show the “starred” posts
    • Tony mentioned the idea that starred posts could fade if they languish without additional stars
  • Panos mentioned the idea of a countdown clock to pressure a vote
  • We walked through the implementation issues. The estimated framework is 3-tier, with a relational DB, Node on the server, and a web client running a framework like React. The goal is a “Hello World” application that we can log into and create accounts running by next week
  • I pointed back to the original JuryRoom document’s strawman representation of the schema.
• Synonyms for fringe
  • Synonyms: Noun
    • border, borderline, bound, boundary, brim, circumference, compass, confines, edge, edging, end, frame, hem, margin, perimeter, periphery, rim, skirt, skirting, verge
  • Synonyms: Verb
    • abut, adjoin, border (on), butt (on or against), flank, join, march (with), neighbor, skirt, touch, verge (on)

ASRC PhD 7:00 – 6:00

• SlackToDb
  • Pull down text – Done, I hope. The network here has bad problems with TLS resolution. Will try from home
  • Link sequential posts – done
  • Add word lists for places and spaces (read from file, also read embeddings)
    • Writing out the config file – done
  • Add field for similarity distance threshold. Changing this lists nearby words in the embedding space. These terms are used for trajectory generation and centrality tables.
  • Add plots for place/space words
  • Add phrase-based splitting to find rooms. Buckets work within these splits. Text before the first split and after the last split isn’t used (For embedding, centrality, etc.)
  • Add phrase-based trimming. Test before one and after the other isn’t used
  • Stub out centrality for (embedded) terms and (concatenated, bucketed, and oriented) documents
  • Look into 3d for tkinter (from scratch)
    • OpenGL (stackoverflow) (pyopengltk)
    • How to embed a Matplotlib graph to your Tkinter GUI
    • Embedding Matplotlib In Tk
    • Embed a pyplot in a tkinter window and update it – Stack Overflow
    • And we’ll need to tab between console and graphics (section 11.4 of tkInter

      n = ttk.Notebook(parent)
      f1 = ttk.Frame(n)   # first page, which would get widgets gridded into it
      f2 = ttk.Frame(n)   # second page
      n.add(f1, text='One')
      n.add(f2, text='Two')

     

  • Progress for the day:

Got a really good idea about doing a hybrid coding model using embeddings. We start with a list of “place terms” and a list of “space terms”. We then use the embedded representation (vector) of those terms to find the adjacent terms. This is a sort of automated “snowball sampling”, where terms can lead to other terms. Once we have these terms, we use them as queries into the database to find the campaign and the timestamp for each. We use these to create the trajectories and maps.

This is a pretty straightforward code and a set of queries to write, and I have high confidence that it will work, and provide a novel, understandable method of producing a nice ‘mixed method’ process that is also grounded completely in the corpora.

Aaron is running Tymora 4

Tried a full similarity run. The files that describe the environments aren’t being uploaded. Found out how to do that

Need to chain together all posts from one user that are sequential in SlacktoDB

Plot embedding from room-synchronized posts

7:00 – ASRC

• Downloaded the JuryRoom spec from Waikato and sent my sympathies for Christchurch
• Worked on getting cosine distance working – Done. Also created spreadsheets of the distances between posts and list the posts on a tab in the spreadsheet. I strip out the words that aren’t used to make the vectors so the posts look a little funny, but the gist is there: