7:00 – 4:30 VTX

• Working on diagram
• Realised that I don’t have an evaluation Criteria for RQ2
• Got the antiBelief and origin force scalars working
• Still don’t have the inserts and deletes working in Belief.addBeliefStatements() working something to talk to Don and Aaron about?
• Starting to work on clustering. Extended the ResizableCanvas class, since it knows the global state.
• Yay! I don’t have to implement DBSCAN. It’s in the apache math commons!
• It works! You need to know the average spacing within a cluster. Here’s how.

  Clusters with eps of < 3.8461538461538463
  
  cluster (10 elements):
  Shape[0-0] pos = (5.14, 2.50), angle = 0.00
  Shape[0-1] pos = (7.46, 0.73), angle = 0.00
  Shape[0-2] pos = (2.51, 2.64), angle = 0.00
  Shape[0-4] pos = (5.11, 0.24), angle = 0.00
  Shape[0-6] pos = (4.07, 1.91), angle = 0.00
  Shape[0-7] pos = (4.14, 4.53), angle = 0.00
  Shape[0-8] pos = (3.82, 5.07), angle = 0.00
  Shape[0-3] pos = (1.96, 4.80), angle = 0.00
  Shape[0-5] pos = (0.68, 2.02), angle = 0.00
  Shape[0-9] pos = (2.73, 6.09), angle = 0.00
  
  cluster (10 elements):
  Shape[1-0] pos = (37.75, 38.52), angle = 0.00
  Shape[1-1] pos = (37.47, 38.50), angle = 0.00
  Shape[1-2] pos = (40.58, 37.65), angle = 0.00
  Shape[1-6] pos = (38.97, 37.11), angle = 0.00
  Shape[1-7] pos = (40.48, 39.53), angle = 0.00
  Shape[1-8] pos = (35.93, 35.51), angle = 0.00
  Shape[1-9] pos = (35.95, 40.37), angle = 0.00
  Shape[1-3] pos = (40.63, 34.00), angle = 0.00
  Shape[1-5] pos = (40.69, 35.59), angle = 0.00
  Shape[1-4] pos = (34.95, 34.15), angle = 0.00
  
  cluster (10 elements):
  Shape[2-0] pos = (68.48, 71.03), angle = 0.00
  Shape[2-4] pos = (67.78, 72.69), angle = 0.00
  Shape[2-5] pos = (67.39, 69.31), angle = 0.00
  Shape[2-6] pos = (71.04, 70.03), angle = 0.00
  Shape[2-8] pos = (70.69, 73.91), angle = 0.00
  Shape[2-1] pos = (70.23, 66.77), angle = 0.00
  Shape[2-2] pos = (74.27, 68.85), angle = 0.00
  Shape[2-3] pos = (72.95, 68.10), angle = 0.00
  Shape[2-7] pos = (72.85, 69.00), angle = 0.00
  Shape[2-9] pos = (72.05, 73.34), angle = 0.00

• Yup, that worked:

  for(SmartShape outerSS : ssList){
      for(SmartShape innerSS : ssList){
          if(outerSS == innerSS){
              continue;
          }
          double[] op = outerSS.getPoint();
          double[] ip = innerSS.getPoint();
          double dist = Math.sqrt(op[0]*ip[0] + op[1]*ip[1]);
          distList.add(dist);
      }
  }
  distList.sort(doubleComparator);
  double eps = distList.get(distList.size()/10);
  DBSCANClusterer<SmartShape> dbscan = new DBSCANClusterer<SmartShape>(eps, 3);
  final List<Cluster<SmartShape>> clusterList = dbscan.cluster(ssList);

• Well, that was a really good day…

7:00 – 3:30 VTX

Paper

• Working on a diagram that connects research questions
  • Learning Illustrator
• Need to add some setup for each section
• Add a study where subjects have explorer, confirmer and avoider roles when searching for an answer. (This should be in the E.C. for 5.4.4)
• Add a final study that’s just ‘open search’? (This could be interesting with 5.4.5. It wouldn’t be any more coding than the Red Scare system. Still a Google CSE as the back end, but running through an intermediary server for logging.)

Code

• Working through the antistatement
• Added a subtractStatement to belief.
• Adding in an opposing belief for initialization tests
• I’m going to need an anti belief list for each agent for similarity analysis. Weight is being overloaded.
• Added AntiBelief, which calculates a repulsion based on similarities with  statements in the target belief.
• Need to add a button that toggles origin attraction.
• Copied projects to VTX svn

8:00 – 3:00 VTX

Paper

• Continuing the The Sovereign Map. Definitely building my vocabulary. Interesting point: map, carte, etc are all descriptions of drawing. So the etymology of map does not address the concepts that support maps.
• Need to add a ‘done’ condition to the discussion of the RQs. – Working this.
  • Added the evaluation criteria for 5.4.9.
• Need to add diagram that connects research questions
• Need to add some setup for each section
• Add a study where subjects have explorer, confirmer and avoider roles when searching for an answer. (This should be in the E.C. for 5.4.4)
• Add a final study that’s just ‘open search’? (This could be interesting with 5.4.5. It wouldn’t be any more coding than the Red Scare system. Still a Google CSE as the back end, but running through an intermediary server for logging.)

Code

• Thinking that every statement may need an ‘antistatement’ (which could be a negative weight). This would allow a belief to be against something rather than just for something. Need to work out the rules on that. Also, I still need to get around to the agent’s energy budget and rules for that.
  • Looking at Tutorial on agent-based modeling and simulation
  • This also looks good. Comparison of different opinion models: Modelling Opinion Formation with Physics Tools: Call for Closer Link with Reality
    • Cited by: Opinion Formation by Informed Agents
• Updating Intellij
• Sprint retrospective
  • Raised the point that we need an archived corpus to test against
• Wrote up some support for Aarnon’s next steps email to Chris/others

7:00 – 3:30 VTX

Paper

• Started The Sovereign Map
• Need to add a ‘done’ condition to the discussion of the RQs. – Working this.
  • Added the evaluation criteria for 5.4.6. Also added some discussion on how the model might help narrow the search space.
• Need to add diagram that connects research questions
• Need to add some setup for each section
• Add a study where subjects have explorer, confirmer and avoider roles when searching for an answer. (This should be in the E.C. for 5.4.4)
• Add a final study that’s just ‘open search’? (This could be interesting with 5.4.5. It wouldn’t be any more coding than the Red Scare system. Still a Google CSE as the back end, but running through an intermediary server for logging.)

Code

• Added mousewheel scale and mouse drag. Recentering isn’t quite right
• Added reset button
• Working on polarization
  • chance calculations seem to be working, but frequent enough sampling of far away to have all the items converge. Need to ponder. Maybe there’s a cost for keeping a statement that has a high average distance?
  • The current goal is to see the color groups collapse into homogeneous without combining into one group.
  • After that look into dissimilarity. Purge elements of similarity?
  • Would like to measure the overall force vector of a particular cluster as a proxy for group drift.

7:00 – 3:30 VTX

Paper

• Need to add a ‘done’ condition to the discussion of the RQs. – Working this.
• Added the evaluation criteria for 5.4.6. Also added some discussion on how the model might help narrow the search space.
• Need to add diagram that connects research questions
• Need to add some setup for each section
• Add a study where subjects have explorer, confirmer and avoider roles when searching for an answer. (This should be in the E.C. for 5.4.4)
• Add a final study that’s just ‘open search’? (This could be interesting with 5.4.5. It wouldn’t be any more coding than the Red Scare system. Still a Google CSE as the back end, but running through an intermediary server for logging.)

Code

• Added origin attraction scalars
• Something is causing the system to set positions to NaN. Need to look for divide by zero. Fixed several things, including distance calculations between the same item.
• Fixed the sliders
• Starting on polarization
  • It needs to wait until the system stabilizes, so I added a start/stop button
  • Calculating the chance of changing an opinion
  • Also added and then commented out code that copies a statement from one agent into another’s.
  • Selecting chance is based on closeness. Need to verify that this is working
  • The current goal is to see the color groups collapse into homogeneous without combining into one group.
  • After that look into dissimilarity. Purge elements of similarity?
  • Would like to measure the overall force vector of a particular cluster as a proxy for group drift.

VTX 7:00 – 3:30

Paper

• Need to add diagram that connects research questions
• Need to add some setup for each section
• Need to add a ‘done’ condition to the discussion of the RQs. – Working this.
  • Struggled with RQ2 and RQ2a. My issue was one of ordering reall. I’d like to get some good information about how the current tool would be used. I know there will need to be modifications and I don’t want to get tied up in designing before the people that I can talk to about the design have a sense of how it might work. So what is required for a pre-design design? And how do you evaluate it.
  • As a side note, I could certainly revisit the Google news navigation. The RSS code isn’t supported any more, but it looks like a CSE with NewsArticle might work. Looks like it does! ScholarlyArticle is supported as well!
• Add a study where subjects have explorer, confirmer and avoider roles when searching for an answer. (This should be in the E.C. for 5.4.4)
• Add a final study that’s just ‘open search’? (This could be interesting with 5.4.5. It wouldn’t be any more coding than the Red Scare system. Still a Google CSE as the back end, but running through an intermediary server for logging.)

Coding

• Going to try the similarity distance as the ratio of similar items to the total. That turned out to work very nicely. Here’s the code of it:

  public double compare(Belief targBelief) {
      CollectionCompare cc = new CollectionCompare();
  
      // look for all matches and partial matches from teh target's point of view
      for (Statement targStatement : targBelief.getList()) {
          if (statementMap.containsKey(targStatement.getName())) {
              Statement sourceStatement = statementMap.get(targStatement.getName());
              double matches = Math.min(sourceStatement.getWeight(), targStatement.getWeight());
              cc.matches += matches;
              cc.mismatches += Math.max(sourceStatement.getWeight(), targStatement.getWeight()) - matches;
  
          } else {
              cc.mismatches += targStatement.getWeight();
          }
      }
  
      // look for all mismatches from our point of view
      Map<String, Statement> targMap = targBelief.getMap();
      for (Statement sourceStatement : getList()) {
          if (!targMap.containsKey(sourceStatement.getName())) {
              cc.mismatches += sourceStatement.getWeight();
          }
      }
  
      cc.total = cc.matches+cc.mismatches;
      double ratio = cc.matches/cc.total;
  
      return ratio;
  }

• Had to add a pull towards the origin
• Added sliders to manipulate attraction and repulsion

7:00 – 4:00 VTX

Paper

• Need to add diagram that connects research questions
• Need to add some setup for each section
• Need to add a ‘done’ condition to the discussion of the RQs. – Working this.
  • Added in a section that discusses the creation of statements and beliefs, since that looks like it’s going to work.
  • Added the evaluation criteria for 5.4.3
• Add a study where subjects have explorer, confirmer and avoider roles when searching for an answer. (This should be in the E.C. for 5.4.4)
• Add a final study that’s just ‘open search’? (This could be interesting with 5.4.5. It wouldn’t be any more coding than the Red Scare system. Still a Google CSE as the back end, but running through an intermediary server for logging.)

VTX

• Test QA if its up.Done
• More porsche crap.
• Added dprint callbacks. Will need to add some other event handling that will filter up.
• Moved simple clustering into ForceShape
• Starting on BeliefAgentShape (BAS). Got a lot done. The logic for handling agents is now in the BeliefAgentManager class. BASs now have a ControlBeliefCA in them, and it’s initialized correctly. Not using it for similarity comparisons yet.
• Built three beliefs, redBelief, greenBelief and blueBelief. Eash belief consists of a set of colors that are in the neighborhood of pure red green and blue. This should be a good test since I’ll be able to see the groups
• Pix for the day:

7:00 – 3:00 VTX

• Found Some nice stuff on Bootstrapping
  • The WISE (Web Interface for Statistics Education) site
  • Nice video showing their applet
•  Paper
  • Need to add diagram that connects research questions
  • Need to add some setup for each section
  • Need to add a ‘done’ condition to the discussion of the RQs. – Working this.
  • Add a study where subjects have explorer, confirmer and avoider roles when searching for an answer.
  • Add a final study that’s just ‘open search’?
• Got the initial particle code running with a real simple similarity compare. Performance is quite nice! Need to add belief compare next. Poles could probably be anchors with a frozen belief, maybe with one statement.

7:00 – 3:30 VTX

• Found this: We need more solution-oriented social science: on changing our frames of reference and tackling big social problems.
• Paper
  • Need to add diagram that connects research questions
  • Need to add some setup for each section
  • Need to describe that the intent of building the model is to have a starting point that is updated as research continues. It’s plastic, not static
  • Need to add a ‘done’ condition to the discussion of the RQs.
  • Add a study where subjects have explorer, confirmer and avoider roles when searching for an answer.
  • Add a final study that’s just ‘open search’?
• More interactive app for visualizing group polarization
  • Adding OpenGL-like matrix manipulation to Resizable canvas – done
    • Well, I thought I was. Needed to use a copy constructor to place a copy of the matrix rather than the same old pointer.
  • Need to get the origin at the center – done
  • Need to build some graphic entities that mostly draw themselves and hang onto state. Also some interactivity like detecting clicks. Damn – it looks like I need to unproject the matrix. Done. Yay, there was already a bounding box class.
  • Assuming that I can make attraction work on a force model, then some things come along for free
    • Closer agents are more like minded. Therefore looking at closer agents for statements makes sense
    • Clustering can then be based on the distance model. We should use dp-means (blog) (paper), since we don’t know the number of clusters?

7:00 – 3:00 VTX

• Adding ‘scaffolding’ to proposal
• Need to add diagram that connects research questions
• Need to add some setup for each section
• Need to describe that the intent of building the model is to have a starting point that is updated as research continues. It’s plastic, not static
• Need to add a ‘done’ condition to the discussion of the RQs.
• Add a study where subjects have explorer, confirmer and avoider roles when searching for an answer.
• Add a final study that’s just ‘open search’?
• Started interactive app for visualizing group polarization
  • Got the 2D canvas and matricies working mostly

7:00 – 9:00 VTX

• Adding ‘scaffolding’ to proposal
• Added a section on Simon’s ant and friction in design
• Need to add diagram that connects research questions
• Need to add some setup for each section
• Need to describe that the intent of building the model is to have a starting point that is updated as research continues. It’s plastic, not static
• Need to add a ‘done’ condition to the discussion of the RQs.
• Add a study where subjects have explorer, confirmer and avoider roles when searching for an answer.
• Add a final study that’s just ‘open search’?

7:00 – 5:00 VTX

• Thinking about moving into bonds until after the election.
• Meeting with Bob at 11:45
• Meeting with Wayne at 4:00
• Standing on the shoulders of the Google giant: Sustainable discovery and Google Scholar’s comprehensive coverage.
• More editing
  • I think I need to expand the section on fact checking. At least mention these papers in passing:
    • Computational Fact Checking from Knowledge Networks
    • Sensing and Shaping Emerging Conflicts
    • Eliciting Information and Detecting Lies in Intelligence Interviewing: An Overview Of Recent Research
    • On the Accuracy of Media-based Conflict Event Data
    • Incentivizing High-quality User-Generated Content
    • Adaptive Faceted Ranking for Social Media Comments
    • On the Wisdom of Experts vs. Crowds – Discovering Trustworthy Topical News in Microblogs
    • Finding and assessing social media information sources in the context of journalism
    • Veracity Roadmap: Is Big Data Objective, Truthful and Credible?
    • Seeking the Trustworthy Tweet: Can Microblogged Data Fit the Information Needs of Disaster Response and Humanitarian Relief Organizations
• More Belief CAs (and that’s what the collection should be called)
• Branched off the SingleDistribution classes in case that turns out to be the right approach

7:00 – 5:30  VTX

• More refining on the proposal. Adding supporting links.
• Waiting for QA to have the new code to run tests.
• While waiting, working on GroupPolarization models.