Author Archives: pgfeldman

Phil 10.4.17

7:00 – 3:00 ASRC MKT

Phil 10.3.17

Phil 7:00 – 5:00 ASRC MKT

Phil 10.2.17

8:00 – 5:00 ASRC MKT

  • The CHIIR paper is submitted! Incorporated all of Wayne’s points (that I could decipher)
  • Change the angle recording code so that it is WRT the average heading of the population. Might make a better figure 7. Started.
  • Security training – one hour – done
  • Do Charlestown things – done
  • Fika
    • Anita skimmed the paper and liked what she saw.
    • NVivo webinar
    • $120/year
  • Meeting with Wayne?
    • The CHI deadline is next week: https://chi2018.acm.org/authors/doctoral-consortium/
    • Extended Abstracts from CHI 17 (search for SESSION: Doctoral Consortium)
    • Some extended discussion about GLOBE. Might have the opportunity to look at the code with some guidance. Otherwise, it’s going up on GitHub soon. I’d like to see the code that finds similar remotely observed data on the globe as a way to find similar papers. In this scenario, that could be used to equate new GEOS data (soil, vegetation, lighting, etc) to use places that are burning to places that are at high risk for burning.

Phil 9.29.17

7:00 – 5:00 ASRC MKT

  • Sent out copies of the draft to academic/work management. Waiting for comments
  • Fix concepts
  • Fix Keywords – going to try the LMN on the lit review and see what pops up 2017-09-29
  • Get page numbers
  • Register for easychair, and make sure what the actual deadline is. Registered, but there is no date information WRT the submission. Going to submit Saturday night out of an abundance of caution.
  • I had some more thoughts about how behavior patterns emerge from the interplay between trust and awareness. I think the following may be true:
    • Healthy behaviors emerge when trust and awareness are equivalent.
    • Low trust and low awareness is reasonable. It’s like walking through a dark, unknown space. You go slow, bump into things, and adjust.
    • Low trust and high awareness is paralytic.
    • High trust and low awareness is reckless. Runaway conditions like echo chambers.
    • Diversity is a mechanism for extending awareness, but it depends on trusting those who are different. That may be the essence of the explore/exploit dilemma.
    • In a healthy group context, trust falls off as a function of awareness. That’s why we get flocking. That is the pattern that emerges when you trust more those who are close, while they in turn do the same, building a web of interaction. It’s kind of like interacting ripples?
    • This may work for any collection of entities that have varied states that undergo change in some predictable way. If they were completely random, then awareness of the state is impossible, and trust should be zero.
      1. Human agent trust chains might proceed from self to family to friends to community, etc.
      2. Machine agent trust chains might proceed from self to direct connections (thumb drives, etc) to LAN/WAN to WAN
      3. Genetic agent trust chain is short – self to species. Contact is only for reproduction. Interaction would reflect the very long sampling times.
      4. Note that (1) is evolved and is based on incremental and repeated interactions, while (2) is designed and is based on arbitrary rules that can change rapidly. Genetics are maybe dealing with different incentives? The only issue is persisting and spreading (which helps in the persisting)
    • Computer-mediated-communication disturbs this process (as does probably every form of mass communication) because the trust in the system is applied to the trust of the content. This can work in both ways. For example, lowering trust in the press allows for claims of Fake News. Raising the trust of social networks that channel anonymous online sources allows for conspiracy thinking.
    • An emerging risk is how this affects artificial intelligence, given that currently high trust in the algorithms and training sets is assumed by the builders
      • Low numbers of training sets mean low diversity/awareness,
      • Low numbers of algorithms (DNNs) also mean low diversity/awareness
      • Since training/learning is spread by update, the installed base is essentially multiple instances of the same individual. So no diversity and very high trust. That’s a recipe for a stampede of 10,000 self driving cars.

Phil 9.28.17

7:00 – 4:00 ASRC MKT

  • from ABC news. Artificially amplifying (both) poles and establishing norms
    • “They were taking both sides of the argument this past weekend, and pushing them out from their troll farms as much as they could to try to just raise the noise level in America and to make a big issue seem like an even bigger issue,” Lankford said at a hearing of the Senate Homeland Security and Government Affairs Committee.
  • Got all the LaTex packages installed so that I can compile the paper at home
  • Adding in references – done
  • Fix concepts
  • Fix Keywords

Phil 9.26.17

9:00 – 5:00 ASRC MKT

  • Cleaning up text
  • Generating figures
  • 4:00 Meeting with Wayne
    • Wayne feedback on last two sections (now-ish)
    • Anita reciprocal read for papers Wed/Thu/Fri?
    • Wayne edit Fri/Sat/Sun

Phil 9.25.17

7:00 – 7:00 ASRC MKT

Phil 9.21.17

Aaaaand it’s fall. Darkness looms…

7:00 – 10:30, 12:30 – 6:00 ASRC MKT

  • Working on discussion and implications for design sections. Should there be a Future Work? Could discuss the network analysis, CellAccumulator and game/mapping work
  • Resilience: The emergence of a perspective for social–ecological systems analyses Downloaded. This looks like a must-read.
    • Carl Folke – science director and co-founder of the Stockholm Resilience Centre (SRC). He has extensive experience in transdisciplinary collaboration between natural and social scientists and is among the most cited scientists in the world on resilience thinking
    • The resilience perspective is increasingly used as an approach for understanding the dynamics of social–ecological systems. This article presents the origin of the resilience perspective and provides an overview of its development to date. With roots in one branch of ecology and the discovery of multiple basins of attraction in ecosystems in the 1960–1970s, it inspired social and environmental scientists to challenge the dominant stable equilibrium view. The resilience approach emphasizes non-linear dynamics, thresholds, uncertainty and surprise, how periods of gradual change interplay with periods of rapid change and how such dynamics interact across temporal and spatial scales. The history was dominated by empirical observations of ecosystem dynamics interpreted in mathematical models, developing into the adaptive management approach for responding to ecosystem change. Serious attempts to integrate the social dimension is currently taking place in resilience work reflected in the large numbers of sciences involved in explorative studies and new discoveries of linked social–ecological systems. Recent advances include understanding of social processes like, social learning and social memory, mental models and knowledge–system integration, visioning and scenario building, leadership, agents and actor groups, social networks, institutional and organizational inertia and change, adaptive capacity, transformability and systems of adaptive governance that allow for management of essential ecosystem services.

Phil 9.21.17

6:00 – 10:30, 1:00 – 6:00 ASRC MKT

  • I think there is a difference between exploring, a deliberate exposing to things unknown and serendipity, an accidental encounter with the unknown. In the first case, the mind is prepared for the situation. In the second, the mind needs to be receptive to the serendipity. I think that design may matter a lot here. A serendipitous result low on a list may not have the same impact as a point on a map or a line in a story.
  • Oxford English dictionary’’s definitions of:
    • serendipity: “the faculty of making happy and unexpected discoveries by accident”.  
    • explore:  An act of exploring an unfamiliar place; an exploration, an excursion. 
    • discoverTo disclose, reveal, etc., to others or (later) oneself; to find out. 
    • sagacity: Acuteness of mental discernment; aptitude for investigation or discovery; keenness and soundness of judgement in the estimation of persons and conditions, and in the adaptation of means to ends; penetration, shrewdness.
    • synchronicity: the phenomenon of events which coincide in time and appear meaningfully related but have no discoverable causal connection.
  • Skimming these
    • The bohemian bookshelf: supporting serendipitous book discoveries through information visualization
      • A ThudtU HinrichsS Carpendale
      • Serendipity, a trigger of exciting discoveries when we least expect it, is currently being discussed as an often neglected but still important factor in information seeking processes, research, and ideation. In this paper we explore serendipity as an information visualization goal. In particular, we introduce the Bohemian Bookshelf visualization that aims to support serendipitous exploration of digital book collections. The Bohemian Bookshelf consists of five interlinked visualizations, each representing a unique (over)view of the collection. It facilitates serendipitous discoveries by (1) offering multiple access points by providing visualizations of different perspectives on the book collection, (2) enticing curiosity through abstract, metaphorical, and visually distinct representations of the collection, (3) highlighting alternate adjacencies between books, (4) providing multiple pathways for exploring the data collection in a flexible way, (5) supporting immediate previews of books, and (6) enabling a playful approach to information exploration. Our design goals and their exploration through the Bohemian Bookshelf visualization opens up a discussion on how to promote serendipity through information visualization.
      • six design goals that we have derived for promoting serendipitous discoveries through information visualization.
      • Austin coined the term altamirage that describes serendipitous discoveries as a result of chance paired with individual traits of the exploring person [2, 29].
      • This is closely related to the notion of synchronicity where related ideas may manifest as simultaneous occurrences that seem acausal but still meaningful [29].
      • The prevalence of these ideas of chance, fortuity, and coincidence in the discussion around serendipity has led to a tendency to trivialize this complex concept by assuming that serendipity can be supported simply through the introduction of randomness.
      • The design of the Bohemian Bookshelf offers multiple pathways through the book collection by (1) providing multiple interactive overviews of the book collection that can guide the information seeker into different and interesting directions, (2) the presentation of adjacent data that can act as visual signposts providing alternatives for the viewer to move through the dataset by following up on related books, and (3) emphasizing cross visualization attributes by mutual highlighting as in coordinated views [3, 7]
      • multiple pathways through the book collection that can provide guidance in a serendipitous way. The visual overviews can provide one way of exploring books. For instance, visitors can systematically browse through all books of their favourite colour and, in this way, possibly encounter books that are of interest to them but that they did not think of to search for directly. Furthermore, emphasizing adjacent books can be considered as visual signposts. For instance, following up on highlighted books in the Book Pile is likely to rapidly guide people serendipitously to different topical areas of the book collection. As a third approach to multiple pathways, all visualizations of the Bohemian Bookshelf are interlinked with each other. Therefore, every selection of a book in one visualization can be considered a cross road to the other visualizations that highlight this selection as well in their particular context.
      • We deliberately designed the Bohemian Bookshelf to provide multiple overviews of the entire book collection to provide opportunities to discover unexpected trends and relations within the collection.
    • Discovery is never by chance: designing for (un)serendipity – finished. Good paper!
      • P AndréJ TeevanST Dumais
      • Serendipity has a long tradition in the history of science as having played a key role in many significant discoveries. Computer scientists, valuing the role of serendipity in discovery, have attempted to design systems that encourage serendipity. However, that research has focused primarily on only one aspect of serendipity: that of chance encounters. In reality, for serendipity to be valuable chance encounters must be synthesized into insight. In this paper we show, through a formal consideration of serendipity and analysis of how various systems have seized on attributes of interpreting serendipity, that there is a richer space for design to support serendipitous creativity, innovation and discovery than has been tapped to date. We discuss how ideas might be encoded to be shared or discovered by “association-hunting” agents. We propose considering not only the inventor‘s role in perceiving serendipity, but also how that inventor‘s perception may be enhanced to increase the opportunity for serendipity. We explore the role of environment and how we can better enable serendipitous discoveries to find a home more readily and immediately.
        • there is “no discovery of a thing you are looking for
        • However, most systems designed to induce or facilitate serendipity have focused on the first aspect, subtly encouraging chance encounters, while ignoring the second part, making use of those encounters in a productive way.
        • Especially, however, we want to offer approaches to get at
          the desired effect of serendipity: insight
        • For us, serendipity is:
          1. the finding of unexpected information (relevant to the goal or not) while engaged in any information activity,
          2. the making of an intellectual leap of understanding with that information to arrive at an insight
        • In our study, a number of participants remarked that they thought of themselves as ‘serendipitous’, and were surprised to find no instances of it in their search behaviour.
          • This is because exploring is not serendipity. See first point above
        • Click entropy, a direct measure of how varied the result clicks are for the query, was found to be significant. That is, a positive correlation between entropy and the number of potentially serendipitous results suggests that people may have clicked varied results not just because they could not find what they wanted, but because they considered more things interesting, or were more willing to go off at a tangent.
        • Arguably however, almost all visualization systems are designed to support such a goal: identifying interesting, but unknown, trends or patterns in data that would not have been visible otherwise.
        • Erdelez‘s [12] so-called ‘super-encounterers’, encountering unexpected information on a regular basis, even counting on it as an important element in information acquisition.
        • Instead of treating serendipity as arcane, mysterious and accidental, we embrace the ability of computers to help us perceive connections and opportunities in various pieces of information
        • presenting such information to users has the potential to increase the overall information the user must interact with. This can lead to two problems: distraction or overload, and the negative consequences of incorrect or problematic recommendations or assumptions
        • It is widely acknowledged that serendipitous discoveries are preceded by a period of preparation and incubation [7]. They are, in that respect, not as ‗serendipitous‘ as we might expect, being the product of mental preparation as well as of an open and questioning mind
        • The challenge from a design perspective may not necessarily be discovering domain literature opportunities, but defining mechanisms for presenting these suggestions in ways that are effective for the investigator. Further to creating a reading list is defining the space to deliver them opportunistically
        • This idea again supposes a form of common language model, a way to express interest or expertise in particular areas, and a way to search for results.
        • In this spectrum, we have also demonstrated that computer science has spent most of it’s design effort perhaps overly focused on trying to create insight (effect of serendipity), by recreating the cause (chance), rather than on, for instance, increasing the rate and accuracy of proposed candidates for serendipitous insight, or developing domain expertise
  • Ordered this, too: Information Visualization: Beyond the Horizon. Has quite a bit on maps that’s going to be needed in the implications for design section
  • What is a Diagram?
    • This paper responds to renewed interest in the centuries old question of what is a diagram. Existing status of our understanding of diagrams is seen as unsatisfactory and confusing. This paper responds to this by proposing a framework for understanding diagrams based on symbolic and spatial mapping. The framework deals with some complex problems any useful definition of diagrams has to deal with. These problems are the variety of diagrams, meaningful dynamics of diagramming, handling change in diagrams in a well formed way, and all of this in the context of semantically mixed diagrams. A brief description of the framework is given discussing how it addresses the problems.
  • Supporting serendipity: Using ambient intelligence to augment user exploration for data mining and web browsing.
    • Has some very Research-Browser-ish bits in it
    • an agent-based system to support internet browsing. It models the user‘s behaviour to look ahead at linked web pages and their word frequencies, using a Bayesian approach to determine relevance. It then colours links on the page depending on their relevance. In evaluation, the colouring was seen as successful, with people tending to follow the strongly advised links most of the time.
  • Retroactive answering of search queries
    • Major search engines currently use the history of a user’s actions (e.g., queries, clicks) to personalize search results. In this paper, we present a new personalized service, query-specific web recommendations (QSRs), that retroactively answers queries from a user’s history as new results arise. The QSR system addresses two important subproblems with applications beyond the system itself: (1) Automatic identification of queries in a user’s history that represent standing interests and unfulfilled needs. (2) Effective detection of interesting new results to these queries. We develop a variety of heuristics and algorithms to address these problems, and evaluate them through a study of Google history users. Our results strongly motivate the need for automatic detection of standing interests from a user’s history, and identifies the algorithms that are most useful in doing so. Our results also identify the algorithms, some which are counter-intuitive, that are most useful in identifying interesting new results for past queries, allowing us to achieve very high precision over our data set.

Phil 9.19.17

6:30 – ASRC MKT

  • 10:00 status meeting
  • Thinking about going to DC for lunch
  • Matthew Zefferman
    • I am a quantitative social scientist who uses mathematical models and ethnographic field research to understand human ultrasociality – our ability to organize ourselves into societies capable of large-scale cooperation and large-scale conflict – especially in the contexts of war, political organization, and environmental sustainability.
    • I like the term ultrasociality, it captures some of the large-scale effects I’m looking at.
  • NIMBios (Matthew Zefferman spent some time here) Has kind of a Max Planck vibe?infog_new
  • Speaking of which, the logo for the Couzin Lab at Max Planck is a perfect explore/exploit icon: couzin-lab
  • Working on paper. Currently loading up Illustrator and IntelliJ to see which comes up first. Illustrator wins! I really need another monitor now…
    • Finished the methods/simulation section Starting on the pattern detection section

Phil 9.18.17

7:00 – 4:00 ASRC MKT

      • Here’s the code that makes it:
        \vec{aoc}_x= \frac{\{
        \sum_{n=1}^{n = x-1} \vec{aop}_n (1 - \frac{\| \vec{app}_x - \vec{app_n} \| }{r}) + 
        \sum_{n=x+ 1}^{n = max} \vec{aop}_n (1 - \frac{\| \vec{app}_x - \vec{app}_n \| }{r})
        \mid (\|\vec{app}_x - \vec{app}_n \| < r)\}}{1-\sum_{n=1}^{n=max}[\|\vec{app}_n - \vec{app}_x\| < r]}
      • Given these conditions:
        • aoc is the current orientation vector
        • aop is the previous orientation vector
        • app is the current position
        • app is the previous position
        • r is the exploit radius
      • And this is the position update function: PositionUpdate
        • aop is the previous orientation vector
        • acp is the current position
        • app is the previous position
        • dt is elapsed time
      • Working on describing the high-dimensional slew using a diagram.

     

Phil 9.15.17

7:00 – 5:00 ASRC MKT

Phil 9.14.17

7:00 – 4:00 ASRC MKT

  • Reducing Dimensionality from Dimensionality Reduction Techniques
    • In this post I will do my best to demystify three dimensionality reduction techniques; PCA, t-SNE and Auto Encoders. My main motivation for doing so is that mostly these methods are treated as black boxes and therefore sometime are misused. Understanding them will give the reader the tools to decide which one to use, when and how.
      I’ll do so by going over the internals of each methods and code from scratch each method (excluding t-SNE) using TensorFlow. Why TensorFlow? Because it’s mostly used for deep learning, lets give it some other challenges 🙂
      Code for this post can be found in this notebook.
    • This seems important to read in preparation for the Normative Mapping effort.
  • Stanford  deep learning tutorial. This is where I got the links to PCA and Auto Encoders, above.
  • Ok, back to writing:
    • The Exploration-Exploitation Dilemma: A Multidisciplinary Framework
    • Got hung up explaining the relationship of the social horizon radius, so I’m going to change it to the exploit radius. Also changed the agent flocks to red and green: GPM
    • There is a bug, too – when I upped the CellAccumulator hypercube size from 10-20. The max row is not getting set