7:00 – 5:30 ASRC PhD
- Morning thought – primordial movement is navigation at a more generalized level. At this level, only broad features are visible, so it’s only easy to jump to a large, common feature like fear-of-the-other. For humans, I think there are very few accessible features at this level.
- Adversarial attacks on medical machine learning
- With public and academic attention increasingly focused on the new role of machine learning in the health information economy, an unusual and no-longer-esoteric category of vulnerabilities in machine-learning systems could prove important. These vulnerabilities allow a small, carefully designed change in how inputs are presented to a system to completely alter its output, causing it to confidently arrive at manifestly wrong conclusions. These advanced techniques to subvert otherwise-reliable machine-learning systems—so-called adversarial attacks—have, to date, been of interest primarily to computer science researchers (1). However, the landscape of often-competing interests within health care, and billions of dollars at stake in systems’ outputs, implies considerable problems. We outline motivations that various players in the health care system may have to use adversarial attacks and begin a discussion of what to do about them. Far from discouraging continued innovation with medical machine learning, we call for active engagement of medical, technical, legal, and ethical experts in pursuit of efficient, broadly available, and effective health care that machine learning will enable.
- Jumping straight into coding
- Moved the menu bars around
- Added a “Chains” menu that runs sequences of analytics
- Added an NLP menu for BOW and TF-IDF
- Working on parsing the selected listings to add to the various lists
- Added a “search” button to search for neighbors of terms in the spaces and places text areas
- Ran into a problem when I was calculating TF-IDF From here, but the way to get the data is here, spoilers – it uses Dataframes. Anyway, artifacts from Slack and PHPBB we interfering with the analytics. Things like [i:3fsgwhpz]. So I added a lot of preprocessing. First, more regexes:
punctuation_regex = re.compile(r"[\",\-\_\.\d+?!*;“”]") bracket_regex = re.compile(r"\[.*?\]") amper_semicolon_regex = re.compile(r"\&.*?\;")
And then some word-by-word testing and more regexing:
def cleanup_text(self, raw: str) -> str: raw = self.bracket_regex.sub("",raw) raw = self.amper_semicolon_regex.sub("",raw) words = raw.split(" ") s = "" for word in words: if len(word) < 20: word = self.punctuation_regex.sub("",word) word = word.strip() word = word.lower() s += " {}".format(word) else: print("Threw out {}".format(word)) return s - Anyway, the results are pretty good now with TF-IDF. Here’s the top few terms for each player’s runs
---------------------- FuguRoulette-player: post TF-IDF javelin: 1.3235824005932413 orc: 1.2596337832554234 don: 1.2329356851106978 mindy: 1.1935877563453061 dragon: 1.180695872064165 room: 1.16758789676671 goblin: 1.1244271157713812 gate: 1.0518778198496626 muttered: 0.9602704217082824 orb: 0.7818369426232508 vines: 0.7682713289173773 around: 0.7650741399517217 believe: 0.7181160263645541 set: 0.6960723252519683 ---------------------- Kaeritha-player: post TF-IDF troll: 1.8877816896391235 room: 1.6145159552006425 spell: 1.19387373804735 orb: 1.031131725198719 hand: 1.0226191383574903 halfling: 0.882770501608177 feather: 0.8321564150194518 chest: 0.7956715550842 need: 0.7833254070966856 without: 0.7774257667568547 thought: 0.7698168337310007 wasn: 0.7681132279117597 grogg: 0.7397095370527041 nodded: 0.7283692418929164 cricket: 0.7152753845274986 ---------------------- Ashleyder-player: post TF-IDF room: 1.37664885493529 halfling: 1.3095258648568422 orb: 1.1635393833341 arrow: 1.0958743699311024 bow: 1.0833323871838676 woman: 0.905661830111989 sword: 0.8274886204621582 side: 0.8159855961191507 door: 0.8030328480633289 weapons: 0.8023256227742956 bit: 0.7654054685520582 armor: 0.6925203949859854 compatriots: 0.6877982251257945 moment: 0.666106887452693 ready: 0.6591955622573524 wasn: 0.6407825783880001 group: 0.6181005287618395 words: 0.6162132133458346 statues: 0.6129058701485565 ---------------------- dungeon_master1-player: post TF-IDF grogg: 5.334199523123002 room: 3.811509447108922 gate: 3.258183021914178 orb: 2.618164708893951 troll: 2.613186928575063 arrow: 2.324879853387413 looking: 2.0945608918805405 dragon: 2.0386853821484214 statues: 2.0307941282615394 halfling: 1.9946267677568987 goblin: 1.9479046173471883 eyes: 1.9250729565572604 large: 1.8740265406115013 hand: 1.8621985701316857 ooc: 1.854167610118333 orc: 1.8453651951258079 ---------------------- Aaron Buchanan-player: post TF-IDF smile: 5.028089150947501 troll: 4.349229589605341 linda: 4.01623419920215 damage: 3.5816072459387898 let: 3.145522725372224 know: 3.0568701804539486 jenni: 3.0150241755107605 need: 2.9865597817204916 don: 2.89736685000583 fire: 2.8533063572331154 hit: 2.750325190292788 elf: 2.61638151392588 nothing: 2.5832965974665827 rope: 2.5651899037822403 want: 2.5516172618521207 room: 2.5234046485126127 hand: 2.408589994530533 key: 2.400913929253641 halfling: 2.300372097141645 grogg: 2.2976898742276277 ---------------------- Jenni-player: post TF-IDF insight: 3.5333368131417924 troll: 3.4738014944618905 help: 2.629726435567097 grogg: 2.396996336469604 need: 2.358944535917952 room: 2.25768912386651 healing: 2.2382624097615995 rolls: 2.2229326490531314 gate: 2.195439698041948 around: 2.161868029714761 flame: 2.132641891485049 perception: 2.1149040159363293 floor: 2.1054598538974045 hands: 1.9310855224062018 light: 1.8784320905937355 uses: 1.850257078968512 catch: 1.793277658871867 ---------------------- Bjorn Hasseler-player: post TF-IDF flame: 2.315315586844817 sacred: 2.315315586844817 stonecunning: 2.1557147060826947 rolls: 2.132883047459771 grogg: 1.9660626127710805 don: 1.9424906312537291 steps: 1.935482241603244 bridge: 1.7092785394164918 rope: 1.5744166673302291 torches: 1.551554596214274 stairs: 1.4732750153279608 platform: 1.3689503773093064 vines: 1.3351891642736244 light: 1.3217202403569526 ---------------------- randomexile-player: post TF-IDF troll: 5.780387270246775 grogg: 4.59954530049338 need: 4.379175783748707 attack: 3.7429397050152247 don: 3.564218421074024 open: 3.503242156009218 gate: 3.3068573706012985 stealth: 3.1899559813180645 traps: 2.965951521209904 chest: 2.9426150667239175 side: 2.8272991421295277 room: 2.8187225708944883 dragon: 2.7919898167411095 party: 2.784297298562819 know: 2.698287503059542 ---------------------- Linda-player: post TF-IDF grogg: 10.15480371661793 damage: 6.745957190399183 gate: 4.595526542550383 turn: 4.47763106887882 side: 4.220054751334396 room: 4.0759304935283875 troll: 3.6496283755351433 persuasion: 3.427787051079431 stairs: 3.2452878097049718 open: 3.0691978408049714 appears: 2.9662151644031236 barrier: 2.9526976397873197 hit: 2.882801312489094 please: 2.756473252393314 feet: 2.7553337830423685 ---------------------- Grymm-player: post TF-IDF rope: 2.5925740290266477 troll: 2.149767946611558 grogg: 2.1373623910153023 close: 2.093606121380299 goes: 1.9114083131138986 thing: 1.879425660287383 gate: 1.8498993377390152 behind: 1.7759591324283694 around: 1.7739744768952832 eyes: 1.6015525983573213 along: 1.565130385605012 face: 1.5465277621378841 merric: 1.531838768719999 goblin: 1.5017357357398398 chest: 1.4793322265307385 ---------------------- AllTheLolz-player: post TF-IDF rope: 2.5574727497157186 bit: 2.334695846271241 halfling: 2.2917865866720875 turn: 2.2913671375617244 help: 2.263326099701241 want: 2.255517431033907 let: 2.2248419816867973 hand: 2.05823145874274 thing: 2.0252535914010243 need: 2.017853031957051 trying: 1.9392838304479607 won: 1.9074029011042937 lever: 1.8940047810992084 motions: 1.8791666280630153 grogg: 1.8512620533629853 know: 1.8460073095362568 ---------------------- brkuhlman-player: post TF-IDF joy: 2.2090099096592093 bow: 1.4708821850714477 comrades: 1.3450198066079633 agreed: 1.2909672047219294 shit: 1.2511351948636689 hand: 1.1939893091569087 simply: 1.0754065506075219 alongside: 1.03095098597318 ready: 1.030909228527731 moves: 1.0217451884953292 follows: 1.019308558744064 esvele: 1.0031051305561383 eyes: 1.0031051305561383 alrighty: 1.0 sounds: 1.0 wow: 1.0 armor: 0.9675296552629622 goblin: 0.9675296552629622 arrow: 0.959551586099932 ---------------------- Poe-player: post TF-IDF grogg: 9.574956839446978 room: 7.7929146794417985 gate: 7.769157727681967 open: 5.161416388301517 side: 4.9552473292407315 hand: 4.920538249739186 something: 4.862660052617354 troll: 4.756897094197843 damage: 4.698981284560832 phoenix: 4.506875041306749 group: 4.4419312361884575 stealth: 4.347602688687722 bee: 4.337563548710324 stairs: 4.272837824041584 perception: 4.240823300482532 investigation: 4.214126267526979 bit: 4.2116435909201435 goblin: 4.16370490562877 ---------------------- Keiri'to-player: post TF-IDF gate: 3.813331273921538 course: 3.3238613690720182 light: 3.2357123635315 yenadar: 3.206131400462222 move: 3.0410330090181983 orc: 2.920652421803098 dragon: 2.91393405622444 casts: 2.910174915050543 shelton: 2.781316206653326 turn: 2.7696197904765247 close: 2.7395876537286137 history: 2.7290686528241705 rope: 2.533647571484718 toss: 2.488833414797614 ---------------------- Lorelai-player: post TF-IDF rope: 7.346484814122864 mage: 5.1901641703849695 hand: 5.169823617707603 something: 4.052962289815423 room: 3.7977359903069874 spell: 3.733564719352958 feet: 3.629297463463484 gate: 3.4221850444525543 need: 3.313446574887807 hands: 3.306280386619182 casts: 3.239250407373651 arrows: 3.094136824719543 hahaha: 3.0 lorelai: 2.8832894462350955 troll: 2.879950620848435 ---------------------- Bren'Dralagon-player: post TF-IDF javelin: 5.50125987652874 sigh: 4.0 hmm: 3.534360458898429 room: 3.5148283185111264 yup: 3.5117826563035313 axe: 3.114116974088525 wait: 3.0448104923325108 course: 2.7955498582374037 chest: 2.7578668995086213 kk: 2.68753920352695 rope: 2.491724054450192 hand: 2.409513756019609 attack: 2.380401354039185 side: 2.2585165820164 ft: 2.2506235321034813 lead: 2.229579193706388 better: 2.2144928823627117 move: 2.159570674311593 troll: 2.149851721830461 ---------------------- Shelton Herrington-player: post TF-IDF hehe: 12.124909531389427 don: 11.505547928323026 guess: 10.67778790195941 nice: 9.170367618719803 rope: 8.698156248650768 orb: 8.567297721201122 hey: 8.3986603737825 hmm: 8.284208790999351 guys: 8.195019661596476 want: 7.965528793382409 door: 7.900199902653034 know: 7.817490225187236 can: 6.476312939358579 maybe: 6.393688899561484 around: 6.370346146839613
- Moved the menu bars around
viztales 