Category Archives: Phil

Phil 3.30.11

7:30 – 6:30 VISIBILITY

  • Installing updates – windows, java, adobe. Let’s see if we can break *everything*!
    • I broke most things. A fix that is mentioned a lot in the forums and helped me was to UNINSTALL all my old Java SDKs/JDKs/JREs and then install the newest one fresh. After that, all was well
  • The computer is running faster now, though…
  • Doctor’s appt at 9:15
  • Going to try to write a straight F test function using R.
  • Checking up on the state of my account on the new server
    • Turns out that you need an ADMIN account to request a root account for a server. Put in a ticket. I wonder what’s going to be next?
  • Spent some time looking at the programming OOP in R. Looks doable, but different enough from C++/Java/Actionscript that I’m going to get a book. In the meantime, I’m going to calculate the F statistic in Actionscript and hand that off to the qf(.05,dfnum,dferror,lower.tail=F) function in R to see what I can do with it that way. In a way, it’s kind of nice, in that the processing load is kept on the client.

Phil 3.29.11

7:30 – 6:30 VISIBILITY

  • I think the new Firefox is slowing down my computer…
  • Added a lot of post hoc tests into the ANOVA widget. In the process, I discovered something really cool here: http://psych.wisc.edu/moore/Rpdf/610-R3_post-hoc_one-way_betw.pdf. It turns out that you can get the straight critical F values directly out of R using this:
    • qf(.05,dfnum,dfdenom,lower.tail=F)
  • Yes, I know that doesn’t seem all that awesome, but it does mean that I can put some functions together to calculate these things from the basic math, and get some of the flexibility that I’ve been looking for. Whee!
  • Applied for an account on our newly active server.
  • Copied all the webapps folders and sql databases to move over to the new server.

Phil 3.28.11

7:30 – 6:30 VISIBILITY

  • It’s freaking cold outside.
  • Filled out server paperwork
  • Found some R code that will run Dunnett. It runs on fgmdev too!
  • Loaded up a new version to fgmdev. Minor fixes. Dunnett tomorrow?
  • Discussion with Mike about versions of BlazeDS
  • Asked Dong to put script output directly into VISIBILITY rather than having a table viewer.

Phil 3.25.11

7:30 – 11:30 VISIBILITY

  • Swung by the customer site
    • Talked to John W. All development funding is done. There is a little maintenance money. THere are developer dollars to do something with Sharepoint. I reiterated that integrating VISIBILITY with Sharepoint is pretty straightforward, and far easier than re-implementing in Silverlight or HTML5.
    • Wrote up a list of the software and versions that we will need on the new PPM server and sent to Brian
    • Read in on my privac.
  • Leaving early today for air conditioning spring maintenance.
  • Worked on diagnosing the Runtime.exec() problem with Dong
  • Brought Brian up to speed on how things have been going.

Phil 3.24.11

8:00 – 5:30 VISIBILITY

  • Got my new leather mouse to match my leather mousepad. Need a leather computer and keyboard 🙂
  • Doing more upgrades on the R install on fgmdev. Here’s hoping nothing breaks. Pretty much everything is out of date.
  • Well, I got 25 errors, but didn’t break anything.
  • Talked to Dong about the problems that he’s having with Runtime.exec() on the Mac
  • Having Tom install the VISIBILITY suite on one of FGM VA’s servers
  • Initial work on adding in MANOVA and MANCOVA
  • Walked through table issues with Mike.
  • Webinar on cloud computing at 2:00: http://event.on24.com/r.htm?e=292186&s=1&k=69E5FCD268EA18FC4E0A060B96973886

Phil 3.23.11

8:00 – 6:00 VISIBILITY

  • Write status report for the last 7 hours of CATWALK
  • Write reqs for the applet version of the scripting system. Started here: http://www.fgmdev.com/blogs/?page_id=5220
  • Making sure that the coefficient order matches the group order
  • Commented my WebInterfaceIDE Server and Client code and walked Dong through it
  • Phone call with Brian and Bill on server migration
  • Finished fixing bugs, trying to port to fgmdev. Getting Java null exception errors back. Going to make a console panel for sending raw queries and getting responses. Done. It turns out that I was using an old version of Rserve (0.4-7) that came with the Debian apt-get system. The version that I was developing against is version 0.6-3. I installed that using install.packages(“Rserve”). Fortunately that compiled and loaded properly (unlike HH). The new version is here: fgmdev:/usr/local/lib/R/site-library/Rserve. That’s the one that needs to be started.
  • added rserve_start to the .bashrc file for root.

Phil 3.22.11

7:30 – 5:00 VISIBILITY

  • trying to get the fgmdev version of R matching the dev version
  • everything but vcd and HH are in the debian distribution
    • installed and loaded vcd from within R
    • HH failed. It needs a newer version of multcomp. Grr. Re-rigged the code so that it’s not needed.
  • Adding running totals of coefficients to ANCOVA – done
  • Checked up on PPM, which is running fine, but not being used. Helped write up more justification with Bill. Noticed that Matt H. was poking around in some of the + data.
  • Reworked the creation of tables so that they can have columns with different numbers of items in them. Did this by inserting the special ‘NA’ symbol into the list after the last element up to the length of the longest element.

Phil 3.21.11

7:30 – 5:30

  • Hey! It’s Spring! Boy, is it wet.
  • Tried to connect Outlook to the FGM webmail, just to see if that could work. So far, it just seems to kill Outlook.
  • Adding image size arguments to evaltoJpeg() – done
  • Adding a “Save Chart” option – done
  • Deleted and reloaded R on fgmdev. I have a script for removing and installing components, since install.packages() seems to break the installation. Did a quick test by running library(multcomp), which did not complain. Will try Rserve later.
  • Adding running totals of coefficients to ANCOVA
  • Making sure that the coefficient order matches the group order
  • Adding handling of NA in tables and/or dataframes
  • Need to figure out how to get multcomp working on debian – done. Next is HH

Phil 3.17.11

7:30 – 7:00 VISIBILITY

  • Testing code today
  • Need to add image size arguments to evaltoJpeg()
  • Need to add running totals of coefficients to ANCOVA
  • Need to make sure that the coeeficient order matches the group order
  • Need to add handling of NA in tables and/or dataframes

Phil 3.16.11

8:00 – 6:30 VISIBILITY

  • CRAN is down, which is messing up my testing – it’s back up again. Test tomorrow.
  • Need to write up a progress report for Larry
  • Spent the rest of the day putting together complex contrasts, which required reworking the RTestBase class, which then requred fixes of the Student T and ANOVA classes. Hopefully, I can get all of this working on fgmdev, I was having some trouble with library(HH) before CRAN went down.

Phil 3.15.11

7:30 – 6:00 VISIBILITY

  • Caught up with Dong a bit on the Financial Status part that we were working on before the email fire drill
  • We also discussed generating VISIBILITY reports based on financial data. I’ll be showing him how the Scripting system works so he can start mining the PPM data.
  • Scatterplots and coefficients and CONOVA, oh my!
  • And I need to tie into the VISIBILITY remote object so I can start working with those tables…
  • CMM meeting. They like what they see, but don’t want to pay for it.
  • More privac crap

Phil 3.14.11

7:30 – 4:30 VISIBILITY

  • Trying to get R installed on fgmdev.
    • Followed the directions here (http://www.mayin.org/ajayshah/KB/R/documents/install.html). The packages appear to have downloaded and installed, but I am unable to get the console running
    • Ah. I needed to run ‘apt-get install r-base’
    • Installed the following packages: Rserve, car, vcd, effects, gplots, multcomp.
    • set R_HOME to /usr/lib/R
    • set LD_LIBRARY_PATH to $R_HOME/lib
    • exported LD_LIBRARY_PATH
    • ran Rserve, which started Rserve as a daemon.
  • Meeting with Bill to discuss server things. I told him that I had been in contact with Denise WRT getting privac. He said that he would follow up, also got a note from Kris U. about tying into a mail server. Looks very doable.

Phil 3.11.11

7:30 – 3:30 visibility

  • VISIBILITY is back up on site
  • Denise responded to my privac request and passed it off to someone else in her office
  • Kris asked about if we required certs in our app. I told him no, that we could do without them.
  • Worked on adding Kruskal-Wallis and Welche’s W test to the one way ANOVA widget. I’m going to make it so that you check the tests and plots you want
  • Need to get R up and running on FGMdev so I can run this facing out.

Phil 3.10.11

7:30 – 6:30 VISIBILITY

  • Got the One-way ANOVA pretty much done
  • Went to the Site to get access to the server and discovered VISIBILITY server was down. Tried to send an email to vset but it bounced. Ended up sending an email to John W. Pick that up tomorrow after class
  • Sent an email to Denise about getting root access to the new VISIBILITY server
  • Started working on F* and W ANOVA variants.
  • All this statistics got me thinking. What if the amount of instructions it took to transform the two datasets until they were equal was tracked? Something along the lines of applying an n-dimensional convolution filter to n-dimensional histograms…

Phil 3.9.11

7:30 – 5:30 VISIBILITY

  • Sent Christine some screenshots of my setup for RemoteObjectTestbed
  • Server meetings this afternoon – looks like the goal is to have the server up and ready for us to load things on it by the end of April
  • Clean up some of the R code and make a correlation widget that accesses a VISIBILITY table.