Category Archives: VISIBILITY

Dong Shin 03.04.2011

  • PPM
    • reworked Export to retrieve all the data for the selected year (year + year_count) = selected year
      • order by Appropriations, year, budget_center….
    • fixed a bug showing FMP (Financial Mitigation Plan) on empty data
    • export data sets are identified by Funding Transaction Name?
    • using uid to divide the data sets
    • adde funding amount to export

Phil 3.3.11

7:30 – 5:30 VISIBILITY

  • Had a thought about getting data out of R. In the same way that I’m writing pix out to files that will then  be read.
    • Tried it, but no luck. It appears that the output from RServe is not considered redirectable
  • Went looking for more hints and found this in the RServe FAQ:
    • String s=c.eval(“paste(capture.output(print(summary(mymodel))),collapse=’\n’)”).asString();
    • And that seems to work nicely. The moral of the story seems to be “Find a way to get R to do the work”
  • Starting on the RemoteObject – should be mostly finished
  • Started RFlexClient
  • Accessing the setupModel.xml file
  • Having some problems getting the message broker. Found a redundant entry in the remoting-config.xml file. That, plus a recompile, redeploy seems to have fixed it.
  • Connected to the RemoteObject! Time to make some fancy widgets 🙂

7:30 – 3:30 VISIBILITY (3.4.11)

  • Hoping to deploy new PPM today, and that there will be no mysterious 502 error message…
  • Starting on some test statistical widgets to try out the remote object methods
  • Deploy went well. Nearly there
  • The queries are SLOW. Wondering if it has something to do with getting the RConnection. Going to try bouncing back the request on Monday (Depending on the stove delivery…)

Dong Shin 03.03.2011

  • PPM
    • reworking queries that retrieve the request data – done.
    • rearranged Show All and FY Filters, Show Selected
    • show Color coded status on Status column only in Requests Panel and Title column in Request Form
    • verified Financial Data in the Excel spreadsheet, fill 0’s with empty data
    • request status is the worst from projects’ status
    • removed user specific requests
    • delete requests added

Dong Shin 03.02.2011

  • haven’t checked for FGMDEV backup for a while – still working.
  • PPM
    • finally got Excel export working
    • as3xls does not work with multiple sheets….
    • added multiple files support along with single file
      • users can export the projects to a single file or multiple files
    • added progress bar
    • ExcelFile.saveToByteArray slows the application down, not allowing UI updates when it writes data
    • disabled project select on INCOMPLETE projects – cannot be exported
    • added error capture on export

Phil 3.2.11

7:30 – 4:30 VISIBILITY

  • Went over the latest version of PPM with Dong. We have a bit of a problem saving out multiple files without having a dialog pop up for each file. It’s possible that an Applet might be a workaround
  • Working on figuring out how to properly traverse a REXP object
    • Attr
      • Parse the debug string?
        • Split on commas
        • Stuff to the left of ‘=’ is an attribute
        • use getAttribute()
        • Recurse to parser?
    • Payload
      • Object o = rl.elementAt(i);
  • Attempted to install PPM on site, and had the following bugs:
    • When running on Trish’s machine, I got a remote object error 502 when trying to save a report for the first time. This did not happen on my box, but it has a static IP address and a hole in the firewall just for it. Will try on another machine today
    • When bringing up a report request, the fields were blank until some event (i.e. show all) was clicked
    • XLS files did not contain dollar figures

Dong Shin 03.01.2011

  • PPM
    • reworked Data Request update queries to allow new entries. This will remove non-selected and existing data, update current, add newly selected.
    • working on exporting Financial Data Request to Excel.
      • added project headers
      • added user/contact information
      • added for each project
        • Budgets
          • financial data for selected year from Oct to Sep

Phil 3.1.11

9:30 – 7:00 VISIBILITY

  • Dentist this morning
  • Testing Dong’s code. It looks good as far as it goes. We need some kind of excel export for the financial info.
  • Added a page for PPM req’s (for 2011) : http://www.fgmdev.com/blogs/?page_id=4987
  • Somewhat useful tutorial for RServe: http://www.ci.tuwien.ac.at/Conferences/DSC-2003/Drafts/Urbanek.pdf
  • Here’s another: http://www.stat.auckland.ac.nz/~iase/publications/17/C340.pdf
  • Building a more robust data.frame reader. Done
    • It turns out lists can be recursive. I temporarily have the DataFrameReader calling itself, which kind of works but could be better. Fix tomorrow.
  • Working my way through getting some basic calculations. There are some issues where if a string is assigned it is not considered a factor (whatever that is…). Unlike in the R interpreter, a factor must be explicitly set (i.e. “menuType <- as.factor(menuType)”)
  • Went to the customer site and sat around for two hours.

Dong Shin 02.28.2011

  • PPM
    • reworking Financial Data Request
      • Request spans from earliest FY and latest FY in selected projects
      • Request template creates monthly request status
      • Data Request Panel start in current year and month, removed All and reworked filtering
      • Individual Project Status added
      • added data_request_templates table and reworked _data_requests_projects and data_requests tables

Phil 2.28.11

7:30 – 4:30 VISIBILITY

  • It’s starting to feel more Spring-like than wintry. Got 107 miles in on the bike this weekend. My legs are very, very tired.
  • Going to try to do some compound actions with RServe, including running a query and generating a plot into a particular directory. If that works, I’m going to put that code in a remote object and try to trigger it from Flex.
    • Making progress, but getting data out of Rserve data frames is very goofy
  • Cloud-based IDE? – http://www.cloud9ide.com/. Some more stuff here: http://query7.com/cloud9-ide-review
  • Worked with Dong on getting the PPM requests organized in a by-month fashion.

Dong Shin 02.25.2011

  • PPM
    • created DBUpdateSQLs02252011.sql for adding data request tables
    • working on Project export
      • Get all budget centers and amounts query
        SELECT
        c.center_name as `Budget Center`,
        c.center_number as Number,
        GROUP_CONCAT(if(a.year=1,a.amount,NULL)) as FY1Amount,
        GROUP_CONCAT(if(a.year=2,a.amount,NULL)) as FY2Amount,
        GROUP_CONCAT(if(a.year=3,a.amount,NULL)) as FY3Amount,
        c.appropriation as Remarks
        FROM projects p, budget_centers c, budget_amounts a
        WHERE p.uid = c.project_id
        AND c.uid = a.budget_center_id
        AND p.uid = 96
        GROUP BY a.budget_center_id

        SELECT c.center_name as `Budget Center`,c.center_number as Number,
        GROUP_CONCAT(if(a.year=1,a.amount,NULL)) as FY1Amount,GROUP_CONCAT(if(a.year=2,a.amount,NULL)) as FY2Amount,GROUP_CONCAT(if(a.year=3,a.amount,NULL)) as FY3Amount,
        c.appropriation as Remarks
        FROM projects p, budget_centers c, budget_amounts aWHERE p.uid = c.project_idAND c.uid = a.budget_center_idAND p.uid = 96GROUP BY a.budget_center_id

    • Array Collection not returning data in ordered manner? May have to write own parser…

Phil 2.25.11

7:30 – 4:30 VISIBILITY

  • Looking for the mythical java client for Rserve. It does not appear to be in the distro or the svn trunk repo
  • Found it. It was in the snapshots here: http://www.rforge.net/Rserve/files/.
  • compiled the Rserve jar (using make!). Put it up on the maven repo as net.rforge.rserve ver 0.6.3
  • Added R.dll to my path
  • Started the server and connected to it with Putty. The connection was successful, and then the server crashed. That may be because PuTTY sent some bad characters.
  • Talking to the server in java without killing it. Wheee!
  • Writing up a description of our data migration plan – done.
  • Actually able to run an ANOVA and understand what I was doing. I think I can even generate plots and have them put in a particular server folder so that they can be downloaded and displayed in flex.

Dong Shin 02.24.2011

  • PPM
    • added reset filters on Requests Data
    • joining projects, budget_centers, appropriations doesn’t return projects with 0 budget because those might not have budget centers data – fixed by adding OR p.total_budget = 0 in the query
    • removed colors for projects and added status – incomplete gets red
    • rearranged project filter buttons
    • reworked Active Year filters
    • added tooltips to projects datagrid

Phil 2.24.11

8:00 – 5:00 VISIBILITY

  • Now that I’ve got rJava/RMI working, I’m going to try building a few composite commands and parsing the results.
  • And now I’m wondering if rServe makes more sense. It appears to create a separate workspace for each connection. That would work much better for a webapp. The only thing to watch out for is that the server goes down now and then, so it will have to be restarted under control of the Remote Object.
  • Spent the afternoon with the customer drawing diagrams of how our data will be packaged and migrated between platforms.

Dong Shin 02.23.2011

  • Verified that FGMDEV backup works
  • My Eclipse is not behaving!
    • hangs at Loading Web Service DOM….
    • found a offending bug on WTP – related to Tomcat?
    • adding -clean to eclipse.ini resolved it temporarily
    • moved projects to different workspace…
  • PPM
    • Request filtering using Year, Month, Description and Status
    • Project filtering (Active Project) based on Start and End Year range using appropriation length

Phil 2.23.11

7:30 -5:30 VISIBILITY

  • Server Meeting today at 11:15. Don’t see how I can make that
  • Over at site starting at 1:30
  • Setting up rJava: http://www.mumuen.com/2010/10/running-r-in-java-with-jrirjava.html
  • Got the rtest code in the rJava examples directory compiling. It turns out that the CRAN directory has an old version. Sheesh. Updated the maven repo with the version 9 jars. Added R_HOME to the path. Restarting all to register changes… No joy.
  • Following the directions here: http://mithil-tech.blogspot.com/2009/11/r-and-java-jri-via-eclipse.html
    • That worked!
  • Next will be to get R to run in Tomcat: Here’s where I’ll start: http://wiki.cvrgrid.org/index.php/RJava/jri_Setup
  • Useful r packages so far (google “CRAN xx’ for detailed info on the package):
    • sqldf – allows SQL manipulation of tables
    • reshape – for manipulation of data types
    • gwidgets – support for interactive graphics
    • HH
    • rJava – java interaction
    • RServe – R as a webserver