Monthly Archives: April 2015

Phil 4.20.15

8:00 – 4:00 SR

  • Still having problems accessing my virtual drives from the server. Will try again tomorrow.
  • Moving common chart components to WebGlCharts.
  • Showed Dong how I’m getting server data
  • We also discussed unit testing. We’ll target the test code at the generated JavaScript, since we’re testing logic at that point.

Dong Shin 04.20.2015

4.17.15

7:00 – 3:00 SR

  • Deploy new FR fixes
  • Meeting with Lenny and Chris
  • Financial paperwork! Finished, though I had to go back a couple of times.
  • Since the charting is somewhat stable for the moment, I went back to improving the dbObjects to handle matrix operations.

Phil 4.16.15

8:00 – 2:00 SR

  • Charts are working. One really odd bug. The alert (blocking) dialog that pops up to notify non-hardware rendering is interfering with the render. There must be some kind of odd race condition. Removing it seems to fix?
  • Once the review charts are done, the next thing Lenny wants is the truancy reports. Then add Baseian prediction of those most likely to be late.
  • Installing software on new box
  • Got Skolded. Now what?

Dong Shin 04.15.2015

  • fixed Month 10 not showing correctly
  • Contract Details not enabled when the first question is yes and the second is yes, then change the first to no Fixed
  • Direct Cite warning when Funding Breakdown is correct!
  • add Obligations, Outlays, and PM Actuals to Requisition selection in Query Builder – possibly year and month selectors as well.

Phil 4.15.15

8:00 – 12:00 SR

  • My remote drives are not working on the servers any more. Put in a ticket
  • Fixed the Month1 != Month10 problem Dong found.
  • Was going to deploy the chart test but Bill had to leave. Maybe tomorrow.
  • Timesheets!

Phil 4.14.15

8:00 – 4:30 SR

  • FR seems to be running smoothly. Didn’t see Lenny.
  • Found a better linear regression class: http://commons.apache.org/proper/commons-math/apidocs/org/apache/commons/math3/stat/regression/SimpleRegression.html
  • Continuing to work on bars. Index and offset don’t seem to be working? Fixed.
  • Everything’s working. Now to automate the chart creation from the dataFormat and dataProvider.CombinedChart
  • Working out the interfaces for the format. This is helping a lot, particularly the ‘dictionary’ interface
  • Reworked the dataProvider and dataFormat interfaces and objects. This is now what it looks like:
  • DataFormat interface and example: 
    export interface IChartElementFormat {
   label:string;
   objectName:string;
   type:string; // "area", "bar", pie, cluster
   hexColor:number;
}

export interface IChartFormat{
   [label:string]:IChartElementFormat;
}

this.dataFormat = { // might add 2D/3d, dynamic/static, etc.
   goals: {label:"Goals", objectName:"goals", type:"area", hexColor:0xFF0000},
   obligations:{label:"Obligations", objectName:"obligations",  type:"area",hexColor:0xFFFF00},
   pm_actuals:{label:"PM Actuals", objectName:"pm_actuals",  type:"bar",hexColor:0x00FF00},
   facts:{label:"Facts", objectName:"facts",  type:"bar",hexColor:0x0000FF},
   future_pm_actuals:{label:"Future PMA", objectName:"future_pm_actuals",  type:"area",hexColor:0xAAFFAA},
   future_facts:{label:"Future FACTS", objectName:"future_facts",  type:"area", hexColor:0xAAAAFF}
};
  • DataProvider interfaces: 
    export interface IChartBoundries {
   xmin:number;
   xmax:number;
   ymin:number;
   ymax:number;
   zmin?:number;
   zmax?:number;
}

export interface IChartDataMapping{
   [label:string]:number;
}

export interface IMinMax {
   min:number;
   max:number;
}

export interface IChartDataElement{
   [label:string]:IMinMax;
}

export interface IChartDataCollection{
   [objectName:string]:IChartDataElement;
}

export interface IChartData{
   type:string;
   min_max:IChartBoundries;
   mappings:IChartDataMapping[];
   data:IChartDataCollection;
}
  • DataProvider example: 
    this.dataProvider = {
   type:'XY', // RAH (Radius Angle Height) RAE (Radius Azimuth Elevation), XYZ, etc.
   min_max:{xmin:0.00, xmax:11.00, ymin:0.00, ymax:3715.30},
   mappings:[{Jan:0, Feb:1, Mar:2, Apr:3, May:4, Jun:5, Jul:6, Aug:7, Sep:8, Oct:9, Nov:10, Dec:11}],
   data:{
      goals: {
         Jan: {min: 0, max: 1000.00},
         Feb: {min: 0, max: 1100.00},
         Mar: {min: 0, max: 1210.00},
         Apr: {min: 0, max: 1331.00},
         May: {min: 0, max: 1464.10},
         Jun: {min: 0, max: 1610.51},
         Jul: {min: 0, max: 1771.56},
         Aug: {min: 0, max: 1948.72},
         Sep: {min: 0, max: 2143.59},
         Oct: {min: 0, max: 2357.95},
         Nov: {min: 0, max: 2593.74},
         Dec: {min: 0, max: 2853.12}
      },
      obligations: {
         Jan: {min: 0, max: 500.00},
         Feb: {min: 0, max: 600.00},
         Mar: {min: 0, max: 720.00},
         Apr: {min: 0, max: 864.00},
         May: {min: 0, max: 1036.80},
         Jun: {min: 0, max: 1244.16},
         Jul: {min: 0, max: 1492.99},
         Aug: {min: 0, max: 1791.59},
         Sep: {min: 0, max: 2149.91},
         Oct: {min: 0, max: 2579.89},
         Nov: {min: 0, max: 3095.87},
         Dec: {min: 0, max: 3715.04}
      },
      pm_actuals: {
         Jan: {min: 0, max: 250.00},
         Feb: {min: 0, max: 341.39},
         Mar: {min: 0, max: 495.27},
         Apr: {min: 0, max: 618.30},
         May: {min: 0, max: 923.08},
         Jun: {min: 0, max: 1318.68}
      },
      facts: {
         Jan: {min: 0, max: 125.00},
         Feb: {min: 0, max: 134.17},
         Mar: {min: 0, max: 134.31},
         Apr: {min: 0, max: 163.00},
         May: {min: 0, max: 164.36},
         Jun: {min: 0, max: 202.29}
      },
      future_pm_actuals: {
         Jun: {min: 1318.68, max: 1318.68},
         Jul: {min: 1257.91, max: 1499.96},
         Aug: {min: 1342.92, max: 1827.03},
         Sep: {min: 1427.94, max: 2154.10},
         Oct: {min: 1512.96, max: 2481.16},
         Nov: {min: 1597.97, max: 2808.23},
         Dec: {min: 1682.99, max: 3135.30}
      },
      future_facts: {
         Jun: {min: 202.29, max: 202.29},
         Jul: {min: 193.38, max: 215.48},
         Aug: {min: 196.77, max: 240.99},
         Sep: {min: 200.17, max: 266.49},
         Oct: {min: 203.57, max: 291.99},
         Nov: {min: 206.96, max: 317.50},
         Dec: {min: 210.36, max: 343.00}
      }
   }
};
  • Need to place the dataProvider in the html to see if it works there.

Dong Shin 04.14.2015

  • better instruction to set up Karma for Windows
  • going thru AngularJS: Up and Running again for TDD
  • two bugs reported from Lenny, but cannot duplicate here…..
    • On Contract Details if a user selects yes for the first answer then changes it to no they cannot continue.  I got around it by changing the second answer to no then changing the first answer to no.
    • On the Request Form Data (the info in the center that populates from the data entered in each module) month 10 for the Outlay Plan is showing as zero on all request forms.  I checked and there is a dollar amount entered in the Outlay Plan module.  All other months appear to be displaying correctly.

Dong Shin 04.13.2015

Phil 4.13.15

8:00 – 5:00 SR

  • Figured out Bayes Theorem and got some spreadsheet examples working over the weekend. It’s effective and appropriate.
  • Started modifying DBTypedTable to handle tables that are created by sequential calls to the DB. Basically a way of making mode sophisticated joins.
  • Adding items into the 2Dchart test.
  • All full area charts work.
  • Need to get area charts that only cover part of the chart working. Done
  • Need to add DataPoints to the bottom of area charts that are not zero. Done
  • Need to add clustered bars, based on the number of where the bar is in the order of the dataFormat object.
  • Need to throw an event (or do something similar) when an items is clicked.

Phil 4.10.15

8:00 – 4:00 SR

  • Possibly a good book to get? https://www.ng-book.com/
  • Working on getting regression to predict upper and lower bounds
  • Working out the structure of the dataFormat and dataProvider Objects
  • dataFormat example 
    this.dataFormat = { // might add 2D/3d, dynamic/static, etc.
   goals: "area",
   obligations:"area",
   pm_actuals:"bar",
   facts:"bar",
   pm_future:"area",
   facts_future:"area"
};
  • Matching dataProvider example. Note the _mappings array and the fact that all items have a min/max value as well as a chart-wide minmax (no Z in this case) 
    this.dataProvider = {
   _type:'XY', // RAH (Radius Angle Height) RAE (Radius Azimuth Elevation), XYZ, etc.
   _min_max:{xmin:0.00, xmax:11.00, ymin:0.00, ymax:3135.30},
   _mappings:[{Jan:0, Feb:1, Mar:2, Apr:3, May:4, Jun:5, Jul:6, Aug:7, Sep:8, Oct:9, Nov:10, Dec:11}],
   goals:{Jan:{min:0, max:1000.00}, Feb:{min:0, max:1100.00}, Mar:{min:0, max:1210.00}, Apr:{min:0, max:1331.00}, May:{min:0, max:1464.10}, Jun:{min:0, max:1610.51}, Jul:{min:0, max:1771.56}, Aug:{min:0, max:1948.72}, Sep:{min:0, max:2143.59}, Oct:{min:0, max:2357.95}, Nov:{min:0, max:2593.74}, Dec:{min:0, max:2853.12}},
   obligations:{Jan:{min:0, max:500.00}, Feb:{min:0, max:600.00}, Mar:{min:0, max:720.00}, Apr:{min:0, max:864.00}, May:{min:0, max:1036.80}, Jun:{min:0, max:1244.16}, Jul:{min:0, max:1492.99}, Aug:{min:0, max:1791.59}, Sep:{min:0, max:2149.91}, Oct:{min:0, max:2579.89}, Nov:{min:0, max:3095.87}, Dec:{min:0, max:3715.04}},
   pm_actuals:{Jan:{min:0, max:250.00}, Feb:{min:0, max:341.39}, Mar:{min:0, max:495.27}, Apr:{min:0, max:618.30}, May:{min:0, max:923.08}, Jun:{min:0, max:1318.68}},
   facts:{Jan:{min:0, max:125.00}, Feb:{min:0, max:134.17}, Mar:{min:0, max:134.31}, Apr:{min:0, max:163.00}, May:{min:0, max:164.36}, Jun:{min:0, max:202.29}},
   future_pm_actuals:{Jun:{min:1318.68, max:1318.68}, Jul:{min:1257.91, max:1499.96}, Aug:{min:1342.92, max:1827.03}, Sep:{min:1427.94, max:2154.10}, Oct:{min:1512.96, max:2481.16}, Nov:{min:1597.97, max:2808.23}, Dec:{min:1682.99, max:3135.30}},
   future_facts:{Jun:{min:202.29, max:202.29}, Jul:{min:193.38, max:215.48}, Aug:{min:196.77, max:240.99}, Sep:{min:200.17, max:266.49}, Oct:{min:203.57, max:291.99}, Nov:{min:206.96, max:317.50}, Dec:{min:210.36, max:343.00}}
};
  • In excel, the results look like the following. Now working on incorporating into the graphing system prediction
  • Setting up a method to calculate the screen positions of the data points based on the dataProvider. Got margins, datagrids and areaCharts working. BarCharts are next. I need to think about how to cluster the bars. I’ll also need to add additional DataPoints when the botom axis is not (zero? horizontal?)

Phil 4.9.15

8:00 – 4:30 SR

  • Showed Lenny the new charts. He’ll be out tomorrow, so I’ll probably deploy the test version on Monday. We then had a long talk about the best way to statistically model the data in the first chart. It really sounds like Bayes might be the way to do this. Which is awesomely cool, because my schoolwork and jobwork are perfectly aligned for the weekend. Gonna charge me some hours figuring out Bayes.
  • Building the dataFormat and dataProvider Objects. Since Lenny wants future performance, I’m pulling in the Apache commons math jar for linear regression. I think I want OLSMultipleLinearRegression
  • Added SimpleLinearRegression to JavaUtils that wraps OLSMultipleLinearRegression and hides some complexity.that is not intuitively obvious documentation. Glad I found this example. Added to Subversion. I’ll probably need to add a method that gets the error so that I can add that to the future error.
  • More JSON tomorrow, then on to Bayes. Did get this book…

Phil 4.8.15

8:00 – 4:00 SR

  • Kinda promised Ronda cookies
  • Worked through Markov Chain Matrix math. I think I understand how it relates to PageRank Matrix math, and therefore, how Page Rank is a Markov Chain.
  • Working through charting bugs
    • Added font and color choice to dprint
    • Fixed canvas font application in WebGlComponentClasses
    • Updated WebGlInterfaces
    • Fixed bugs in ChartInfo
  • Newest version is live
  • Adding JSON objects for charts to read and display.

Dong Shin 04.08.2015

  • working on Reqonciler
    • got Spring File Uploader working
      • requires multipartResolver bean, commons-fileupload-1.3.1.jar, commons-io-2.4.jar
    • ported ContractsParser from FinancialAssistant to ReqoncilerService