Category Archives: VISIBILITY

Mike 5.28.2012

  • Working on the chart stuff from home
  • Finished my class structure and all toXml and fromXml methods, here’s an example:

And the XML that defines it:

<flexichart>
<series>
<set seriesType=”ColumnSet” type=”clustered”>
<series>
<series seriesType=”ColumnSeries” yField=”0″ fillColor=”14976769″ fillAlpha=”1″/>
<set seriesType=”ColumnSet” type=”stacked”>
<series>
<series seriesType=”ColumnSeries” yField=”1″ fillColor=”10861646″ fillAlpha=”1″/>
<series seriesType=”ColumnSeries” yField=”2″ fillColor=”1807833″ fillAlpha=”1″/>
</series>
</set>
</series>
</set>
</series>
</flexichart>

 

Now I need to start working on the configuration screen

Also, here is a useful link for parsing XML using e4x: https://developer.mozilla.org/en/E4X_Tutorial

Mike 5.25.2012

  • Production backups
  • Back and forth emails with Jessica R. regarding account troubles, she was trying to log in to the data vis thinking it was project assistant
  • sent out the vis tool weekly status email
  • After lots of digging I found a connectivity trouble shooting guide designed for the problems we’re having! I found a link to it through someone’s blog.  I plan on using to it write our own troubleshooting guide to send to users.
  • I sent a few tests from the troubleshooting guide to a local site admin I’ve been working with.
  • Worked with Dong to debug an issue with my auto-login system

Dong Shin 05.24.2012

  • Demo/Tutorial at the site with Mike
  • fixed scriptEngine returning Byte to String for VisibilityScripting
  • fixed SolrXMLIngest to change illegal characters in column names to ‘_’
  • following fields to be added to PPM’s Budget Centers
    • Funding Type – BASE or OCO
    • Location
    • Org
  • SQL to add the fields to the budget centers
    • ALTER TABLE `budget_centers` ADD `funding_type` VARCHAR( 255 ) NULL DEFAULT ‘BASE’,
      ADD `org` VARCHAR( 255 ) NULL DEFAULT ‘S1’,
      ADD `location` VARCHAR( 255 ) NULL DEFAULT ‘Fort Meade, MD’;

Mike 5.24.2012

  • Production backups
  • Checked on the ticket status for diagnosing connection problems to specific sites; it is “in the queue.”
  • Demo/Tutorial with Jessica R., Lenni M., and Carla H. at my desk.  We went over PA, PPM, and data vis.  I gave them PPM accounts and made them all admins.  They seemed excited about the tool. A few issues arose from the demo:
    • in the data vis, periods cannot appear in column headers or you have problems
    • Need new columns for reqs:
      • Funding Type
      • Physical Location
      • Organization
  • Fix the period issue by having all ingestors replace periods in headers with underscores

Mike 5.23.2012

  • Production backups
  • Worked with Dong to try and mesh the COGNOS data and our data, we had a bit of trouble matching things up so we went and spoke with Jessica R..  She seems to have a very good picture of how the budgets are organized and also showed us some reports she’d like to be able to produce.  There are a few fields that need to be added to Reqs to produce them: type, physical location, and Org.
  • We also have a meeting/demo set up with her tomorrow morning at my desk.
  • Contacted my old badge sponsor to try and transfer my badge
  • Charting stuff…

Working on the Config Screen.  Here are my current list of config screens and options:

General

  • Legend On/Off
  • Legend Position
  • Base at Zero = true|false

Series: Each chartable field will have enabled and type selector, changing types will change the options available.  Types:

  • AreaSeries – Stackable
    • yField
    • Fill Color
    • Fill Alpha
    • Form = segment|curve|horizontal|reverseStep|step|vertical
    • strokeEnable = true|false
    • Stroke Color
    • Stroke Width
  • BubbleSeries
    • yField
    • radiusField
    • minRadius=0
    • maxRadius=50
    • Fill Color
    • Fill Alpha
    • strokeEnable = true|false
    • Stroke Color
    • Stroke Width
  • CandlestickSeries
    • openField
    • closeField
    • highField
    • lowField
    • Fill Color
    • Fill Alpha
  • ColumnSeries – Stackable
    • yField
    • Fill Color
    • Fill Alpha
  • HLOCSeries
    • openField
    • closeField
    • highField
    • lowField
    • Fill Color
    • Fill Alpha
  • LineSeries
    • yField
    • Form = “segment|curve|horizontal|reverseStep|step|vertical”
    • Stroke Color
    • Stroke Width
  • PlotSeries
    • yField
    • Fill Color
    • Fill Alpha
    • Stroke Color

Sets: AreaSeries and ColumnSeries will both be members of sets with the following options:

  • AreaSet
    • series = []
    • type = “100%|clustered|overlaid|stacked”
    • allowNegative= true|false
  • ColumnSet
    • series = []
    • type = “100%|clustered|overlaid|stacked”
    • allowNegative= true|false

That’s all the options I can think of for now, always room for more.

Dong Shin 05.22.2012

  • stopped by the Fort, computers were down. Could not get V badge….
  • a bug in VisibilityScripting not returning data fields in correct format for complex SQL queries (Join tables?)
  • fixed COGNOS SQL using CAST function
    • SELECT f.*,
      CAST(
      CASE WHEN SUBSTR(FY_Month, 8, 3) = ‘Oct’ THEN  month_1
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Nov’ THEN  month_2
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Dec’ THEN  month_3
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Jan’ THEN  month_4
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Feb’ THEN  month_5
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Mar’ THEN  month_6
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Apr’ THEN  month_7
      WHEN SUBSTR(FY_Month, 8, 3) = ‘May’ THEN  month_8
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Jun’ THEN  month_9
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Jul’ THEN  month_10
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Aug’ THEN  month_11
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Sep’ THEN  month_12
      ELSE ‘other’
      END AS DECIMAL) AS PM_Actuals
      FROM visibility_dev2.facts_fy12 f, project_portfolio.budget_centers c, project_portfolio.obligations_outlays o
      WHERE c.uid = o.funding_id
      AND f.Program = c.facts_pe
      AND f.BC = c.center_number
      AND f.Approp = c.appropriation
      AND o.year = SUBSTR(FY_Month, 3, 4)
      AND o.year_count = 1
      AND o.type LIKE “PM Actuals%”

Mike 5.22.2012

  • Production backups
  • Imported Dong’s script to merge data sources, it ran but returned zero rows so the data must not be matching up well
  • My sponsor is letting my badge expire next month so I sent Jim from TASC a note about it
  • Working on configurable chart
  • Submitted my proof of concept with toXml and fromXml

Mike 5.21.2012

  • Production backups at site
  • meeting being set up to discuss moving SSPs?
  • Per Jessica R.’s request to show column charts with line trends on them, I’m looking in to making a customizable chart
    • Will allows users to change series types
      • AreaSeries
      • BubbleSeries
      • CandlestickSeries
      • ColumnSeries
      • HLOCSeries
      • LineSeries
      • PlotSeries
    • Will allow users to select series color
    • Will save these settings to dashboards / slideshows
    • Will have some kind of copy / paste functionality to copy settings between multiple similar charts
    • The configuration menu will be accessed through either a button or right-clicking the chart if the button is too obnoxious looking

Dong Shin 05.21.2012

  • decided to use SQL query to genenrate COGNOS supporting data (PM Actuals) instead of a lengthy Python script
  • working on SQL queries…
  • COGNOS with matching PM Actuals
    • SELECT f.*,
      CASE WHEN SUBSTR(FY_Month, 8, 3) = ‘Oct’ THEN  month_1
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Nov’ THEN  month_2
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Dec’ THEN  month_3
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Jan’ THEN  month_4
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Feb’ THEN  month_5
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Mar’ THEN  month_6
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Apr’ THEN  month_7
      WHEN SUBSTR(FY_Month, 8, 3) = ‘May’ THEN  month_8
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Jun’ THEN  month_9
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Jul’ THEN  month_10
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Aug’ THEN  month_11
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Sep’ THEN  month_12
      ELSE ‘other’
      END AS PM_Actuals
      FROM visibility_dev2.facts_fy12 f, project_portfolio.budget_centers c, project_portfolio.obligations_outlays o
      WHERE c.uid = o.funding_id
      AND f.Program = c.facts_pe
      AND f.BC = c.center_number
      AND f.Approp = c.appropriation
      AND o.year = SUBSTR(FY_Month, 3, 4)
      AND o.year_count = 1
      AND o.type LIKE “PM Actuals%”
      ORDER BY f.uid
  • match COGNOS data with PPM data
    • SELECT f.*, o.month_1 as PM_Actuals FROM visibility_dev2.facts_fy12 f, project_portfolio.budget_centers c, project_portfolio.obligations_outlays o
      WHERE c.uid = o.funding_id
      AND f.Program = c.facts_pe
      AND f.BC = c.center_number
      AND f.Approp = c.appropriation
      AND o.year = 2012
      AND o.year_count = 1
      AND o.type LIKE “PM Actuals%”
  • parse FY_Month field for year and month
    • SELECT f.FY_Month, SUBSTR(FY_Month, 3, 4) as year,
      CASE WHEN SUBSTR(FY_Month, 8, 3) = ‘Oct’ THEN  ‘month_1’
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Nov’ THEN  ‘month_2’
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Dec’ THEN  ‘month_3’
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Jan’ THEN  ‘month_4’
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Feb’ THEN  ‘month_5’
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Mar’ THEN  ‘month_6’
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Apr’ THEN  ‘month_7’
      WHEN SUBSTR(FY_Month, 8, 3) = ‘May’ THEN  ‘month_8’
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Jun’ THEN  ‘month_9’
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Jul’ THEN  ‘month_10’
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Aug’ THEN  ‘month_11’
      WHEN SUBSTR(FY_Month, 8, 3) = ‘Sep’ THEN  ‘month_12’
      ELSE ‘other’
      END AS month
      FROM visibility_dev2.facts_fy12 f

Mike 5.18.2012

  • Production backups
  • Wrote up our weekly status and submitted it to Mike H., Dave W., and Jim from TASC
  • No word back yet from the data center about our connectivity problems
  • Looking in to some neat javascript only things for simple websites

Dong Shin 05.18.2012

  • spent sometime setting up Visibility and Scripting Servers for COGNOS data
  • COGNOS data fields mapping to the PPM database fields, others are calculated…
    • FY Month (FYYYYY MMM) – FY2012 Oct
    • Capability
    • Program (FACTS)
    • Service
    • Sub-Project (Expenditure Center)
    • BC  (Budget Center)
    • Approp
    • Current Budget (FY Budget)

Mike 5.17.2012

  • Production system backup
  • Met with Dong and went over the COGNOS data, we should be able to write a script that will mesh the desired data in to one table in visibility
  • Got a response from the other person having connection problems.  They are still having problems and gave me their IP.  I submitted a ticket with the enterprise help desk so hopefully they will have an idea of what is going wrong.
  • Finished up my manifest reader library and wrote a short users guide.  Shared in my sandbox svn folder for now.

Mike 5.16.2012

  • Production server backups
  • Completed some OCI training for TASC requested by Jim
  • The remote site admin got back to me.  He said he can’t reach the production but last month was able to reach the test site.  I asked him to verify he can connect to the test site then I will contact local server admins
  • Also sent an email to the other person who was having connection issues.  I haven’t heard from them since their local admin said he could connect just fine.  Hopeful the admin and user resolved everything and just forgot to tell us.
  • Started matching up data between PPM and COGNOS, asked Dong to come in tomorrow to help write a query

Mike 5.15.2012

  • Backups on the production server
  • Prepared some of the connection test document and troubleshooting, will have more to add to troubleshooting once we resolve something
  • Read up on how the network works, proxies, firewalls, pki, etc. to see what may be blocking some users
  • Updated my internal FGM resume
  • It works! I have a small gwt app that displays exactly when it was built, the svn version number, and who built it.  We can also add other fields as needed.
  • Need to turn it in to a library.

Mike 5.14.2012

  • Backed up the production server
  • Drafted a new timeline for deploying the VIS Tool with the final date of July 9th for full production (aprox. 2 months of connection testing and early adopters should be sufficient depending on connection issues), sent it to Jim/Tangie
  • Sent an email to the admin of the user who is having connection problems, hopefully he can tell me why he can connect and she cannot
  • Added classification markings to the vis index sites
  • Still playing around with maven and creating a webservice that returns the build date and SVN version number.  I finally have the date and version being placed in the manifest file correctly.