Category Archives: Phil

Phil 10.23.14

8:00 – 5:30 SR

  • DB backups
  • Documentation
    • com.edgeti.VisibilityServer.Excel
      • ExcelIngestorBase
      • AsciiIngestor
      • ExcelIngestor
      • CsvIngestor
      • ExcelExport
      • FileUploader
      • FileUploader2
      • TsvIngestor
    • com.edgeti.VisibilityServer.Ingestor
      • AutoIngestor
      • AutoIngestorServlet
      • Credentials
      • CredentialsBase
      • FilterFacade
    • com.edgeti.VisibilityServer.Security
      • AccessControlFilter
      • FilterFacade
      • CredentialsBase
      • Credentials
    • com.edgeti.VisibilityServer.UsersAndRoles
      • DbHelper
      • DbTable
      • RoleInfoObject
      • RoleNode
      • RoleTree
      • TableInfoObject
      • UserAndRoleFakeData
      • UsersAndRolesTests
    • com.edgeti.VisibilityServer.XMLIngestors
      • SolrXMLIngestor

Phil 10.22.14

8:00 – 5:00 SR

  • DB backups
  • Lenny is setting up a meeting with Larry next week
  • Talked to Dong about how to make the new Visualization more like ScriptingServer. The web folder contains all the components and directives that the system uses, but the particular html page is created dynamically by a servlet. The page is made in an IDE where the queries can be built and associated with sections of the html code. The actual page the user sees doesn’t really even need to have communication with the server. This doers not address the input side, where interaction with the tables is essential. But those pages are not dynamic like reports and would probably be built in the traditional way.
  • Documentation
    • Added Documentation folder to repo
    • Dong added in the DB documentation
    • De-Mavenized the Visibility project. Pulled out a lot of cruft.
    • com.edgeti.Utils
      • Column
      • HttpFile
      • HttpUtilities
      • IngestResult
      • PropertyLoader
      • SSLUtilities
    • com.edgeti.Utils.logging
      • Log4jInit
      • LoggingEntry
      • VisibilityLogger
  • I have documented my brain to death. Seeing if there is some room for Angular.

Phil 10.21.14

8:00 – 4:30SR

  • DB Backups
  • Documentation
    • visibilityScriptingServer.Autocomplete.languages.DummyLanguageService
    • visibilityScriptingServer.Autocomplete.languages.PythonLanguageService
    • visibilityScriptingServer.RemoteObjects.ScriptObject
    • visibilityScriptingServer.RemoteObjects.UserObject
    • visibilityScriptingServer.Servlets.AlertServlet
    • visibilityScriptingServer.Servlets.PublisherServlet
    • visibilityScriptingServer.Servlets.ScriptRunnerServlet
  • Deployed new FA

Phil 10.20.14

8:00 – 10:00, 12:00-4:00SR

  • DB Backups.
  • Documentation
    • De-mavenized and fixed scriptEngine and scriptEngineServer
    • Diagrammed com.fgm.scriptEngine
    • Diagrammed com.fgm.scriptEngineServer
      • Commented PublishDataObject
      • Commented PublishSupportObject.
      • Commented AlertInfoObject
      • Commented ScriptCensor
      • Commented ScriptResultObject
      • Commented ScriptRunner
      • Commented UrlReader

Phil 10.17.14

8:00 – 3:00 SR

  • DB Backups
  • Deploy New FA
  • Fixed the truancy report by moving the query forward a month
  • Tried to get Wolfram to show clusters in a meaningful way. Worked with the help files but not with my fake ISRPMO data. Beat on that for a while with no luck.
  • More documentation?
    • Diagrammed com.fgm.security.pki and fgm.security.pki.ip

Phil 10.16.14

8:00 – 5:00 SR

  • DB Backups
  • MaintainJ – reverse engineered diagramming. Unfortunately, it’s $99 to license. Examine later….
  • AgileJ eclipse plugin. Produces class diagrams. Update site: http://www.agilej.com/structureViews. Using that.
  • Working on JavaUtils
    • Generated class diagrams for all packages
    • Finished PropertyLoader
    • Finished SSLUtilities
  • Working on javaUtils.database
    • Finished DbHelper
    • Finished DbTable
    • Finished DbTypedTable
    • Not sure what to do with SQLResult yet. Need to find out where it’s used, and call hierarchy doesn’t work until the code compiles. If it’s anywhere, it’s in FinancialAssistant, which we will get to shortly.
  • Working with javaUtils.dbObjects
    • Finished BaseObject
    • Finished CreateTableObject
    • Finished InfoObjectManager
    • Finished InsertObject
    • Finished QueryObject
    • Finished QueryResponseObject
  • Working with javaUtils.logging
    • Finished Log4jInit
    • Finished VisibilityLogger
    • Finished LoggingEntry
  • Fixed ScriptEngine on the way to fixing FinancialAssistant

Phil 10.15.14

8:00 – 5:00 SR

  • DB Backups
  • Building query and chart for acceptances. Working, needs to be vetted by Lenny. In addition to CURRENT and OVERDUE, we added NEGATIVE, where the dates of “committed” and “accepted” are incorrect
  • Got Javadoc working, and errors turned off in the editor.
    • Finished YuiTestServlets
    • Ran into a problem navigating code. The compiler has to be working, and that was failing with an “Could not initialize class org.eclipse.jst.j2ee.project.facet.IJ2EEFacetConstants” error. Had to install Web, XML, Java EE and OSGi Enterprise Development plugins.
    • And now I have to install Java EE to get the javax.servlet. No, I can’t do that because Oracle has a Glassfish download in their “java_ee_sdk-7u1.zip” file. What an AWESOME company. Got it from http://www.java2s.com/Code/Jar/s/Downloadservletapijar.htm instead.
    • Turned off all the Maven external libraries as well, and placed the code in a “jars” folder, so it’s now backed up by SVN.
  • Working on JavaUtils
    • CalendarParser – done
    • CalendarParserException – done
    • Dom4jUtils – done
    • FileUtils – done

Phil 10.14.14

8:00 – 2:00 SR

  • DB backups
  • Deployed new FA
  • Discussion with Chris about next steps. Going to Javadoc the classes and then discuss next steps. He wants to be able to do visualizations ASAP
  • Downloading new Eclipse
  • Pulled all the current code from Subversion into new directory from new repository
  • Installed JavaDoc plugin

3:00-6:00

  • More Wolfram Alpha
  • Alpha is more forgiving as far as files, but it still takes the same overall format – a column for each factor (i.e. User, Capability, dollars). There can be a row with factor names.
  • Found the financial data charting for Mathematica. Need to find it in Alpha. Or maybe it’s the Wolfram Finance Platform (more info)?

Phil 10.13.14

10:00 – 2:00 SR

  • Figuring out if Mathematica can be used for producing presentation widgets for data visualization. The first tricky thing seems to be how it stores tables (lists) for analysis: http://reference.wolfram.com/language/guide/ListManipulation.html
  • Success! In that I was able to read in a file (Insert->File Path…), then click Import under the line. Boy, that’s intuitive…
  • ANOVA (yes, all caps) runs like this: ANOVA[allErrors, {Alias, TestType, All}, {Alias, TestType}]

Phil 10.10.14

8:00 – 5:00 SR

  • Backups
  • Updated lab list
  • Finish ng-route section of Angular book
    • module.config is very picky about what it can use. All the injections that work in controllers, factories and services cannot be used here. Angular module.provider can interact, but providers appear to be tricky too. This post goes into the differences between factories, services and providers.
  • Start on Documentation – Nope started on directives, since it’s a long weekend.
  • Install Mathematica – done

Phil 8.9.14

8:00 – 5:00 SR

  • Backups!
  • Restored the qb_queries table since Lenny had blown some of his queries away
  • More Angular – walking though the full webapp example. Also watched this talk on TypeScript and Angular. Good stuff – just not quite yet.
  • Meeting at 2:00, plus a deploy of the fixed FA.
    • We are to document the current system. I’ll do most of it, which will keep Dong free to fix and update things. Here’s the list of Things To Do.
    • The next step will be to do visualization (reports, slides, quad-charts) of the live data. We may roll our own or possible use something like the Wolfram Alpha Appliance. Have to see how much that costs.

Phil 10.8.14

8:00 – 2:30 SR

  • Backups!
  • More angular. Filters yesterday, directives today?
  • Discovered an interesting problem with bound arrays, at least for strings. If the value that Angular is using to connect it to the div is the same for two or more rows, it complains with a “Error: [ngRepeat:dupes] Duplicates in a repeater are not allowed. Use ‘track by’ expression to specify unique keys”. The default seems to be the first column. This is discussed in the documentation here, with the upshot that you can generally get around this by using “<div ng-repeat="value in [4, 4] track by $index"></div>“. not sure how that would play with some of the large tables we’re using. I’ve just tried this for objects, and it seems just fine. This implies that we’ll need to be careful about how we populate datagrids, but nothing horrible.
  • Working my way through ng-route.

Phil 10.7.14

8:00 – 4:00 SR

  • Another day, another ticket trying to get back my servers.
  • Updated the database though, through the scripting server.
  • More Angular. First, we’re going to try to move the QueryService off to it’s own file.
  • AngularJS: Getting around ngApp limitations with ngModule
  • Here’s how to have multiple files with dependencies in Angular, at least insofar as I can tell.
  • First, make sure that all your scripts are listed at the bottom of your html file. In this case, the ng-app is queryAppServlet, which is shown below:
<html ng-app="queryAppServlet">
    <body ng-controller="MainCtrl as mainCtrl">
        <script src="libs/angular.js"> </script>
        <script src="queryAppServlet.js"></script>
        <script src="tomcatConnection.js"></script>
    </body>
</html>
  • Each javascript file contains an individual module. Here’s a truncated version of ‘tomcatConnection.js’:
 var tc = angular.module('tomcatConnection', []);
 tc.factory('QueryService', ['$http', function($http){
     "use strict";
     var items = ["Ready"];
     var message = "No Messages";
     var subscribers = [];
     return{
         addSubscriber: function(subscr){
         subscribers.push(subscr);
     }
}]);
  • ‘queryAppService.js’ uses tomcatConnect for the communication with the server. It looks like this:
var qa = angular.module('queryAppServlet', ['tomcatConnection']);
qa.controller('MainCtrl', ['QueryService', '$http', function (QueryService, $http) {
     "use strict";
     var self = this;
     QueryService.addSubscriber(self);
     self.query = "show tables";

     self.items = QueryService.getItems();
     self.message = QueryService.getMessage();

     self.submit = function(){
         QueryService.submit(self.query);
     };
}]);

Phil 10.6.14

8:00 – 10:00, 1:00 – 5:00 SR

  • No joy in getting on the servers. Put in another ticket to get my admin accounts back(?)
  • Ronda seems to be making progress though
  • Angular
    • learning about $q
    • Re-rigged the Angular ‘QueryAppServlet’ to use a service. There doesn’t seem to be a straightforward way to bind the values from the service to the controller, so I used a pubsub pattern, which worked just fine and I don’t feel too bad about it, but it seems… clunky. In looking for an answer, I found this discussion on stackoverflow, which I need to spend more time reading.
    • Tried to get the Java Servlet to see straight json, but no luck. back to URL encoding.