Friday Log (8.14.2009)

  • Working on QueryInfoObject – finished the java side, mostly done on the flex side
  • Started advanced tab in querybuilder – got to the point that A query is sent and the results come back and are visible in the debugger. For Monday, start transitioning over queryWidgets to use the google format and replace the whereClause code
  • Talked to Anne for a while about the source for the combined.xml file. She’s going to talk to Mike C.

Thursday Log (8.13.2009)

  • Deployed data at the fort
  • Started getting classification working. Managed to break the server (the jblocks jar is needed) so we punted for a while
  • Lunch for Mike
  • Working on getting the google API integrated
  • Select Al button in Query builder is broken

Wednesday Log (8.12.2009)

  • Deployed data at the fort
  • There was a problem with the spreadsheet that we had uploaded. Fixed
  • Got the google Visualzation data API working
  • Walked Ines through how Vis2 works

Mike Kluever Status – week of 8/10/2009

  • Adjusted DynamicPanel to allow the saving / loading of minimized / maximized states
  • Implemented the saving of DynamicPanel states in the vis 2 views
  • Created simplified basic query builder
  • Walked through some of the procedure required to use PKI and integrate in to a central authentication server
  • Changed the spawning of new QueryWidgets from clicking in a chart to first making a selection then clicking a button
  • Commented a number of classes

Tuesday, 8.11.2009

8:00 – 4:30

  • Had a long discussion with Mike about form input and building a more customized query.
  • Thinking about making the query like what Lance and I were pondering on TUMMS – a Google-style interface(http://code.google.com/apis/base/docs/2.0/query-lang-spec.html)
    • a blank line would return all values in a table
    • the full or partial name of a column would return the values for the column (i.e. “bar” would return all the values of column “bar”, while “ba*” would return all the values for “bar” and “baz”.
    • the default search term (and the default) is “columns:”, which means return onlyt the values specified. The other option is “row”, which means to return all columns where the specified constraints are met. (“rows: foo[10]” would return all entries where the value for the columns “foo” is 10)
    • Brackets would constrain searches ( ba* [1..10] would return all entries of bar and baz that lie between 1 and 10 inclusive, while animals[kittens, puppies, ponies] would constrain the search to only those animals listed)
    • Searches could be combined so that ba*[1..10], date[1/1/1990..1/1/2000] would return all the values for bar and baz that are between 1 and 10 and were collected within the specified dates
    • The NOT operator “!” can be used to keep something from being returned (“rows: !ba*” will return the contents of the table without “bar” or “baz”, while “columns: !foo[10]” will return all vaues of foo that are not 10)
  • Looks like there is a java API that supports this: (http://code.google.com/apis/visualization/documentation/dev/dsl_intro.html). Also, there is a nice video overview here: http://code.google.com/apis/visualization. It’s not quite what’s specified above, but it’s close, and it’s got MySQL support. Going to look more deeply tomorrow.
  • Another useful link on same: http://ouseful.wordpress.com/2009/05/18/using-google-spreadsheets-as-a-databace-with-the-google-visualisation-api-query-language/

Mike – Week of 8/10/09

  • Helped Inez Mitchell upload an excel spreadsheet to the currently deployed Vis2 instance and play around with it
  • Modified Dynamic Panels to save off minimized/maximized state and load in correctly with or without layout managers

Mike – Week of 8/03/09

  • Deployed a new version inside to help diagnose pop-up / export issues: it is definitely a size limit imposed by the proxy
  • Implemented a tip of the day welcome panel to prototype shared object functionality which may later be used in default dashboard saving
  • Provided a status update to John Williams
  • Added an ‘Advanced’ menu to QueryWidgets allowing users direct control over the columns on the widget and the queries being run against those columns.  Advanced users can now add / remove columns on the fly as well as create more robust queries.
  • Gave a demo to a number of S2F members and added some more beta user accounts

Dong Shin Visibility Status – July 09

Week of 07/27

  • changes to Ingestor for Roles/Classification management
    • listTables() working – need ingest working
    • change TableInfoObject.as and TableInforObject.java
    • changed table structure in the database, table_data, uid to id.
    • added IngestConfirmWindow to IngestManager
    • added getColumnHeaders to XMLIngestor.java, ExcelIngestor.java
    • added listColumnHeaders to IngestManger.java
    • added Roles and Classification for file selected to IngestVBox.mxml
    • addes StringColumn.as ad ColumnRenderer.mxml for Roles column selection
  • Started working on Tables Management util.
    • added tables management to ManagementUtilsText
    • TableInfoOjbect, TablesManager, TablesMgmtPanel
    • added getTablesTree() to UsersAndRoles.java
  • added user id to autoingest; FlexAutoIngestRow, IngestManager, AutoIngestor,
  • allowClose=false not working!!!!! added menu item to bring IngestManger back in case it’s closed
  • changed Canvas to ManagedCanvas to utilize Windows menu – abandoned because ManagedCanvas doesn’t support allowClose=false
  • added menus to IngestManager – disabled unnecessary ones for future use
  • added createTable() and constructor to DBRemoteObject.java to fix error when there TABLE_INFO table doesn’t exists.
  • SecurityUtils moved to ManagementUtils for accessing SecutiryUtil Objects
  • integrated LoginScreen.mxml to IngestManager

Week of 07/20

  • added tableinfo table to keep timestamp info when data gets ingested
  • added timestamp info to the returning table list and to return the data, server
  • added DROP / ADD DATABASE USERS_AND_ROLES
  • Finally solved build problems; checked out the complete project, overwrite the changes…. NEVER CREATE new projects in Flex/Eclipse!!!!!!!!!!!!!!!!!!!!!
  • create table if not exists added to handle merge – Server
  • File Browse button added to AutoIngestConfig, but directory cannot be appended to the filename… hardcoded path to C:/Program Files/Apache Software Foundation/Tomcat 6.0/webapps/Visibility2/uploads/
  • rearranged serverLog, ingestPanel, and debugPanel so that it lays out better
  • chaged all java files to utilize new log4j implementation
  • implemented AutoIngestorServlet to utilize AutoIngestor with preset interval defined in web.xml
  • TomCat servlet can be used with Timer.schedule
  • could not find a way to log with scheduled task. abandoned idea of using the scheduled task
  • Create a Scheduled Task – http://support.microsoft.com/kb/308569
  • Java Service Wrapper successfully set up AutoIngestor as a service – C:UsersDong ShinDesktopwrapper-delta-pack-3.3.5
  • Created C:Program FilesApache Software FoundationTomcat 6.0webappsrunAutoIngest.bat to run AutoIngest from command line
  • Started looking into Java Services for windows
  • rebuilt flex projects with the improved logger. Had compile issues, but Flex Build Paths settings needs reset.
  • started FlexMySQLAdmin to experiment database interface using amfPHP and Flex
  • Change project compiler setting for AMFPHP – -services “services-config.xml”

Week of 07/13

  • Enable/Disable buttons on IngestPanel according to user selection
  • Set up XAMPP to use different port: 8080, disable SSL.
  • Added merge option for data ingest – client and server (07/16)
  • Added merge option for automatic data ingest configutation – clien and server
  • data uploader now hidden under Upload File Control – client
  • changed Table Name setting to use all lower case to match DB tablenames – client
  • changed Server return of boolean to readable message – server
  • merged data uploader with ingestor – client (07/15)
  • delete table added  – client and server (7/14)

Week of 07/06

  • changed dynamic panel on IngestPanel to  SaveStatePanel – client
  • IngestPanel now not closeable…
  • added AutoIngestConfigVBox for configuration of auto ingest – client and server
  • deleted old Data Ingestor codes – server
  • created new DatabaseIf.java for better interface and control – server
  • File Ingest support all xml and xls files in one window – client
  • added filter for each supported ingest file type – client
  • added existing database tables to view o the ingest panel  – client

Wednesday Log (7.29.2009)

7:00 – 4:30

  • Deployed new VIS2 at fort. Problems with screenshots and excel export
  • Went over next two week schedule with Dong and Mike
  • Proposal work for VIS2 next phase

Tuesday Log (7.28.2009)

7:00 -3:00

  • Meeting at the fort this morning with John and Anne. Basically to discuss what it would take to put together schedule and cost for finishing VIS2 and also doing form input
  • Got roles working in ManagementUtils
  • Built a method for Dong to get whether one role is above or below another
  • Worked with Mike to get the Excel exporter working
  • Burned disks for tomorrow’s deploy attempt.

Mike – Week of 7/27/09

  • Added Export to Excel button and backing code
  • Added screen shot button and backing code
  • Helped Tom with checking out and building code
  • Added delete dashboard feature to save dialog
  • Deployed latest version inside
  • Met with Anne to discuss new features and take her input
  • Selected column and chart and now properly saved / loaded
  • Debugging issue with Excel export and snapshot
  • Added change password feature to log in page
  • Implemented the find panel list

Monday Log (727.2009)

8:00 – 4:00

  • Making role addition work when there are no roles to attach to. Done
  • Need to upload new role tree. Which means I need a RoleInfoObject – Done
  • Meeting tomorrow with John Williams

Friday Log (7.24.2009)

6:30 – 1:30 (3:30 actual, but with 2 hr lunchtime appt)

  • Deployed this morning. The scheduled task didn’t occur – windows (sigh). Also made the _wtfPanel invisible.
  • Working on getting role panel up and running. Role loading and tree manipulation are done. Need to upload the results. Also, maybe add an xml ingester to save work?
  • Doctor’s appt. today at noon.

Thursday Log (7.22.2009)

7:30 – 4:30

  • Deployed, but had a tough time doing so. It looks like the exception handling in the Flex logger that Mike wrote is making the code go off and hang – not sure where. After we realized that, everything went reasonably smoothly.
  • Changed the ManagementUtilsTest to be menu driven
  • Need to add role configuration and login screen (with backdoor, for original install)