Tuesday Log (8.25.2009)

7:30 – 3:30

  • Deployed data
  • Working on search in AdvancedQueryWidget. Also did QueryWidget. Took a while to figure out how to set selected in a chart. Turns out you set the selected index of the series.
  • Need to add column checkbox to ADG

Monday Log (8.24.2009)

7:30 – 4:00

  • Deployed VIS1 & 2
  • Talked to Mike C about putting “Current”, “stale” and “Obsolete” tags in a “Data Freshness” column in his data sources
  • Sent a note of To Mike K about making a Pat display
  • Talked to Dong about roles
  • Caught up with Brian and Clift.
  • AdvancedQueryWidget
    • Put new where clauses immediately after “where” – done
    • Add implicit “select”? – still thinking about this
    • Added the ability to set the query in the builder from an AdvancedQueryWidget
    • Getting loading and saving working
    • Need to have “setQueryBuilder” also set the table name. This requires adding table to QueryStringEvent – done

Friday Log (8.21.2009)

7:30 – 4:00

  • No meeting today – put off until next week sometime
  • Showed Anne the new stuff – her suggestions:
    • Have an indication in the chart as to what columns is being displayed
    • Populate the QueryBuilder from the loaded chart so that additional queries, based on the current query can be performed
  • Back to AdvancedQueryWidget.
    • Got the date grid part working
    • Need to match up data types from the google types->primType->ColumnInfoObject
    • Integrating charts – things are displaying properly.
    • Need to get AdvancedQueryWidget to save and load properly
    • Need to change AdvancedQueryWidget so that the “and” clauses are inserted immediately after the where. See line 119 for details.

Thursday Log (8.20.2009)

8:00 – 4:00

  • Prepping for 10:00 meeting
    • There will be some kind of follow up meeting where I bring in a laptop to evaluate responses
    • Add search box for Inez. Done, but not wired to the datagrid/dataprovider highlighting yet
    • Didn’t get to AdvancedQueryWidget at all today. Try again tomorrow
  • Stuff for Mike
    • Need a layout that has the query builder open with the appropriate boxes checked
    • Cascade layout should put panes back in their saved xy positions in addition to size
    • Column ordering is not saved (does not load in saved order)
    • Vertical scroll layout should adjust so that QueryBuilder does not obscure

Wednesday Log (8.19.2009)

7:30 – 5:30

  • Deployed at the fort. Told Kathy W. and John W. that we’d have a better interface in about two weeks. Meeting tomorrow at 10:00
  • Helped Dong fix his project
  • Added user info to all remote object queries
  • Back to advanced query widget
  • Got most of the pieces put together. Need to extend QueryWidgetBase to AdvancedQueryWidget, and deal with columns and saving/loading

Monday Log (8.17.2009)

8:00 – 4:00

  • Clear fluids today! Wheee!
  • Deployed at the fort. Combined now ingests in a few seconds. Talked to Mike C about various issues. Tuns out that there was a bug in Mike’s code that generated spurious entries in the xml table.  The upshot is that we’ll wait to see how Anne likes the new data
  • Talked to John W. He’s like a not from Brian about our burn rate and how it gets us through to October
  • Working on Advanced Queries. Just realized that there is no equivalent for mySQL “discrete”. Goint to have to figure out a workaround. Not only that, but advanced queries can’t be the same as “normal” if this is the case. Hmmmm. Fixed by putting rows in a HashMap with their string values as the key

Friday Log (8.14.2009)

  • Working on QueryInfoObject – finished the java side, mostly done on the flex side
  • Started advanced tab in querybuilder – got to the point that A query is sent and the results come back and are visible in the debugger. For Monday, start transitioning over queryWidgets to use the google format and replace the whereClause code
  • Talked to Anne for a while about the source for the combined.xml file. She’s going to talk to Mike C.

Thursday Log (8.13.2009)

  • Deployed data at the fort
  • Started getting classification working. Managed to break the server (the jblocks jar is needed) so we punted for a while
  • Lunch for Mike
  • Working on getting the google API integrated
  • Select Al button in Query builder is broken

Wednesday Log (8.12.2009)

  • Deployed data at the fort
  • There was a problem with the spreadsheet that we had uploaded. Fixed
  • Got the google Visualzation data API working
  • Walked Ines through how Vis2 works

Mike Kluever Status – week of 8/10/2009

  • Adjusted DynamicPanel to allow the saving / loading of minimized / maximized states
  • Implemented the saving of DynamicPanel states in the vis 2 views
  • Created simplified basic query builder
  • Walked through some of the procedure required to use PKI and integrate in to a central authentication server
  • Changed the spawning of new QueryWidgets from clicking in a chart to first making a selection then clicking a button
  • Commented a number of classes

Tuesday, 8.11.2009

8:00 – 4:30

  • Had a long discussion with Mike about form input and building a more customized query.
  • Thinking about making the query like what Lance and I were pondering on TUMMS – a Google-style interface(http://code.google.com/apis/base/docs/2.0/query-lang-spec.html)
    • a blank line would return all values in a table
    • the full or partial name of a column would return the values for the column (i.e. “bar” would return all the values of column “bar”, while “ba*” would return all the values for “bar” and “baz”.
    • the default search term (and the default) is “columns:”, which means return onlyt the values specified. The other option is “row”, which means to return all columns where the specified constraints are met. (“rows: foo[10]” would return all entries where the value for the columns “foo” is 10)
    • Brackets would constrain searches ( ba* [1..10] would return all entries of bar and baz that lie between 1 and 10 inclusive, while animals[kittens, puppies, ponies] would constrain the search to only those animals listed)
    • Searches could be combined so that ba*[1..10], date[1/1/1990..1/1/2000] would return all the values for bar and baz that are between 1 and 10 and were collected within the specified dates
    • The NOT operator “!” can be used to keep something from being returned (“rows: !ba*” will return the contents of the table without “bar” or “baz”, while “columns: !foo[10]” will return all vaues of foo that are not 10)
  • Looks like there is a java API that supports this: (http://code.google.com/apis/visualization/documentation/dev/dsl_intro.html). Also, there is a nice video overview here: http://code.google.com/apis/visualization. It’s not quite what’s specified above, but it’s close, and it’s got MySQL support. Going to look more deeply tomorrow.
  • Another useful link on same: http://ouseful.wordpress.com/2009/05/18/using-google-spreadsheets-as-a-databace-with-the-google-visualisation-api-query-language/

Mike – Week of 8/10/09

  • Helped Inez Mitchell upload an excel spreadsheet to the currently deployed Vis2 instance and play around with it
  • Modified Dynamic Panels to save off minimized/maximized state and load in correctly with or without layout managers

Mike – Week of 8/03/09

  • Deployed a new version inside to help diagnose pop-up / export issues: it is definitely a size limit imposed by the proxy
  • Implemented a tip of the day welcome panel to prototype shared object functionality which may later be used in default dashboard saving
  • Provided a status update to John Williams
  • Added an ‘Advanced’ menu to QueryWidgets allowing users direct control over the columns on the widget and the queries being run against those columns.  Advanced users can now add / remove columns on the fly as well as create more robust queries.
  • Gave a demo to a number of S2F members and added some more beta user accounts

Dong Shin Visibility Status – July 09

Week of 07/27

  • changes to Ingestor for Roles/Classification management
    • listTables() working – need ingest working
    • change TableInfoObject.as and TableInforObject.java
    • changed table structure in the database, table_data, uid to id.
    • added IngestConfirmWindow to IngestManager
    • added getColumnHeaders to XMLIngestor.java, ExcelIngestor.java
    • added listColumnHeaders to IngestManger.java
    • added Roles and Classification for file selected to IngestVBox.mxml
    • addes StringColumn.as ad ColumnRenderer.mxml for Roles column selection
  • Started working on Tables Management util.
    • added tables management to ManagementUtilsText
    • TableInfoOjbect, TablesManager, TablesMgmtPanel
    • added getTablesTree() to UsersAndRoles.java
  • added user id to autoingest; FlexAutoIngestRow, IngestManager, AutoIngestor,
  • allowClose=false not working!!!!! added menu item to bring IngestManger back in case it’s closed
  • changed Canvas to ManagedCanvas to utilize Windows menu – abandoned because ManagedCanvas doesn’t support allowClose=false
  • added menus to IngestManager – disabled unnecessary ones for future use
  • added createTable() and constructor to DBRemoteObject.java to fix error when there TABLE_INFO table doesn’t exists.
  • SecurityUtils moved to ManagementUtils for accessing SecutiryUtil Objects
  • integrated LoginScreen.mxml to IngestManager

Week of 07/20

  • added tableinfo table to keep timestamp info when data gets ingested
  • added timestamp info to the returning table list and to return the data, server
  • added DROP / ADD DATABASE USERS_AND_ROLES
  • Finally solved build problems; checked out the complete project, overwrite the changes…. NEVER CREATE new projects in Flex/Eclipse!!!!!!!!!!!!!!!!!!!!!
  • create table if not exists added to handle merge – Server
  • File Browse button added to AutoIngestConfig, but directory cannot be appended to the filename… hardcoded path to C:/Program Files/Apache Software Foundation/Tomcat 6.0/webapps/Visibility2/uploads/
  • rearranged serverLog, ingestPanel, and debugPanel so that it lays out better
  • chaged all java files to utilize new log4j implementation
  • implemented AutoIngestorServlet to utilize AutoIngestor with preset interval defined in web.xml
  • TomCat servlet can be used with Timer.schedule
  • could not find a way to log with scheduled task. abandoned idea of using the scheduled task
  • Create a Scheduled Task – http://support.microsoft.com/kb/308569
  • Java Service Wrapper successfully set up AutoIngestor as a service – C:UsersDong ShinDesktopwrapper-delta-pack-3.3.5
  • Created C:Program FilesApache Software FoundationTomcat 6.0webappsrunAutoIngest.bat to run AutoIngest from command line
  • Started looking into Java Services for windows
  • rebuilt flex projects with the improved logger. Had compile issues, but Flex Build Paths settings needs reset.
  • started FlexMySQLAdmin to experiment database interface using amfPHP and Flex
  • Change project compiler setting for AMFPHP – -services “services-config.xml”

Week of 07/13

  • Enable/Disable buttons on IngestPanel according to user selection
  • Set up XAMPP to use different port: 8080, disable SSL.
  • Added merge option for data ingest – client and server (07/16)
  • Added merge option for automatic data ingest configutation – clien and server
  • data uploader now hidden under Upload File Control – client
  • changed Table Name setting to use all lower case to match DB tablenames – client
  • changed Server return of boolean to readable message – server
  • merged data uploader with ingestor – client (07/15)
  • delete table added  – client and server (7/14)

Week of 07/06

  • changed dynamic panel on IngestPanel to  SaveStatePanel – client
  • IngestPanel now not closeable…
  • added AutoIngestConfigVBox for configuration of auto ingest – client and server
  • deleted old Data Ingestor codes – server
  • created new DatabaseIf.java for better interface and control – server
  • File Ingest support all xml and xls files in one window – client
  • added filter for each supported ingest file type – client
  • added existing database tables to view o the ingest panel  – client