Friday Log (9.11.2009)

7:30 – 4:00

  • Gloomy damned day
  • Committed the new ingestors
  • Fixed the query builder so that selects are inserted before any other reserved word. This means that any fancy query can be adjusted by clicking on columns without loosing the clauses
  • Meeting with Pat, Anne, John, Mike K, and Brian
  • Fixed the query reference so that it does not contain developer info
  • Need to do the following:
    • Enable tooltips on title bar and widget finder
    • Make query into a TextArea?
    • Keep tabs on save. It may be broken
    • See if it’s possible to build a tree view of the columns that group by sections that match within underscores (i.e. “foo_bar” and “foo_baz” would be under “foo”)
    • Add search to builder
    • Make darker panels – done
    • Make bigger scrollbars – done

Thursday Log (9.10.09)

7:30 – 4:00

  • Ingested data at the Fort
  • Talked to Anne about the next proposal – I think it’s more of a TUMMS monitoring app with CoreItems than VISIBILITY or AppBoard
  • Making a csv ingestor to deal with all of the xls ingestion problems – done
  • Also put together a tab seperated ingestor
  • Looked over Brian’s proposal

Wednesday Log (9.9.9)

7:30 – 3:30

  • Updated data at the Fort
  • Verified that if I run tomcat as myself, that remote uploading can work. The problem is that the server box won’t let Tomcat run with my id once I log off. And it automatically logs you off, so it can’t be left in the state that we leave the subversion server or laureldemo. Sigh
  • Cleaned out some of the debugging traces in the code.
  • Still had some problems reading files with special characters in the columns. Going to work on that next. – Fixed
  • Meeting on new Mission Dashboard Thingy

Tuesday Log (9.8.2009)

7:30 – 4:00

  • Updated data
  • Discovered a bug with Uploader.java – it’s including the path as well as the filename when storing data in the upload directory
  • Had some problems ingesting Anne’s new spreadsheet – columns with “-” and ” ‘ ” made mySQL choke without a good message to the user – had to go through the server log
  • I showed Arron what was going on, and he has two suggestions:
    • Diff the code that we have now with code from early August and see what the difference is. It might be something obvious.
    • Change the connect() and disconnect() methods so that they re-use the connection if it exists. Add a terminate() method that calls connect() and then closses the connection at the end of the remote object call.
  • Turns out that some browsers may store the entire path in the item name. Added some checks and am testing with Firefox, IE, and Opera
  • Burned a new copy of VIS2
  • Installed at the fort. Igestors now work! THe last remaining problem is that the auto ingestors need to work as a SYSTEM service

Friday Log (9.4.2009)

8:00 – 4:00

  • set pom so the output war is now called Visibility3.war – done
  • Change the VISIBILITY_DEPLOY variable in FlexBuilder preferences->General->Workspace->LinkedResources to point to Visibility3 – done
  • Change the VISIBILITY_SERVER_SERVICES variable in FlexBuilder preferences->General->Workspace->LinkedResources to point to Visibility3 – done
  • Set the AccountManagers->Preferences->Root URL to Visibility3 – done
  • Set the IngestManager->Preferences->Root URL to Visibility3 – done
  • Set the vis2->Preferences->Root URL to Visibility3 – done
  • Have uploader.java produce a better web page so that uploading doesn’t seem so skanky.
  • Continue to beat on ingestor problems

Thursday Log (9.3.2009)

7:00 – 7:00

  • Hopefully, today we can have a better install.
  • Need to do the following:
    • Get an HTML-based file upload running that we can have the flash app point to. That seems to be working in VisibilityHsqlServer
    • Get a stand-alone version of the ingestor running with some test files so that we can do some debugging at the fort
    • Fix the ingestor so that it can 1) Point to a remote file – i.e. “\yourServeryourDirectoryyourfile.xml”  2) Verify that the file is visible, 3) Ingest the file immediately, and then on a schedule.
  • Deployed the new version as Visibility3
    • Need to change the pom file so this tracks
    • After futzing about with endpoints and other issues, got the new version to work, although with the same problems as last time. However, the HTML version of upload works, so I’m going to change the upload to launch a webpage to handle uploading until we can figure out what’s going on.
    • Ran a lot of tests and took screenshots. These are now on Dong’s desk.

Wednesday Log (9.2.2009)

7:30 – 5:30

  • Deployed
  • There is going to be a demo on Sept 11
  • Added “Select All” and “Clear All” to QueryBuilderBase
  • Everything works on Laureldemo – going to burn a disk – done
  • Going to the Fort to try rolling out the new version
  • Some things worked, a lot didn’t:
    • File upload hangs
    • Timed ingestor won’t read in files that are not in the “uploads” directory
    • Ingestor has “too many connections” error with MySql and fails on combined.xml. Can read billets.xml. The old ingestor handles these files just fine.
    • Didn’t try ingesting xml

Tuesday Log (9/1/2009)

7:30 – 3:30

Monday Log (9.31.2009)

10:00 – 5:00

  • Demo for Pat
  • Deployed
  • Things to do:
    • Changes search from ‘==’ to ‘contains’ – done
    • Clear checks on new table selected – done
    • Add documentation button back
    • see how to do combinations of “and” and “or” in googleSQL
  • Timesheet!

Dong Shin Visibility Status – August '09

Week of 08/24

  • Completed Table/User/Role managment
  • Fix ingest bugs (Excel)
  • Ingestors return IngestResult
  • added warning about duplicate columns on IngestPanel

Week of 08/17

  • checked out project from SVN. Ingestor seems working, but lots of others seem broken. Need to talk to Phil. Renamed visibility2 to visibility2old and moved it to desktop for backup, checked out complete project.
  • reworked the AutoIngestor client to take day, time. Hide/show appropriate fields according to duration selection.

Week of 08/10

  • added time fields to Auto Ingest, both client and server, changes to AutoIngestorServlet to utilize time
  • modifying Flex clients for DbRemoteObject – pass UserInfoObjest
    • QueryBuilder.mxm
    • QueryWidgetBase.as
  • modifying DbRemoteObject.java to use UnserInfoObject
    • getRelationshipList
    • getMetaEntryList
    • getMetaEntryDetailsList
    • getQuery
    • getQueryWhere

Week of 08/03

Ingested Data Configuration Management

  • list of data ingested shown
  • publish status, classification, and roles can be changed
  • must override closeHandler so that the window can be brought back

Changes to Ingestor for Roles/Classification management- cont’d

  • Added file_name to table_data – changes to UsersAndRoles.java, TablesInfoObject.java, TablesInfoObject.as
  • Ingested Data Configuration
  • Changes to AutoIngest
    • AutoIngestConfirmWindow
    • AutoIngestFileWindow
    • changes to Servlet to add classification and roles
    • Deletion keeps the data table for now
  • Deletion of other’s data disabled from client
  • Ingestion of using other’s existing table name disabled from client
  • Highlight user’s data tables using different font coler
  • Ingest and Delete now works! (table_data, table_classifications, table_role_columns)
  • rework ingest and delete to use user information and table_data (lot of work!!!)
  • keep uid and id separate; uid is for ingested data tables, id is for user and data info tables

Moved all tables from users_and_roles to visibility_dev

  • com.edgeti.VisibilityServer.UsersAndRoles.UsersAndRoles.java
    • table_dashboards
    • table_data ***** changes required
    • table_data_role
    • table_data_user
    • talbe_roles
    • table_role_user
    • table_users

Friday Log (8.28.2009)

7:30 – 4:00

  • Deployed
  • Working on QueryBuilder. Also need to stop sending the full response over from the server and only send the discrete response
  • Finished QueryBuilder- now QueryBuilderBase. AdvancedQueryBuilder extends base. So QueryBuilder and AdvQueryBuilder should be deleted. Going to do that after the demo on Monday.
  • Set up a demo at S2F for Monday at 11:30

Thursday Log (8.26.2009)

8:00 – 4:30

  • Deployed. Uploaded and ingested a spreadsheet for Anne. It had some problems (duplicate columns and multiple worksheets) that had to be resolved. Also had a conversation with Mike C about HRMS data
  • Talked to Dong about making more instructive error messages for ingest
  • Email with Mike K. He’s going to be working on the layout manager
  • Going to get the check marks to autopopulate  today. Maybe depricate QueryWidget
  • Meeting with Anne – 2:00 – 4:00

Wednesday Log (2.26.2009)

7:30 – 4:00

  • Deployed. There was a note from Anne about a slow query. After looking at the logs, it looked like it could have been a query that used columns that were no longer in the data. She’s going to try to rebuild the query and see if that affects performance.
  • Talked to Dong about checking to see that columns exist before running the query. If they don’t then run the query in a degraded mode
  • Talked to Dong about role management admin screen
  • Working on putting column name checkboxes in AdvancedQueryBuilder – done
  • Need to add a rollover to search – done
  • Added Google Query Language Reference documentation to AdvancedQueryWidget