- working on queries for Query Builder
- added indexes to the tables used in the detailed data
- created views for tables that use SUM() and GROUP_CONCAT()
- seemed to make queries faster, will try these tomorrow on-site
Category Archives: VizTool Priority List
Dong Shin 07.11.2014
- tried to set up the VM server in office… too slow!
- trouble-shooting slow query
- copying to tmp table is the bottle neck
- tmp_table_size is set to 16M = max_heap_table_size
-
-- set the temp memory size to 512MB SET tmp_table_size = 512000;
- slightely faster on mine…
Dong Shin 07.10.2014
- fixed weird cell height problem in Query Builder (happens in FireFox and IE)
- added itemRenderer to format % values to one decimal points that are less than 100%
- working on Query Builder
- trying profileSQL – http://www.profilesql.com/download/
Dong Shin 07.09.2014
- deployed FA – font for Status Yellow turns white!!! – fixed
- created a query to generate master data per budget center, seems slow… will test tomorrow on-site
Dong Shin 07.08.2014
- deployed new FA
- Status ItemRenderer changes when scrolling in Query Builder – fixed
- working on new Query Builder
- refining master data table to include all appropriation years in a row instead of separated by a year
- SELECT
SUM(IF(year_count=1,SUM(IF(type = ‘Planned Obligated $:’, month_1, 0)),0)) AS planned_obligated_year_1_month_1,
SUM(IF(year_count=1,SUM(IF(type = ‘Reported FACTS Obligated $:’, month_1, 0)),0)) AS reported_facts_obligated_year_1_month_1,
SUM(IF(year_count=1,SUM(IF(type = ‘Planned Outlay $:’, month_1, 0)),0)) AS planned_outlay_year_1_month_1,
SUM(IF(year_count=1,SUM(IF(type = ‘Reported Outlay $:’, month_1, 0)),0)) AS reported_outlay_year_1_month_1,
SUM(IF(year_count=1,SUM(IF(type = ‘PM Actuals (Invoiced) Outlay $:’, month_1, 0)),0)) AS pm_actuals_year_1_month_1,
SUM(IF(year_count=1,SUM(IF(type = ‘Outlay $ (Reported in FACTS)’, month_1, 0)),0)) AS reported_facts_outlay_year_1_month_1
FROM obligations_outlays
GROUP BY funding_id
Dong Shin 07.07.2014
- < would not work in FAChangeLogs.xml….. > works though. This caused the FA app to crash!
- changed Font Colors for Obligation/Outlay/PM Actuals status to white when the status is Green/Red
Dong Shin 06.26.2014
- tried to deploy the new Query Builder, the queries are too slow… 6 minutes! will try this tomorrow
- ‘Copying to tmp table’, ‘2.432915’
‘Sorting result’, ‘0.899327’
‘Sending data’, ‘0.783034’ - SHOW VARIABLES LIKE ‘max_heap_table_size’;
- ‘max_heap_table_size’, ‘16777216’
- SHOW VARIABLES LIKE ‘tmp_table_size’;
- ‘tmp_table_size’, ‘16777216’
- ‘Copying to tmp table’, ‘2.432915’
- added last COGNOS upload status to FA
- added status (Red, Yellow, Green) to Obligated, Outlay, PM Actuals % value columns in Query Builder (old)
Dong Shin 06.25.2014
- added last file uploaded info to Reqonciler
- working on Query Builder
- load column info to Query Builder
- added color coded status to Obligations, Outlays, and PM Actuals – configure in queryBuilderConfig2.xml
Dong Shin 06.24.2014
- working on Query Builder
- fixed publish/unpublish bug
- fixed save
- fixed NULL returning in percent values – NULL ≠0!!!!
- fixed Req Info update bug
Dong Shin 06.23.2014
- put old FA (Query Builder) back on-site
- working on Query Builder
- added obligation, outlay, pm actual percents in config
- fixed Update Requisition
- reworked __view_project_detailed_data to include service poc’s and fixed goals percents
Dong Shin 06.20.2014
- deployed new FA with the reworked Query Builder – all is well.
- experimented with MariaDB and some database performance testing on-site.
- working on Query Builder
- added Obligation, Outlay, PM Actuals columns back…. still need % values
- required columns added to queryBuilderConfig.xml
Dong Shin 06.19.2014
- did some performance testing of the temporary table, __view_project_detailed_data
- data generation took 90 sec
- query is faster
- need Update button in Query Builder when data generation is needed
- installed MariaDB and compared the performance
- data generation too 20 sec
- some error running stored procedure… may need to run – mysql_upgrade.exe -uroot -p –force
#1728 - Cannot load from mysql.proc. The table is probably corrupted
- working on Query Builder
- added Update Data in Query Builder to update project detailed data
- added _table_last_update_status to keep track of tables status
- added triggers to update the _table_last_update_status – obligations_outlays, budget_centers, committed_amount, and contracts_cognos for now
- modified users queries to match new structure of __view_project_detailed_data
Dong Shin 06.16.2014
- deployed the view __view_project_detailed_data, too slow, > 20 sec.
- reworking queries to generate the project detailed data….
- removed all references to other views…
- changed ‘LIKE’ to ‘=’
- performance improved, but still not satisfied….
- installing MariaDB
Dong Shin 06.13.2014
- checked out projects from new SVN repo
- builds, but cannot check in…. permission issues
- org.apache.subversion.javahl.ClientException: Permission denied
svn: Commit failed (details follow):
svn: Can’t move ‘/home/vectr/svn/307519/db/txn-protorevs/3263-2iv.rev’ to ‘/home/vectr/svn/307519/db/revs/3/3264’: Permission denied
Dong Shin 06.12.2014
- working on Query Builder
- converted old queries to new format
- reworked __view_total_committed_amount_by_budget_center
- CREATE ALGORITHM=UNDEFINED DEFINER=`root`@`localhost` SQL SECURITY DEFINER VIEW `__view_total_committed_amount_by_budget_center` AS select `committed_amounts`.`budget_center_id` AS `budget_center_id`,sum(`committed_amounts`.`committed_amount`) AS `total_committed_amount`,MAX(`committed_amounts`.`committed_date`) AS `max_committed_date`, group_concat(`committed_amounts`.`committed_date` separator ‘,’) AS `committed_dates` from `committed_amounts` group by `committed_amounts`.`budget_center_id`;
- reworked __view_project_detailed_data to include obligation date and committed date
- going through the user queries….
- svn migration complete – trying to check out…

You must be logged in to post a comment.