Phil 9.17.2021

Short day today. Leave here NLT 10:45. Bring grocery bags!

Found the Pushshift Github today. Could be quite useful

Submitted the actual dissertation to the copyright office.

GPT Agents

  • Working on training models for French, Chinese, and Mexican restaurants on the corpora I built yesterday. Need to extract 10k items of ground truth while training
  • French Model
***** train metrics *****
  epoch                    =        6.0
  train_loss               =     2.9698
  train_runtime            = 2:32:07.50
  train_samples            =       5929
  train_samples_per_second =      3.897
  train_steps_per_second   =      3.897
09/16/2021 19:05:49 - INFO - __main__ - *** Evaluate ***
[INFO|trainer.py:2165] 2021-09-16 19:05:49,388 >> ***** Running Evaluation *****
[INFO|trainer.py:2167] 2021-09-16 19:05:49,388 >>   Num examples = 2281
[INFO|trainer.py:2170] 2021-09-16 19:05:49,388 >>   Batch size = 8
100%|████████████████████████████████████████████████████████████████████████████████| 286/286 [02:37<00:00,  1.82it/s]
***** eval metrics *****
  epoch                   =        6.0
  eval_loss               =     3.0133
  eval_runtime            = 0:02:38.06
  eval_samples            =       2281
  eval_samples_per_second =     14.431
  eval_steps_per_second   =      1.809
  perplexity              =    20.3535
  • Chinese Model
***** train metrics *****
  epoch                    =        6.0
  train_loss               =     2.9474
  train_runtime            = 2:29:11.94
  train_samples            =       5808
  train_samples_per_second =      3.893
  train_steps_per_second   =      3.893
09/17/2021 09:10:58 - INFO - __main__ - *** Evaluate ***
[INFO|trainer.py:2165] 2021-09-17 09:10:58,203 >> ***** Running Evaluation *****
[INFO|trainer.py:2167] 2021-09-17 09:10:58,203 >>   Num examples = 1090
[INFO|trainer.py:2170] 2021-09-17 09:10:58,203 >>   Batch size = 8
100%|████████████████████████████████████████████████████████████████████████████████| 137/137 [01:15<00:00,  1.81it/s]
***** eval metrics *****
  epoch                   =        6.0
  eval_loss               =     2.9766
  eval_runtime            = 0:01:16.25
  eval_samples            =       1090
  eval_samples_per_second =     14.295
  eval_steps_per_second   =      1.797
  perplexity              =    19.6214
  • Mexican Model
***** train metrics *****
  epoch                    =        6.0
  train_loss               =     2.9156
  train_runtime            = 1:48:46.94
  train_samples            =       4214
  train_samples_per_second =      3.874
  train_steps_per_second   =      3.874
09/17/2021 11:04:52 - INFO - __main__ - *** Evaluate ***
[INFO|trainer.py:2165] 2021-09-17 11:04:52,237 >> ***** Running Evaluation *****
[INFO|trainer.py:2167] 2021-09-17 11:04:52,237 >>   Num examples = 2175
[INFO|trainer.py:2170] 2021-09-17 11:04:52,237 >>   Batch size = 8
100%|████████████████████████████████████████████████████████████████████████████████| 272/272 [02:29<00:00,  1.82it/s]
***** eval metrics *****
  epoch                   =        6.0
  eval_loss               =     2.9759
  eval_runtime            = 0:02:30.52
  eval_samples            =       2175
  eval_samples_per_second =     14.449
  eval_steps_per_second   =      1.807
  perplexity              =    19.6069

SBIR(s)

  • Work on getting an animated canvas working. Done!